[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786098956060137-21165-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 10:35:56 dist-test-slave-0b58 krb5kdc[21172](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 10:35:56 dist-test-slave-0b58 krb5kdc[21172](info): set up 2 sockets
Aug 07 10:35:56 dist-test-slave-0b58 krb5kdc[21172](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260807 10:35:57.319515 21165 mini_kdc.cc:121] Time spent starting KDC: real 1.051s user 0.002s sys 0.022s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786098956060137-21165-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786098956060137-21165-0/krb5kdc/test-user.keytab.
Aug 07 10:35:57 dist-test-slave-0b58 krb5kdc[21172](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786098957, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T10:35:57Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T10:35:57Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.171.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.171.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.171.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.126.keytab.
Entry for principal kudu/127.20.171.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.126.keytab.
I20260807 10:35:57.508744 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786098956060137-21165-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786098956060137-21165-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786098956060137-21165-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.171.126:42183
--webserver_interface=127.20.171.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.126.keytab
--principal=kudu/127.20.171.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.171.84:43879
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.171.126:42183
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786098956060137-21165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786098956060137-21165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786098956060137-21165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:35:58.118666 21186 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:35:58.119136 21186 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:35:58.119393 21186 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:35:58.129088 21186 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 10:35:58.129269 21186 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:35:58.129400 21186 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:35:58.129593 21186 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 10:35:58.129706 21186 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 10:35:58.142894 21186 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.171.84:43879
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786098956060137-21165-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786098956060137-21165-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.171.126:42183
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.126.keytab
--principal=kudu/127.20.171.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.171.126:42183
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.171.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786098956060137-21165-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:35:58.144989 21186 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:35:58.146943 21186 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:35:58.172068 21191 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:35:58.171877 21194 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:35:58.172688 21192 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:35:58.173695 21186 server_base.cc:1034] running on GCE node
I20260807 10:35:58.174860 21186 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:35:58.177157 21186 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:35:58.178386 21186 hybrid_clock.cc:648] HybridClock initialized: now 1786098958178300 us; error 92 us; skew 500 ppm
I20260807 10:35:58.179033 21186 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:35:58 dist-test-slave-0b58 krb5kdc[21172](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786098958, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:35:58.183691 21186 init.cc:377] Logged in from keytab as kudu/127.20.171.126@KRBTEST.COM (short username kudu)
I20260807 10:35:58.186587 21186 webserver.cc:460] Webserver started at http://127.20.171.126:39845/ using document root <none> and password file <none>
I20260807 10:35:58.187664 21186 fs_manager.cc:359] Metadata directory not provided
I20260807 10:35:58.187798 21186 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:35:58.188337 21186 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:35:58.193475 21186 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786098956060137-21165-0/minicluster-data/master-0/data/instance:
uuid: "b6169e8cec3540139dd16aa05a938d23"
format_stamp: "Formatted at 2026-08-07 10:35:58 on dist-test-slave-0b58"
server_key: "fcbaa259210b06e3f556907164e3888c"
server_key_iv: "202b52a35e65671e3e5476f5d9146aa0"
server_key_version: "encryptionkey@0"
I20260807 10:35:58.194641 21186 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786098956060137-21165-0/minicluster-data/master-0/wal/instance:
uuid: "b6169e8cec3540139dd16aa05a938d23"
format_stamp: "Formatted at 2026-08-07 10:35:58 on dist-test-slave-0b58"
server_key: "fcbaa259210b06e3f556907164e3888c"
server_key_iv: "202b52a35e65671e3e5476f5d9146aa0"
server_key_version: "encryptionkey@0"
I20260807 10:35:58.203822 21186 fs_manager.cc:691] Time spent creating directory manager: real 0.008s user 0.009s sys 0.001s
I20260807 10:35:58.210970 21201 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:35:58.212998 21186 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.002s sys 0.004s
I20260807 10:35:58.213284 21186 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786098956060137-21165-0/minicluster-data/master-0/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786098956060137-21165-0/minicluster-data/master-0/wal
uuid: "b6169e8cec3540139dd16aa05a938d23"
format_stamp: "Formatted at 2026-08-07 10:35:58 on dist-test-slave-0b58"
server_key: "fcbaa259210b06e3f556907164e3888c"
server_key_iv: "202b52a35e65671e3e5476f5d9146aa0"
server_key_version: "encryptionkey@0"
I20260807 10:35:58.213553 21186 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786098956060137-21165-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786098956060137-21165-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786098956060137-21165-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:35:58.235297 21186 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:35:58.242041 21186 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:35:58.242489 21186 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:35:58.285228 21186 rpc_server.cc:307] RPC server started. Bound to: 127.20.171.126:42183
I20260807 10:35:58.285358 21253 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.171.126:42183 every 8 connection(s)
I20260807 10:35:58.287727 21186 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
I20260807 10:35:58.292136 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 21186
I20260807 10:35:58.292656 21165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786098956060137-21165-0/minicluster-data/master-0/wal/instance
I20260807 10:35:58.295122 21254 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:35:58.295153 21165 external_mini_cluster.cc:1428] Setting key d69088730b212cc9df7cba5b4ec9a2a6
I20260807 10:35:58.316191 21254 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b6169e8cec3540139dd16aa05a938d23: Bootstrap starting.
I20260807 10:35:58.323817 21254 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b6169e8cec3540139dd16aa05a938d23: Neither blocks nor log segments found. Creating new log.
I20260807 10:35:58.326254 21254 log.cc:824] T 00000000000000000000000000000000 P b6169e8cec3540139dd16aa05a938d23: Log is configured to *not* fsync() on all Append() calls
I20260807 10:35:58.331867 21254 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b6169e8cec3540139dd16aa05a938d23: No bootstrap required, opened a new log
Aug 07 10:35:58 dist-test-slave-0b58 krb5kdc[21172](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786098957, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.171.126@KRBTEST.COM
I20260807 10:35:58.346261 21254 raft_consensus.cc:348] T 00000000000000000000000000000000 P b6169e8cec3540139dd16aa05a938d23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b6169e8cec3540139dd16aa05a938d23" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 42183 } }
I20260807 10:35:58.346885 21254 raft_consensus.cc:374] T 00000000000000000000000000000000 P b6169e8cec3540139dd16aa05a938d23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:35:58.347134 21254 raft_consensus.cc:729] T 00000000000000000000000000000000 P b6169e8cec3540139dd16aa05a938d23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6169e8cec3540139dd16aa05a938d23, State: Initialized, Role: FOLLOWER
I20260807 10:35:58.348448 21254 consensus_queue.cc:260] T 00000000000000000000000000000000 P b6169e8cec3540139dd16aa05a938d23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b6169e8cec3540139dd16aa05a938d23" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 42183 } }
I20260807 10:35:58.348939 21254 raft_consensus.cc:388] T 00000000000000000000000000000000 P b6169e8cec3540139dd16aa05a938d23 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 10:35:58.349344 21254 raft_consensus.cc:482] T 00000000000000000000000000000000 P b6169e8cec3540139dd16aa05a938d23 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 10:35:58.349617 21254 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b6169e8cec3540139dd16aa05a938d23 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:35:58.352119 21257 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:35:58.301847 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38750 (local address 127.20.171.126:42183)
0807 10:35:58.306659 (+ 4812us) server_negotiation.cc:206] Beginning negotiation
0807 10:35:58.306678 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0807 10:35:58.306783 (+ 105us) server_negotiation.cc:407] Connection header received
0807 10:35:58.319065 (+ 12282us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:35:58.319086 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:35:58.319637 (+ 551us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:35:58.320127 (+ 490us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:35:58.324347 (+ 4220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:35:58.326316 (+ 1969us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:35:58.329474 (+ 3158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:35:58.330447 (+ 973us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:35:58.330629 (+ 182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:35:58.340732 (+ 10103us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:35:58.340783 (+ 51us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:35:58.340816 (+ 33us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:35:58.340859 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:35:58.345274 (+ 4415us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:35:58.346122 (+ 848us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:35:58.346129 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:35:58.346144 (+ 15us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:35:58.346430 (+ 286us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:35:58.347017 (+ 587us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:35:58.347024 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:35:58.347030 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:35:58.347872 (+ 842us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:35:58.348408 (+ 536us) server_negotiation.cc:1035] Waiting for connection context
0807 10:35:58.349442 (+ 1034us) server_negotiation.cc:299] Negotiation successful
0807 10:35:58.349896 (+ 454us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4270,"thread_start_us":3671,"threads_started":1}
I20260807 10:35:58.354175 21254 raft_consensus.cc:504] T 00000000000000000000000000000000 P b6169e8cec3540139dd16aa05a938d23 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b6169e8cec3540139dd16aa05a938d23" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 42183 } }
I20260807 10:35:58.355373 21254 leader_election.cc:302] T 00000000000000000000000000000000 P b6169e8cec3540139dd16aa05a938d23 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b6169e8cec3540139dd16aa05a938d23; no voters:
I20260807 10:35:58.357002 21254 leader_election.cc:288] T 00000000000000000000000000000000 P b6169e8cec3540139dd16aa05a938d23 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 10:35:58.357482 21259 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b6169e8cec3540139dd16aa05a938d23 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:35:58.362478 21254 sys_catalog.cc:564] T 00000000000000000000000000000000 P b6169e8cec3540139dd16aa05a938d23 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 10:35:58.362269 21259 raft_consensus.cc:686] T 00000000000000000000000000000000 P b6169e8cec3540139dd16aa05a938d23 [term 1 LEADER]: Becoming Leader. State: Replica: b6169e8cec3540139dd16aa05a938d23, State: Running, Role: LEADER
I20260807 10:35:58.363358 21259 consensus_queue.cc:237] T 00000000000000000000000000000000 P b6169e8cec3540139dd16aa05a938d23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b6169e8cec3540139dd16aa05a938d23" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 42183 } }
I20260807 10:35:58.372089 21260 sys_catalog.cc:455] T 00000000000000000000000000000000 P b6169e8cec3540139dd16aa05a938d23 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b6169e8cec3540139dd16aa05a938d23" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b6169e8cec3540139dd16aa05a938d23" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 42183 } } }
I20260807 10:35:58.372195 21261 sys_catalog.cc:455] T 00000000000000000000000000000000 P b6169e8cec3540139dd16aa05a938d23 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b6169e8cec3540139dd16aa05a938d23. Latest consensus state: current_term: 1 leader_uuid: "b6169e8cec3540139dd16aa05a938d23" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b6169e8cec3540139dd16aa05a938d23" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 42183 } } }
I20260807 10:35:58.373133 21260 sys_catalog.cc:458] T 00000000000000000000000000000000 P b6169e8cec3540139dd16aa05a938d23 [sys.catalog]: This master's current role is: LEADER
I20260807 10:35:58.373190 21261 sys_catalog.cc:458] T 00000000000000000000000000000000 P b6169e8cec3540139dd16aa05a938d23 [sys.catalog]: This master's current role is: LEADER
I20260807 10:35:58.376638 21269 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 10:35:58.388461 21269 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 10:35:58.415390 21269 catalog_manager.cc:1347] Generated new cluster ID: 5c6c3d37993d42dba5a9b07e6a7b8079
I20260807 10:35:58.415578 21269 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 10:35:58.436439 21269 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 10:35:58.438364 21269 catalog_manager.cc:1504] Loading token signing keys...
I20260807 10:35:58.446046 21269 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b6169e8cec3540139dd16aa05a938d23: Generated new TSK 0
I20260807 10:35:58.447171 21269 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.171.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.171.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.171.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.65.keytab.
Entry for principal kudu/127.20.171.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.65.keytab.
I20260807 10:35:58.499507 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786098956060137-21165-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786098956060137-21165-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786098956060137-21165-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786098956060137-21165-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.171.65:0
--local_ip_for_outbound_sockets=127.20.171.65
--webserver_interface=127.20.171.65
--webserver_port=0
--tserver_master_addrs=127.20.171.126:42183
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.65.keytab
--principal=kudu/127.20.171.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.171.84:43879
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786098956060137-21165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786098956060137-21165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786098956060137-21165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:35:59.126355 21282 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:35:59.126763 21282 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:35:59.127039 21282 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:35:59.137717 21282 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:35:59.137984 21282 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:35:59.138255 21282 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.171.65
I20260807 10:35:59.151718 21282 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.171.84:43879
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786098956060137-21165-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786098956060137-21165-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.65.keytab
--principal=kudu/127.20.171.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.171.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786098956060137-21165-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.171.65
--webserver_port=0
--tserver_master_addrs=127.20.171.126:42183
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.171.65
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786098956060137-21165-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:35:59.153272 21282 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:35:59.154939 21282 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:35:59.172142 21287 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:35:59.172663 21290 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:35:59.173184 21288 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:35:59.174268 21282 server_base.cc:1034] running on GCE node
I20260807 10:35:59.175026 21282 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:35:59.176216 21282 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:35:59.177488 21282 hybrid_clock.cc:648] HybridClock initialized: now 1786098959177402 us; error 53 us; skew 500 ppm
I20260807 10:35:59.177809 21282 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:35:59 dist-test-slave-0b58 krb5kdc[21172](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786098959, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:35:59.182797 21282 init.cc:377] Logged in from keytab as kudu/127.20.171.65@KRBTEST.COM (short username kudu)
I20260807 10:35:59.185756 21282 webserver.cc:460] Webserver started at http://127.20.171.65:34645/ using document root <none> and password file <none>
I20260807 10:35:59.186694 21282 fs_manager.cc:359] Metadata directory not provided
I20260807 10:35:59.186954 21282 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:35:59.187453 21282 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:35:59.192608 21282 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786098956060137-21165-0/minicluster-data/ts-0/data/instance:
uuid: "27d97d29bf314adc8bc5d6ab02ab16e1"
format_stamp: "Formatted at 2026-08-07 10:35:59 on dist-test-slave-0b58"
server_key: "fdb93b53107fa909d43992088a6f7ec8"
server_key_iv: "8d3ff6452e68cdf6e8758d450cb45e1c"
server_key_version: "encryptionkey@0"
I20260807 10:35:59.193703 21282 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786098956060137-21165-0/minicluster-data/ts-0/wal/instance:
uuid: "27d97d29bf314adc8bc5d6ab02ab16e1"
format_stamp: "Formatted at 2026-08-07 10:35:59 on dist-test-slave-0b58"
server_key: "fdb93b53107fa909d43992088a6f7ec8"
server_key_iv: "8d3ff6452e68cdf6e8758d450cb45e1c"
server_key_version: "encryptionkey@0"
I20260807 10:35:59.202534 21282 fs_manager.cc:691] Time spent creating directory manager: real 0.008s user 0.005s sys 0.004s
I20260807 10:35:59.208318 21297 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:35:59.210654 21282 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.001s
I20260807 10:35:59.210924 21282 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786098956060137-21165-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786098956060137-21165-0/minicluster-data/ts-0/wal
uuid: "27d97d29bf314adc8bc5d6ab02ab16e1"
format_stamp: "Formatted at 2026-08-07 10:35:59 on dist-test-slave-0b58"
server_key: "fdb93b53107fa909d43992088a6f7ec8"
server_key_iv: "8d3ff6452e68cdf6e8758d450cb45e1c"
server_key_version: "encryptionkey@0"
I20260807 10:35:59.211329 21282 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786098956060137-21165-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786098956060137-21165-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786098956060137-21165-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:35:59.249475 21282 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:35:59.255704 21282 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:35:59.256088 21282 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:35:59.257972 21282 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:35:59.259974 21282 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:35:59.260113 21282 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:35:59.260349 21282 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:35:59.260449 21282 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.001s
I20260807 10:35:59.340628 21282 rpc_server.cc:307] RPC server started. Bound to: 127.20.171.65:38703
I20260807 10:35:59.340716 21412 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.171.65:38703 every 8 connection(s)
I20260807 10:35:59.342262 21282 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786098956060137-21165-0/minicluster-data/ts-0/data/info.pb
I20260807 10:35:59.345314 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 21282
I20260807 10:35:59.345584 21165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786098956060137-21165-0/minicluster-data/ts-0/wal/instance
I20260807 10:35:59.346688 21165 external_mini_cluster.cc:1428] Setting key d79311793a558323fe13b822a04554e2
Aug 07 10:35:59 dist-test-slave-0b58 krb5kdc[21172](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786098959, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.65@KRBTEST.COM for kudu/127.20.171.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.20.171.66@KRBTEST.COM; defaulting to no policy
I20260807 10:35:59.375299 21415 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:35:59.345965 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.65:32911 (local address 127.20.171.126:42183)
0807 10:35:59.346847 (+ 882us) server_negotiation.cc:206] Beginning negotiation
0807 10:35:59.346856 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 10:35:59.348390 (+ 1534us) server_negotiation.cc:407] Connection header received
0807 10:35:59.351060 (+ 2670us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:35:59.351066 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:35:59.351160 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:35:59.351274 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:35:59.353512 (+ 2238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:35:59.354418 (+ 906us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:35:59.356245 (+ 1827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:35:59.356822 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:35:59.356957 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:35:59.364001 (+ 7044us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:35:59.364011 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:35:59.364018 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:35:59.364063 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:35:59.369782 (+ 5719us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:35:59.371191 (+ 1409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:35:59.371199 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:35:59.371204 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:35:59.371432 (+ 228us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:35:59.372345 (+ 913us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:35:59.372350 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:35:59.372353 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:35:59.372909 (+ 556us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:35:59.373138 (+ 229us) server_negotiation.cc:1035] Waiting for connection context
0807 10:35:59.374367 (+ 1229us) server_negotiation.cc:299] Negotiation successful
0807 10:35:59.374647 (+ 280us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":637,"thread_start_us":504,"threads_started":1}
I20260807 10:35:59.376475 21416 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:35:59.346873 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:42183 (local address 127.20.171.65:32911)
0807 10:35:59.348190 (+ 1317us) negotiation.cc:107] Waiting for socket to connect
0807 10:35:59.348241 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0807 10:35:59.350772 (+ 2531us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:35:59.351597 (+ 825us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:35:59.351606 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:35:59.352527 (+ 921us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:35:59.353306 (+ 779us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:35:59.353326 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:35:59.354610 (+ 1284us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:35:59.354613 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:35:59.356086 (+ 1473us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:35:59.356099 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:35:59.357115 (+ 1016us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:35:59.357125 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:35:59.357490 (+ 365us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:35:59.358391 (+ 901us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:35:59.358425 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:35:59.363639 (+ 5214us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:35:59.369955 (+ 6316us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:35:59.369968 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:35:59.369989 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:35:59.371003 (+ 1014us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:35:59.371576 (+ 573us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:35:59.371582 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:35:59.371585 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:35:59.372133 (+ 548us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:35:59.373104 (+ 971us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:35:59.373113 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:35:59.373696 (+ 583us) client_negotiation.cc:769] Sending connection context
0807 10:35:59.374158 (+ 462us) client_negotiation.cc:240] Negotiation successful
0807 10:35:59.374872 (+ 714us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1026,"thread_start_us":725,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.171.66@KRBTEST.COM" created.
I20260807 10:35:59.378577 21413 heartbeater.cc:347] Connected to a master server at 127.20.171.126:42183
I20260807 10:35:59.379132 21413 heartbeater.cc:464] Registering TS with master...
I20260807 10:35:59.380384 21413 heartbeater.cc:511] Master 127.20.171.126:42183 requested a full tablet report, sending...
I20260807 10:35:59.384567 21219 ts_manager.cc:194] Registered new tserver with Master: 27d97d29bf314adc8bc5d6ab02ab16e1 (127.20.171.65:38703)
I20260807 10:35:59.387156 21219 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.171.65@KRBTEST.COM'} at 127.20.171.65:32911
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.171.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.66.keytab.
Entry for principal kudu/127.20.171.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.66.keytab.
I20260807 10:35:59.403710 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786098956060137-21165-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786098956060137-21165-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786098956060137-21165-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786098956060137-21165-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.171.66:0
--local_ip_for_outbound_sockets=127.20.171.66
--webserver_interface=127.20.171.66
--webserver_port=0
--tserver_master_addrs=127.20.171.126:42183
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.66.keytab
--principal=kudu/127.20.171.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.171.84:43879
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786098956060137-21165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786098956060137-21165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786098956060137-21165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:36:00.039108 21420 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:36:00.039476 21420 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:36:00.039772 21420 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:36:00.049340 21420 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:36:00.049536 21420 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:36:00.049753 21420 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.171.66
I20260807 10:36:00.062017 21420 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.171.84:43879
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786098956060137-21165-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786098956060137-21165-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.66.keytab
--principal=kudu/127.20.171.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.171.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786098956060137-21165-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.171.66
--webserver_port=0
--tserver_master_addrs=127.20.171.126:42183
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.171.66
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786098956060137-21165-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:36:00.063479 21420 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:36:00.065202 21420 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:36:00.083683 21425 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:36:00.084471 21426 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:36:00.084885 21428 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:36:00.085891 21420 server_base.cc:1034] running on GCE node
I20260807 10:36:00.086776 21420 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:36:00.088024 21420 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:36:00.089344 21420 hybrid_clock.cc:648] HybridClock initialized: now 1786098960089210 us; error 53 us; skew 500 ppm
I20260807 10:36:00.089834 21420 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:36:00 dist-test-slave-0b58 krb5kdc[21172](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786098960, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:36:00.094115 21420 init.cc:377] Logged in from keytab as kudu/127.20.171.66@KRBTEST.COM (short username kudu)
I20260807 10:36:00.096207 21420 webserver.cc:460] Webserver started at http://127.20.171.66:43827/ using document root <none> and password file <none>
I20260807 10:36:00.097184 21420 fs_manager.cc:359] Metadata directory not provided
I20260807 10:36:00.097393 21420 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:36:00.097777 21420 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:36:00.101419 21420 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786098956060137-21165-0/minicluster-data/ts-1/data/instance:
uuid: "031316cb5ba74895b881c77c2eb9943b"
format_stamp: "Formatted at 2026-08-07 10:36:00 on dist-test-slave-0b58"
server_key: "890499e4e0cdf729632e630f5dd9d878"
server_key_iv: "52ca8f1eebd1fd98b8d9575b21b29547"
server_key_version: "encryptionkey@0"
I20260807 10:36:00.102316 21420 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786098956060137-21165-0/minicluster-data/ts-1/wal/instance:
uuid: "031316cb5ba74895b881c77c2eb9943b"
format_stamp: "Formatted at 2026-08-07 10:36:00 on dist-test-slave-0b58"
server_key: "890499e4e0cdf729632e630f5dd9d878"
server_key_iv: "52ca8f1eebd1fd98b8d9575b21b29547"
server_key_version: "encryptionkey@0"
I20260807 10:36:00.109901 21420 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.001s sys 0.006s
I20260807 10:36:00.115185 21435 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:36:00.116782 21420 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.001s
I20260807 10:36:00.116968 21420 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786098956060137-21165-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786098956060137-21165-0/minicluster-data/ts-1/wal
uuid: "031316cb5ba74895b881c77c2eb9943b"
format_stamp: "Formatted at 2026-08-07 10:36:00 on dist-test-slave-0b58"
server_key: "890499e4e0cdf729632e630f5dd9d878"
server_key_iv: "52ca8f1eebd1fd98b8d9575b21b29547"
server_key_version: "encryptionkey@0"
I20260807 10:36:00.117182 21420 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786098956060137-21165-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786098956060137-21165-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786098956060137-21165-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:36:00.135192 21420 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:36:00.142045 21420 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:36:00.142592 21420 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:36:00.144407 21420 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:36:00.146347 21420 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:36:00.146538 21420 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:36:00.146787 21420 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:36:00.146906 21420 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:36:00.240497 21420 rpc_server.cc:307] RPC server started. Bound to: 127.20.171.66:39085
I20260807 10:36:00.240545 21551 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.171.66:39085 every 8 connection(s)
I20260807 10:36:00.242393 21420 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786098956060137-21165-0/minicluster-data/ts-1/data/info.pb
I20260807 10:36:00.247910 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 21420
I20260807 10:36:00.248157 21165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786098956060137-21165-0/minicluster-data/ts-1/wal/instance
I20260807 10:36:00.248674 21165 external_mini_cluster.cc:1428] Setting key a32eb3cecae7dd034904492577f3f252
Aug 07 10:36:00 dist-test-slave-0b58 krb5kdc[21172](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786098960, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.66@KRBTEST.COM for kudu/127.20.171.126@KRBTEST.COM
I20260807 10:36:00.267143 21555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:00.245410 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.66:51363 (local address 127.20.171.126:42183)
0807 10:36:00.245973 (+ 563us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:00.245978 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:00.247105 (+ 1127us) server_negotiation.cc:407] Connection header received
0807 10:36:00.249755 (+ 2650us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:00.249760 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:00.249821 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:00.249955 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:36:00.252190 (+ 2235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:00.253063 (+ 873us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:00.255846 (+ 2783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:00.256427 (+ 581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:00.256525 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:00.260733 (+ 4208us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:36:00.260738 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:36:00.260741 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:36:00.260773 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:36:00.263815 (+ 3042us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:00.264645 (+ 830us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:00.264651 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:00.264654 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:00.264813 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:00.265297 (+ 484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:00.265302 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:00.265304 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:00.265590 (+ 286us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:36:00.265741 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:00.266500 (+ 759us) server_negotiation.cc:299] Negotiation successful
0807 10:36:00.266725 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":8,"server-negotiator.queue_time_us":454,"thread_start_us":314,"threads_started":1}
I20260807 10:36:00.268168 21556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:00.246051 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:42183 (local address 127.20.171.66:51363)
0807 10:36:00.246946 (+ 895us) negotiation.cc:107] Waiting for socket to connect
0807 10:36:00.246983 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0807 10:36:00.249200 (+ 2217us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:36:00.250244 (+ 1044us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:36:00.250252 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:36:00.251116 (+ 864us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:36:00.252015 (+ 899us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:00.252043 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:00.253281 (+ 1238us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:00.253289 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:00.255614 (+ 2325us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:00.255631 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:00.256674 (+ 1043us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:00.256684 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:00.257048 (+ 364us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:00.257920 (+ 872us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:36:00.257942 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:36:00.260504 (+ 2562us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:36:00.263947 (+ 3443us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:36:00.263956 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:36:00.263971 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:36:00.264526 (+ 555us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:36:00.264929 (+ 403us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:36:00.264934 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:36:00.264938 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:36:00.265167 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:36:00.265724 (+ 557us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:36:00.265732 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:36:00.266084 (+ 352us) client_negotiation.cc:769] Sending connection context
0807 10:36:00.266391 (+ 307us) client_negotiation.cc:240] Negotiation successful
0807 10:36:00.266948 (+ 557us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":652,"thread_start_us":395,"threads_started":1}
WARNING: no policy specified for kudu/127.20.171.67@KRBTEST.COM; defaulting to no policy
I20260807 10:36:00.269814 21553 heartbeater.cc:347] Connected to a master server at 127.20.171.126:42183
I20260807 10:36:00.270167 21553 heartbeater.cc:464] Registering TS with master...
I20260807 10:36:00.271016 21553 heartbeater.cc:511] Master 127.20.171.126:42183 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.171.67@KRBTEST.COM" created.
I20260807 10:36:00.272588 21219 ts_manager.cc:194] Registered new tserver with Master: 031316cb5ba74895b881c77c2eb9943b (127.20.171.66:39085)
I20260807 10:36:00.273644 21219 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.171.66@KRBTEST.COM'} at 127.20.171.66:51363
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.171.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.67.keytab.
Entry for principal kudu/127.20.171.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.67.keytab.
I20260807 10:36:00.294099 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786098956060137-21165-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786098956060137-21165-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786098956060137-21165-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786098956060137-21165-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.171.67:0
--local_ip_for_outbound_sockets=127.20.171.67
--webserver_interface=127.20.171.67
--webserver_port=0
--tserver_master_addrs=127.20.171.126:42183
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.67.keytab
--principal=kudu/127.20.171.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.171.84:43879
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786098956060137-21165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786098956060137-21165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786098956060137-21165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 10:36:00.392186 21413 heartbeater.cc:503] Master 127.20.171.126:42183 was elected leader, sending a full tablet report...
W20260807 10:36:00.836100 21560 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:36:00.836611 21560 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:36:00.836879 21560 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:36:00.847823 21560 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:36:00.848114 21560 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:36:00.848461 21560 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.171.67
I20260807 10:36:00.861032 21560 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.171.84:43879
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786098956060137-21165-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786098956060137-21165-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.67.keytab
--principal=kudu/127.20.171.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.171.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786098956060137-21165-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.171.67
--webserver_port=0
--tserver_master_addrs=127.20.171.126:42183
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.171.67
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786098956060137-21165-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:36:00.862457 21560 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:36:00.864180 21560 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:36:00.885116 21568 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:36:00.885469 21566 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:36:00.885957 21570 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:36:00.886981 21560 server_base.cc:1034] running on GCE node
I20260807 10:36:00.887864 21560 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:36:00.889537 21560 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:36:00.890844 21560 hybrid_clock.cc:648] HybridClock initialized: now 1786098960890744 us; error 48 us; skew 500 ppm
I20260807 10:36:00.891263 21560 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:36:00 dist-test-slave-0b58 krb5kdc[21172](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786098960, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:36:00.896081 21560 init.cc:377] Logged in from keytab as kudu/127.20.171.67@KRBTEST.COM (short username kudu)
I20260807 10:36:00.898392 21560 webserver.cc:460] Webserver started at http://127.20.171.67:40685/ using document root <none> and password file <none>
I20260807 10:36:00.899205 21560 fs_manager.cc:359] Metadata directory not provided
I20260807 10:36:00.899413 21560 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:36:00.899861 21560 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:36:00.903808 21560 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786098956060137-21165-0/minicluster-data/ts-2/data/instance:
uuid: "4b67af3571634956b68160bd86d20b09"
format_stamp: "Formatted at 2026-08-07 10:36:00 on dist-test-slave-0b58"
server_key: "449c4a1307fc9afc2b136299cf1b4214"
server_key_iv: "464671b1443f1bdc96d399540a26de05"
server_key_version: "encryptionkey@0"
I20260807 10:36:00.904831 21560 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786098956060137-21165-0/minicluster-data/ts-2/wal/instance:
uuid: "4b67af3571634956b68160bd86d20b09"
format_stamp: "Formatted at 2026-08-07 10:36:00 on dist-test-slave-0b58"
server_key: "449c4a1307fc9afc2b136299cf1b4214"
server_key_iv: "464671b1443f1bdc96d399540a26de05"
server_key_version: "encryptionkey@0"
I20260807 10:36:00.911859 21560 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.001s sys 0.005s
I20260807 10:36:00.916955 21577 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:36:00.918695 21560 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.003s
I20260807 10:36:00.918941 21560 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786098956060137-21165-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786098956060137-21165-0/minicluster-data/ts-2/wal
uuid: "4b67af3571634956b68160bd86d20b09"
format_stamp: "Formatted at 2026-08-07 10:36:00 on dist-test-slave-0b58"
server_key: "449c4a1307fc9afc2b136299cf1b4214"
server_key_iv: "464671b1443f1bdc96d399540a26de05"
server_key_version: "encryptionkey@0"
I20260807 10:36:00.919215 21560 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786098956060137-21165-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786098956060137-21165-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786098956060137-21165-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:36:00.944882 21560 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:36:00.950721 21560 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:36:00.951251 21560 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:36:00.952901 21560 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:36:00.954931 21560 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:36:00.955143 21560 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:36:00.955370 21560 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:36:00.955497 21560 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:36:01.049808 21560 rpc_server.cc:307] RPC server started. Bound to: 127.20.171.67:35013
I20260807 10:36:01.049975 21696 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.171.67:35013 every 8 connection(s)
I20260807 10:36:01.051437 21560 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786098956060137-21165-0/minicluster-data/ts-2/data/info.pb
I20260807 10:36:01.058106 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 21560
I20260807 10:36:01.058478 21165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786098956060137-21165-0/minicluster-data/ts-2/wal/instance
I20260807 10:36:01.059495 21165 external_mini_cluster.cc:1428] Setting key 6eb660392dd6b0d6013948b3e531683e
Aug 07 10:36:01 dist-test-slave-0b58 krb5kdc[21172](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786098960, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.67@KRBTEST.COM for kudu/127.20.171.126@KRBTEST.COM
I20260807 10:36:01.081636 21699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:01.054934 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.67:54065 (local address 127.20.171.126:42183)
0807 10:36:01.056016 (+ 1082us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:01.056035 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:01.057424 (+ 1389us) server_negotiation.cc:407] Connection header received
0807 10:36:01.061527 (+ 4103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:01.061532 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:01.061631 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:01.061741 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:36:01.064888 (+ 3147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:01.066026 (+ 1138us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:01.067902 (+ 1876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:01.068612 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:01.068724 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:01.073501 (+ 4777us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:36:01.073509 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:36:01.073514 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:36:01.073582 (+ 68us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:36:01.077991 (+ 4409us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:01.078701 (+ 710us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:01.078706 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:01.078710 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:01.078926 (+ 216us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:01.079447 (+ 521us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:01.079452 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:01.079456 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:01.079867 (+ 411us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:36:01.080085 (+ 218us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:01.080827 (+ 742us) server_negotiation.cc:299] Negotiation successful
0807 10:36:01.081069 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":866,"thread_start_us":566,"threads_started":1}
I20260807 10:36:01.082581 21700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:01.055749 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:42183 (local address 127.20.171.67:54065)
0807 10:36:01.057262 (+ 1513us) negotiation.cc:107] Waiting for socket to connect
0807 10:36:01.057302 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0807 10:36:01.061192 (+ 3890us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:36:01.062334 (+ 1142us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:36:01.062347 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:36:01.063423 (+ 1076us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:36:01.064699 (+ 1276us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:01.064720 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:01.066224 (+ 1504us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:01.066228 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:01.067773 (+ 1545us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:01.067785 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:01.068881 (+ 1096us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:01.068887 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:01.069126 (+ 239us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:01.069968 (+ 842us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:36:01.069992 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:36:01.073162 (+ 3170us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:36:01.078127 (+ 4965us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:36:01.078135 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:36:01.078156 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:36:01.078563 (+ 407us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:36:01.079050 (+ 487us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:36:01.079057 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:36:01.079071 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:36:01.079315 (+ 244us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:36:01.080013 (+ 698us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:36:01.080020 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:36:01.080459 (+ 439us) client_negotiation.cc:769] Sending connection context
0807 10:36:01.080723 (+ 264us) client_negotiation.cc:240] Negotiation successful
0807 10:36:01.081310 (+ 587us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1167,"thread_start_us":753,"threads_started":1}
I20260807 10:36:01.084226 21697 heartbeater.cc:347] Connected to a master server at 127.20.171.126:42183
I20260807 10:36:01.084630 21697 heartbeater.cc:464] Registering TS with master...
I20260807 10:36:01.085431 21697 heartbeater.cc:511] Master 127.20.171.126:42183 requested a full tablet report, sending...
I20260807 10:36:01.086939 21219 ts_manager.cc:194] Registered new tserver with Master: 4b67af3571634956b68160bd86d20b09 (127.20.171.67:35013)
I20260807 10:36:01.087968 21219 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.171.67@KRBTEST.COM'} at 127.20.171.67:54065
I20260807 10:36:01.090528 21165 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 07 10:36:01 dist-test-slave-0b58 krb5kdc[21172](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786098961, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 07 10:36:01 dist-test-slave-0b58 krb5kdc[21172](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786098961, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.20.171.65@KRBTEST.COM
I20260807 10:36:01.198828 21706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:01.177860 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44118 (local address 127.20.171.65:38703)
0807 10:36:01.179181 (+ 1321us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:01.179192 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:01.179229 (+ 37us) server_negotiation.cc:407] Connection header received
0807 10:36:01.179303 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:01.179309 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:01.179575 (+ 266us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:01.179780 (+ 205us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:36:01.181887 (+ 2107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:01.183262 (+ 1375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:01.184865 (+ 1603us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:01.185543 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:01.185632 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:01.191328 (+ 5696us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:36:01.191341 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:36:01.191355 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:36:01.191412 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:36:01.195716 (+ 4304us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:01.196562 (+ 846us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:01.196569 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:01.196571 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:01.196733 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:01.197127 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:01.197130 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:01.197132 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:01.197508 (+ 376us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:36:01.197788 (+ 280us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:01.198095 (+ 307us) server_negotiation.cc:299] Negotiation successful
0807 10:36:01.198344 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1009,"thread_start_us":687,"threads_started":1}
W20260807 10:36:01.200455 21326 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44118
Aug 07 10:36:01 dist-test-slave-0b58 krb5kdc[21172](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786098961, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
I20260807 10:36:01.276296 21553 heartbeater.cc:503] Master 127.20.171.126:42183 was elected leader, sending a full tablet report...
Aug 07 10:36:01 dist-test-slave-0b58 krb5kdc[21172](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786098961, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.171.65@KRBTEST.COM
I20260807 10:36:01.296341 21706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:01.276231 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44124 (local address 127.20.171.65:38703)
0807 10:36:01.276879 (+ 648us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:01.276887 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:01.277492 (+ 605us) server_negotiation.cc:407] Connection header received
0807 10:36:01.277764 (+ 272us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:01.277768 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:01.277864 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:01.277976 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:36:01.280657 (+ 2681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:01.281499 (+ 842us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:01.283235 (+ 1736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:01.284123 (+ 888us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:01.284305 (+ 182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:01.290050 (+ 5745us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:36:01.290055 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:36:01.290059 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:36:01.290091 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:36:01.293857 (+ 3766us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:01.294520 (+ 663us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:01.294523 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:01.294525 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:01.294645 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:01.295023 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:01.295026 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:01.295027 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:01.295291 (+ 264us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:36:01.295512 (+ 221us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:01.295754 (+ 242us) server_negotiation.cc:299] Negotiation successful
0807 10:36:01.295973 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":493}
I20260807 10:36:01.298388 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 21282
I20260807 10:36:01.314726 21706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:01.299403 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44130 (local address 127.20.171.65:38703)
0807 10:36:01.299571 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:01.299575 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:01.299998 (+ 423us) server_negotiation.cc:407] Connection header received
0807 10:36:01.300094 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:01.300098 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:01.300151 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:01.300230 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:36:01.301777 (+ 1547us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:01.302697 (+ 920us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:01.304546 (+ 1849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:01.305182 (+ 636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:01.305271 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:01.308316 (+ 3045us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:36:01.308322 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:36:01.308325 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:36:01.308352 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:36:01.312117 (+ 3765us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:01.312832 (+ 715us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:01.312835 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:01.312838 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:01.313091 (+ 253us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:01.313438 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:01.313441 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:01.313443 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:01.313755 (+ 312us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:36:01.313988 (+ 233us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:01.314130 (+ 142us) server_negotiation.cc:299] Negotiation successful
0807 10:36:01.314280 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260807 10:36:01.315651 21408 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:36:01.412915 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 21282
W20260807 10:36:01.434252 21202 connection.cc:535] server connection from 127.20.171.65:32911 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260807 10:36:01.434734 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 21420
Aug 07 10:36:01 dist-test-slave-0b58 krb5kdc[21172](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786098961, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.171.66@KRBTEST.COM
I20260807 10:36:01.457089 21714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:01.435773 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34558 (local address 127.20.171.66:39085)
0807 10:36:01.436447 (+ 674us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:01.436454 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:01.436480 (+ 26us) server_negotiation.cc:407] Connection header received
0807 10:36:01.436542 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:01.436548 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:01.436765 (+ 217us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:01.436894 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:36:01.438713 (+ 1819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:01.439755 (+ 1042us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:01.441675 (+ 1920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:01.442279 (+ 604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:01.442403 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:01.450796 (+ 8393us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:36:01.450809 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:36:01.450825 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:36:01.450863 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:36:01.454298 (+ 3435us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:01.454901 (+ 603us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:01.454908 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:01.454910 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:01.455031 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:01.455398 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:01.455402 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:01.455405 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:01.455832 (+ 427us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:36:01.456087 (+ 255us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:01.456391 (+ 304us) server_negotiation.cc:299] Negotiation successful
0807 10:36:01.456762 (+ 371us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":423,"thread_start_us":245,"threads_started":1}
I20260807 10:36:01.458648 21546 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:36:01.547003 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 21420
I20260807 10:36:01.567770 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 21560
Aug 07 10:36:01 dist-test-slave-0b58 krb5kdc[21172](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786098961, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.171.67@KRBTEST.COM
I20260807 10:36:01.583774 21716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:01.568940 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42386 (local address 127.20.171.67:35013)
0807 10:36:01.569458 (+ 518us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:01.569466 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:01.569495 (+ 29us) server_negotiation.cc:407] Connection header received
0807 10:36:01.569559 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:01.569566 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:01.569985 (+ 419us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:01.570113 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:36:01.571330 (+ 1217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:01.572435 (+ 1105us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:01.573581 (+ 1146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:01.574085 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:01.574184 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:01.578279 (+ 4095us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:36:01.578291 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:36:01.578305 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:36:01.578337 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:36:01.581244 (+ 2907us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:01.581854 (+ 610us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:01.581860 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:01.581862 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:01.581976 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:01.582339 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:01.582342 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:01.582344 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:01.582693 (+ 349us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:36:01.582908 (+ 215us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:01.583284 (+ 376us) server_negotiation.cc:299] Negotiation successful
0807 10:36:01.583512 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":381,"thread_start_us":230,"threads_started":1}
I20260807 10:36:01.585028 21692 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:36:01.667405 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 21560
I20260807 10:36:01.687083 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 21186
I20260807 10:36:01.688342 21249 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:36:01.794873 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 21186
2026-08-07T10:36:01Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (5595 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786098956060137-21165-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 10:36:01 dist-test-slave-0b58 krb5kdc[21721](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 10:36:01 dist-test-slave-0b58 krb5kdc[21721](info): set up 2 sockets
Aug 07 10:36:01 dist-test-slave-0b58 krb5kdc[21721](info): commencing operation
krb5kdc: starting...
W20260807 10:36:02.860543 21165 mini_kdc.cc:121] Time spent starting KDC: real 1.018s user 0.007s sys 0.015s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786098956060137-21165-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786098956060137-21165-0/krb5kdc/test-user.keytab.
Aug 07 10:36:02 dist-test-slave-0b58 krb5kdc[21721](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786098962, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T10:36:03Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T10:36:03Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.171.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.171.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.171.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.126.keytab.
Entry for principal kudu/127.20.171.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.126.keytab.
I20260807 10:36:03.057482 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786098956060137-21165-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786098956060137-21165-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786098956060137-21165-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.171.126:33757
--webserver_interface=127.20.171.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.126.keytab
--principal=kudu/127.20.171.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.171.84:36123
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.171.126:33757
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786098956060137-21165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786098956060137-21165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786098956060137-21165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:36:03.381384 21734 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:36:03.381641 21734 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:36:03.381809 21734 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:36:03.389459 21734 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 10:36:03.389591 21734 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:36:03.389678 21734 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:36:03.389780 21734 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 10:36:03.389866 21734 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 10:36:03.399238 21734 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.171.84:36123
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786098956060137-21165-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786098956060137-21165-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.171.126:33757
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.126.keytab
--principal=kudu/127.20.171.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.171.126:33757
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.171.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786098956060137-21165-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:36:03.400614 21734 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:36:03.401895 21734 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:36:03.413692 21742 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:36:03.413620 21740 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:36:03.413981 21739 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:36:03.414930 21734 server_base.cc:1034] running on GCE node
I20260807 10:36:03.415640 21734 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:36:03.416961 21734 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:36:03.418180 21734 hybrid_clock.cc:648] HybridClock initialized: now 1786098963418124 us; error 43 us; skew 500 ppm
I20260807 10:36:03.418504 21734 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:36:03 dist-test-slave-0b58 krb5kdc[21721](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786098963, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:36:03.421628 21734 init.cc:377] Logged in from keytab as kudu/127.20.171.126@KRBTEST.COM (short username kudu)
I20260807 10:36:03.423135 21734 webserver.cc:460] Webserver started at http://127.20.171.126:39267/ using document root <none> and password file <none>
I20260807 10:36:03.423767 21734 fs_manager.cc:359] Metadata directory not provided
I20260807 10:36:03.423907 21734 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:36:03.424229 21734 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:36:03.427102 21734 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786098956060137-21165-0/minicluster-data/master-0/data/instance:
uuid: "053d4d9bbb30440aaf39a1e2c5d3d59c"
format_stamp: "Formatted at 2026-08-07 10:36:03 on dist-test-slave-0b58"
server_key: "6b0fe34e169f0cf67c3c214294c990f8"
server_key_iv: "5e6558d29d6baca84daa809337d608be"
server_key_version: "encryptionkey@0"
I20260807 10:36:03.427798 21734 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786098956060137-21165-0/minicluster-data/master-0/wal/instance:
uuid: "053d4d9bbb30440aaf39a1e2c5d3d59c"
format_stamp: "Formatted at 2026-08-07 10:36:03 on dist-test-slave-0b58"
server_key: "6b0fe34e169f0cf67c3c214294c990f8"
server_key_iv: "5e6558d29d6baca84daa809337d608be"
server_key_version: "encryptionkey@0"
I20260807 10:36:03.432827 21734 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.002s
I20260807 10:36:03.435884 21749 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:36:03.437129 21734 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 10:36:03.437310 21734 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786098956060137-21165-0/minicluster-data/master-0/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786098956060137-21165-0/minicluster-data/master-0/wal
uuid: "053d4d9bbb30440aaf39a1e2c5d3d59c"
format_stamp: "Formatted at 2026-08-07 10:36:03 on dist-test-slave-0b58"
server_key: "6b0fe34e169f0cf67c3c214294c990f8"
server_key_iv: "5e6558d29d6baca84daa809337d608be"
server_key_version: "encryptionkey@0"
I20260807 10:36:03.437498 21734 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786098956060137-21165-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786098956060137-21165-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786098956060137-21165-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:36:03.475914 21734 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:36:03.479885 21734 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:36:03.480209 21734 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:36:03.498835 21734 rpc_server.cc:307] RPC server started. Bound to: 127.20.171.126:33757
I20260807 10:36:03.498865 21803 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.171.126:33757 every 8 connection(s)
I20260807 10:36:03.500205 21734 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
I20260807 10:36:03.503782 21804 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:36:03.505813 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 21734
I20260807 10:36:03.506038 21165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786098956060137-21165-0/minicluster-data/master-0/wal/instance
I20260807 10:36:03.506933 21165 external_mini_cluster.cc:1428] Setting key 4125c9643cb526dc56160b68bee3bad2
I20260807 10:36:03.515435 21804 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 053d4d9bbb30440aaf39a1e2c5d3d59c: Bootstrap starting.
I20260807 10:36:03.518491 21804 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 053d4d9bbb30440aaf39a1e2c5d3d59c: Neither blocks nor log segments found. Creating new log.
I20260807 10:36:03.519484 21804 log.cc:824] T 00000000000000000000000000000000 P 053d4d9bbb30440aaf39a1e2c5d3d59c: Log is configured to *not* fsync() on all Append() calls
Aug 07 10:36:03 dist-test-slave-0b58 krb5kdc[21721](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786098962, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.171.126@KRBTEST.COM
I20260807 10:36:03.522516 21804 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 053d4d9bbb30440aaf39a1e2c5d3d59c: No bootstrap required, opened a new log
I20260807 10:36:03.528702 21807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:03.509206 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45708 (local address 127.20.171.126:33757)
0807 10:36:03.510014 (+ 808us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:03.510025 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:03.510067 (+ 42us) server_negotiation.cc:407] Connection header received
0807 10:36:03.511746 (+ 1679us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:03.511766 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:03.512102 (+ 336us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:03.512504 (+ 402us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:36:03.513907 (+ 1403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:03.515054 (+ 1147us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:03.516234 (+ 1180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:03.516905 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:03.517127 (+ 222us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:03.521400 (+ 4273us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:36:03.521407 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:36:03.521418 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:36:03.521452 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:36:03.524614 (+ 3162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:03.525350 (+ 736us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:03.525355 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:03.525360 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:03.525515 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:03.525896 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:03.525900 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:03.525902 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:03.526463 (+ 561us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:36:03.526723 (+ 260us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:03.527226 (+ 503us) server_negotiation.cc:299] Negotiation successful
0807 10:36:03.527661 (+ 435us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":554,"thread_start_us":324,"threads_started":1}
I20260807 10:36:03.531216 21804 raft_consensus.cc:348] T 00000000000000000000000000000000 P 053d4d9bbb30440aaf39a1e2c5d3d59c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "053d4d9bbb30440aaf39a1e2c5d3d59c" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 33757 } }
I20260807 10:36:03.531574 21804 raft_consensus.cc:374] T 00000000000000000000000000000000 P 053d4d9bbb30440aaf39a1e2c5d3d59c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:36:03.531703 21804 raft_consensus.cc:729] T 00000000000000000000000000000000 P 053d4d9bbb30440aaf39a1e2c5d3d59c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 053d4d9bbb30440aaf39a1e2c5d3d59c, State: Initialized, Role: FOLLOWER
I20260807 10:36:03.532186 21804 consensus_queue.cc:260] T 00000000000000000000000000000000 P 053d4d9bbb30440aaf39a1e2c5d3d59c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "053d4d9bbb30440aaf39a1e2c5d3d59c" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 33757 } }
I20260807 10:36:03.532524 21804 raft_consensus.cc:388] T 00000000000000000000000000000000 P 053d4d9bbb30440aaf39a1e2c5d3d59c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 10:36:03.532663 21804 raft_consensus.cc:482] T 00000000000000000000000000000000 P 053d4d9bbb30440aaf39a1e2c5d3d59c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 10:36:03.532851 21804 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 053d4d9bbb30440aaf39a1e2c5d3d59c [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:36:03.534878 21804 raft_consensus.cc:504] T 00000000000000000000000000000000 P 053d4d9bbb30440aaf39a1e2c5d3d59c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "053d4d9bbb30440aaf39a1e2c5d3d59c" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 33757 } }
I20260807 10:36:03.535444 21804 leader_election.cc:302] T 00000000000000000000000000000000 P 053d4d9bbb30440aaf39a1e2c5d3d59c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 053d4d9bbb30440aaf39a1e2c5d3d59c; no voters:
I20260807 10:36:03.536099 21804 leader_election.cc:288] T 00000000000000000000000000000000 P 053d4d9bbb30440aaf39a1e2c5d3d59c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 10:36:03.536242 21809 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 053d4d9bbb30440aaf39a1e2c5d3d59c [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:36:03.537061 21809 raft_consensus.cc:686] T 00000000000000000000000000000000 P 053d4d9bbb30440aaf39a1e2c5d3d59c [term 1 LEADER]: Becoming Leader. State: Replica: 053d4d9bbb30440aaf39a1e2c5d3d59c, State: Running, Role: LEADER
I20260807 10:36:03.537564 21809 consensus_queue.cc:237] T 00000000000000000000000000000000 P 053d4d9bbb30440aaf39a1e2c5d3d59c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "053d4d9bbb30440aaf39a1e2c5d3d59c" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 33757 } }
I20260807 10:36:03.538223 21804 sys_catalog.cc:564] T 00000000000000000000000000000000 P 053d4d9bbb30440aaf39a1e2c5d3d59c [sys.catalog]: configured and running, proceeding with master startup.
I20260807 10:36:03.540498 21810 sys_catalog.cc:455] T 00000000000000000000000000000000 P 053d4d9bbb30440aaf39a1e2c5d3d59c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "053d4d9bbb30440aaf39a1e2c5d3d59c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "053d4d9bbb30440aaf39a1e2c5d3d59c" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 33757 } } }
I20260807 10:36:03.540916 21810 sys_catalog.cc:458] T 00000000000000000000000000000000 P 053d4d9bbb30440aaf39a1e2c5d3d59c [sys.catalog]: This master's current role is: LEADER
I20260807 10:36:03.542142 21811 sys_catalog.cc:455] T 00000000000000000000000000000000 P 053d4d9bbb30440aaf39a1e2c5d3d59c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 053d4d9bbb30440aaf39a1e2c5d3d59c. Latest consensus state: current_term: 1 leader_uuid: "053d4d9bbb30440aaf39a1e2c5d3d59c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "053d4d9bbb30440aaf39a1e2c5d3d59c" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 33757 } } }
I20260807 10:36:03.542505 21811 sys_catalog.cc:458] T 00000000000000000000000000000000 P 053d4d9bbb30440aaf39a1e2c5d3d59c [sys.catalog]: This master's current role is: LEADER
I20260807 10:36:03.545660 21816 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 10:36:03.549952 21816 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 10:36:03.558007 21816 catalog_manager.cc:1347] Generated new cluster ID: 717f9751a1da4d6184ef243183d29228
I20260807 10:36:03.558125 21816 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 10:36:03.576673 21816 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 10:36:03.577927 21816 catalog_manager.cc:1504] Loading token signing keys...
I20260807 10:36:03.589164 21816 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 053d4d9bbb30440aaf39a1e2c5d3d59c: Generated new TSK 0
I20260807 10:36:03.590096 21816 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.171.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.171.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.171.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.65.keytab.
Entry for principal kudu/127.20.171.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.65.keytab.
I20260807 10:36:03.636951 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786098956060137-21165-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786098956060137-21165-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786098956060137-21165-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786098956060137-21165-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.171.65:0
--local_ip_for_outbound_sockets=127.20.171.65
--webserver_interface=127.20.171.65
--webserver_port=0
--tserver_master_addrs=127.20.171.126:33757
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.65.keytab
--principal=kudu/127.20.171.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.171.84:36123
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786098956060137-21165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786098956060137-21165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786098956060137-21165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:36:03.963999 21832 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:36:03.964352 21832 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:36:03.964465 21832 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:36:03.971503 21832 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:36:03.971601 21832 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:36:03.971710 21832 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.171.65
I20260807 10:36:03.981446 21832 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.171.84:36123
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786098956060137-21165-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786098956060137-21165-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.65.keytab
--principal=kudu/127.20.171.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.171.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786098956060137-21165-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.171.65
--webserver_port=0
--tserver_master_addrs=127.20.171.126:33757
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.171.65
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786098956060137-21165-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:36:03.982699 21832 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:36:03.983943 21832 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:36:03.996917 21837 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:36:03.996949 21838 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:36:03.997599 21840 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:36:03.998178 21832 server_base.cc:1034] running on GCE node
I20260807 10:36:03.998800 21832 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:36:03.999758 21832 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:36:04.000984 21832 hybrid_clock.cc:648] HybridClock initialized: now 1786098964000944 us; error 51 us; skew 500 ppm
I20260807 10:36:04.001325 21832 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:36:03 dist-test-slave-0b58 krb5kdc[21721](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786098963, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:36:04.004590 21832 init.cc:377] Logged in from keytab as kudu/127.20.171.65@KRBTEST.COM (short username kudu)
I20260807 10:36:04.006151 21832 webserver.cc:460] Webserver started at http://127.20.171.65:46081/ using document root <none> and password file <none>
I20260807 10:36:04.006863 21832 fs_manager.cc:359] Metadata directory not provided
I20260807 10:36:04.007019 21832 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:36:04.007351 21832 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:36:04.010650 21832 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786098956060137-21165-0/minicluster-data/ts-0/data/instance:
uuid: "bb0d8f44adf54fa9afe589cf18e1c411"
format_stamp: "Formatted at 2026-08-07 10:36:04 on dist-test-slave-0b58"
server_key: "0ddb229e04f2e38604c78ca803f41a59"
server_key_iv: "6cc8490aa984439a319d91dc7a72ae92"
server_key_version: "encryptionkey@0"
I20260807 10:36:04.011492 21832 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786098956060137-21165-0/minicluster-data/ts-0/wal/instance:
uuid: "bb0d8f44adf54fa9afe589cf18e1c411"
format_stamp: "Formatted at 2026-08-07 10:36:04 on dist-test-slave-0b58"
server_key: "0ddb229e04f2e38604c78ca803f41a59"
server_key_iv: "6cc8490aa984439a319d91dc7a72ae92"
server_key_version: "encryptionkey@0"
I20260807 10:36:04.016872 21832 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260807 10:36:04.020480 21848 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:36:04.021867 21832 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260807 10:36:04.022051 21832 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786098956060137-21165-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786098956060137-21165-0/minicluster-data/ts-0/wal
uuid: "bb0d8f44adf54fa9afe589cf18e1c411"
format_stamp: "Formatted at 2026-08-07 10:36:04 on dist-test-slave-0b58"
server_key: "0ddb229e04f2e38604c78ca803f41a59"
server_key_iv: "6cc8490aa984439a319d91dc7a72ae92"
server_key_version: "encryptionkey@0"
I20260807 10:36:04.022265 21832 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786098956060137-21165-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786098956060137-21165-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786098956060137-21165-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:36:04.048321 21832 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:36:04.054382 21832 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:36:04.054738 21832 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:36:04.056087 21832 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:36:04.058813 21832 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:36:04.058914 21832 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:36:04.059041 21832 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:36:04.059100 21832 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:36:04.092792 21832 rpc_server.cc:307] RPC server started. Bound to: 127.20.171.65:44965
I20260807 10:36:04.092844 21967 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.171.65:44965 every 8 connection(s)
I20260807 10:36:04.094102 21832 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786098956060137-21165-0/minicluster-data/ts-0/data/info.pb
I20260807 10:36:04.097671 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 21832
I20260807 10:36:04.097946 21165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786098956060137-21165-0/minicluster-data/ts-0/wal/instance
I20260807 10:36:04.098781 21165 external_mini_cluster.cc:1428] Setting key 27f108b42ed8c9ac2eeda68229de3073
Aug 07 10:36:04 dist-test-slave-0b58 krb5kdc[21721](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786098963, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.65@KRBTEST.COM for kudu/127.20.171.126@KRBTEST.COM
I20260807 10:36:04.117321 21970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:04.096681 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.65:45767 (local address 127.20.171.126:33757)
0807 10:36:04.097142 (+ 461us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:04.097148 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:04.098433 (+ 1285us) server_negotiation.cc:407] Connection header received
0807 10:36:04.100675 (+ 2242us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:04.100680 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:04.100782 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:04.100866 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:36:04.102456 (+ 1590us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:04.103635 (+ 1179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:04.105187 (+ 1552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:04.105862 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:04.106003 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:04.110083 (+ 4080us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:36:04.110093 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:36:04.110101 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:36:04.110150 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:36:04.113887 (+ 3737us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:04.114635 (+ 748us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:04.114643 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:04.114648 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:04.114814 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:04.115239 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:04.115244 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:04.115249 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:04.115604 (+ 355us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:36:04.115779 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:04.116512 (+ 733us) server_negotiation.cc:299] Negotiation successful
0807 10:36:04.116817 (+ 305us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":328,"thread_start_us":215,"threads_started":1}
I20260807 10:36:04.118300 21971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:04.097329 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:33757 (local address 127.20.171.65:45767)
0807 10:36:04.098231 (+ 902us) negotiation.cc:107] Waiting for socket to connect
0807 10:36:04.098296 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0807 10:36:04.100437 (+ 2141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:36:04.101166 (+ 729us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:36:04.101174 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:36:04.101693 (+ 519us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:36:04.102262 (+ 569us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:04.102280 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:04.103813 (+ 1533us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:04.103817 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:04.105033 (+ 1216us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:04.105046 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:04.106068 (+ 1022us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:04.106073 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:04.106311 (+ 238us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:04.107014 (+ 703us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:36:04.107036 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:36:04.109784 (+ 2748us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:36:04.114053 (+ 4269us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:36:04.114060 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:36:04.114073 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:36:04.114498 (+ 425us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:36:04.114935 (+ 437us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:36:04.114938 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:36:04.114940 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:36:04.115114 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:36:04.115738 (+ 624us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:36:04.115744 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:36:04.116073 (+ 329us) client_negotiation.cc:769] Sending connection context
0807 10:36:04.116369 (+ 296us) client_negotiation.cc:240] Negotiation successful
0807 10:36:04.116814 (+ 445us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":588,"thread_start_us":371,"threads_started":1}
I20260807 10:36:04.120034 21968 heartbeater.cc:347] Connected to a master server at 127.20.171.126:33757
I20260807 10:36:04.120414 21968 heartbeater.cc:464] Registering TS with master...
I20260807 10:36:04.121368 21968 heartbeater.cc:511] Master 127.20.171.126:33757 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.20.171.66@KRBTEST.COM; defaulting to no policy
I20260807 10:36:04.123643 21766 ts_manager.cc:194] Registered new tserver with Master: bb0d8f44adf54fa9afe589cf18e1c411 (127.20.171.65:44965)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.171.66@KRBTEST.COM" created.
I20260807 10:36:04.125517 21766 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.171.65@KRBTEST.COM'} at 127.20.171.65:45767
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.171.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.66.keytab.
Entry for principal kudu/127.20.171.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.66.keytab.
I20260807 10:36:04.147497 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786098956060137-21165-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786098956060137-21165-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786098956060137-21165-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786098956060137-21165-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.171.66:0
--local_ip_for_outbound_sockets=127.20.171.66
--webserver_interface=127.20.171.66
--webserver_port=0
--tserver_master_addrs=127.20.171.126:33757
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.66.keytab
--principal=kudu/127.20.171.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.171.84:36123
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786098956060137-21165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786098956060137-21165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786098956060137-21165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:36:04.469959 21974 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:36:04.470295 21974 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:36:04.470471 21974 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:36:04.477586 21974 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:36:04.477739 21974 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:36:04.477942 21974 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.171.66
I20260807 10:36:04.487983 21974 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.171.84:36123
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786098956060137-21165-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786098956060137-21165-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.66.keytab
--principal=kudu/127.20.171.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.171.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786098956060137-21165-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.171.66
--webserver_port=0
--tserver_master_addrs=127.20.171.126:33757
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.171.66
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786098956060137-21165-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:36:04.489289 21974 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:36:04.490708 21974 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:36:04.504884 21979 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:36:04.504850 21980 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:36:04.505815 21982 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:36:04.506392 21974 server_base.cc:1034] running on GCE node
I20260807 10:36:04.506999 21974 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:36:04.508008 21974 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:36:04.509231 21974 hybrid_clock.cc:648] HybridClock initialized: now 1786098964509175 us; error 50 us; skew 500 ppm
I20260807 10:36:04.509560 21974 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:36:04 dist-test-slave-0b58 krb5kdc[21721](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786098964, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:36:04.512683 21974 init.cc:377] Logged in from keytab as kudu/127.20.171.66@KRBTEST.COM (short username kudu)
I20260807 10:36:04.514091 21974 webserver.cc:460] Webserver started at http://127.20.171.66:44973/ using document root <none> and password file <none>
I20260807 10:36:04.514779 21974 fs_manager.cc:359] Metadata directory not provided
I20260807 10:36:04.514906 21974 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:36:04.515245 21974 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:36:04.518066 21974 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786098956060137-21165-0/minicluster-data/ts-1/data/instance:
uuid: "7580d9c03cdb41659eb08c761b2ca7f1"
format_stamp: "Formatted at 2026-08-07 10:36:04 on dist-test-slave-0b58"
server_key: "2fd9a40d8f33c79995875571b623ce1c"
server_key_iv: "4bd03f656009597ec1c26bac15596974"
server_key_version: "encryptionkey@0"
I20260807 10:36:04.518949 21974 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786098956060137-21165-0/minicluster-data/ts-1/wal/instance:
uuid: "7580d9c03cdb41659eb08c761b2ca7f1"
format_stamp: "Formatted at 2026-08-07 10:36:04 on dist-test-slave-0b58"
server_key: "2fd9a40d8f33c79995875571b623ce1c"
server_key_iv: "4bd03f656009597ec1c26bac15596974"
server_key_version: "encryptionkey@0"
I20260807 10:36:04.524219 21974 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.005s
I20260807 10:36:04.527874 21989 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:36:04.529250 21974 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 10:36:04.529457 21974 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786098956060137-21165-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786098956060137-21165-0/minicluster-data/ts-1/wal
uuid: "7580d9c03cdb41659eb08c761b2ca7f1"
format_stamp: "Formatted at 2026-08-07 10:36:04 on dist-test-slave-0b58"
server_key: "2fd9a40d8f33c79995875571b623ce1c"
server_key_iv: "4bd03f656009597ec1c26bac15596974"
server_key_version: "encryptionkey@0"
I20260807 10:36:04.529701 21974 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786098956060137-21165-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786098956060137-21165-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786098956060137-21165-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:36:04.555003 21974 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:36:04.559080 21974 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:36:04.559406 21974 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:36:04.560442 21974 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:36:04.561790 21974 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:36:04.561861 21974 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:36:04.562022 21974 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:36:04.562098 21974 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:36:04.593751 21974 rpc_server.cc:307] RPC server started. Bound to: 127.20.171.66:45401
I20260807 10:36:04.593801 22104 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.171.66:45401 every 8 connection(s)
I20260807 10:36:04.595119 21974 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786098956060137-21165-0/minicluster-data/ts-1/data/info.pb
I20260807 10:36:04.605535 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 21974
I20260807 10:36:04.605732 21165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786098956060137-21165-0/minicluster-data/ts-1/wal/instance
I20260807 10:36:04.606290 21165 external_mini_cluster.cc:1428] Setting key 05f38e27a519edb3bfad7f5b9c09e436
Aug 07 10:36:04 dist-test-slave-0b58 krb5kdc[21721](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786098964, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.66@KRBTEST.COM for kudu/127.20.171.126@KRBTEST.COM
I20260807 10:36:04.614804 21970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:04.597757 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.66:54243 (local address 127.20.171.126:33757)
0807 10:36:04.597944 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:04.597948 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:04.599073 (+ 1125us) server_negotiation.cc:407] Connection header received
0807 10:36:04.600981 (+ 1908us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:04.600986 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:04.601053 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:04.601139 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:36:04.602489 (+ 1350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:04.603219 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:04.604688 (+ 1469us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:04.605082 (+ 394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:04.605167 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:04.609065 (+ 3898us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:36:04.609069 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:36:04.609072 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:36:04.609102 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:36:04.611848 (+ 2746us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:04.612647 (+ 799us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:04.612654 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:04.612662 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:04.612794 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:04.613230 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:04.613236 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:04.613243 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:04.613484 (+ 241us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:36:04.613636 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:04.614248 (+ 612us) server_negotiation.cc:299] Negotiation successful
0807 10:36:04.614470 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260807 10:36:04.615669 22107 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:04.598220 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:33757 (local address 127.20.171.66:54243)
0807 10:36:04.598914 (+ 694us) negotiation.cc:107] Waiting for socket to connect
0807 10:36:04.598956 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0807 10:36:04.600744 (+ 1788us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:36:04.601334 (+ 590us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:36:04.601341 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:36:04.601825 (+ 484us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:36:04.602346 (+ 521us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:04.602361 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:04.603347 (+ 986us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:04.603350 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:04.604576 (+ 1226us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:04.604587 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:04.605295 (+ 708us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:04.605304 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:04.605576 (+ 272us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:04.606264 (+ 688us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:36:04.606297 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:36:04.608849 (+ 2552us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:36:04.611991 (+ 3142us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:36:04.611999 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:36:04.612013 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:36:04.612521 (+ 508us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:36:04.612919 (+ 398us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:36:04.612923 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:36:04.612927 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:36:04.613110 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:36:04.613623 (+ 513us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:36:04.613630 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:36:04.613919 (+ 289us) client_negotiation.cc:769] Sending connection context
0807 10:36:04.614152 (+ 233us) client_negotiation.cc:240] Negotiation successful
0807 10:36:04.614640 (+ 488us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":480,"thread_start_us":277,"threads_started":1}
I20260807 10:36:04.616967 22105 heartbeater.cc:347] Connected to a master server at 127.20.171.126:33757
I20260807 10:36:04.617249 22105 heartbeater.cc:464] Registering TS with master...
I20260807 10:36:04.617959 22105 heartbeater.cc:511] Master 127.20.171.126:33757 requested a full tablet report, sending...
I20260807 10:36:04.619484 21766 ts_manager.cc:194] Registered new tserver with Master: 7580d9c03cdb41659eb08c761b2ca7f1 (127.20.171.66:45401)
I20260807 10:36:04.620363 21766 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.171.66@KRBTEST.COM'} at 127.20.171.66:54243
WARNING: no policy specified for kudu/127.20.171.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.171.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.171.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.67.keytab.
Entry for principal kudu/127.20.171.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.67.keytab.
I20260807 10:36:04.649644 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786098956060137-21165-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786098956060137-21165-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786098956060137-21165-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786098956060137-21165-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.171.67:0
--local_ip_for_outbound_sockets=127.20.171.67
--webserver_interface=127.20.171.67
--webserver_port=0
--tserver_master_addrs=127.20.171.126:33757
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.67.keytab
--principal=kudu/127.20.171.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.171.84:36123
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786098956060137-21165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786098956060137-21165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786098956060137-21165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:36:04.978978 22110 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:36:04.979261 22110 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:36:04.979455 22110 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:36:04.986908 22110 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:36:04.987013 22110 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:36:04.987195 22110 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.171.67
I20260807 10:36:04.997016 22110 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.171.84:36123
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786098956060137-21165-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786098956060137-21165-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.67.keytab
--principal=kudu/127.20.171.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.171.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786098956060137-21165-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.171.67
--webserver_port=0
--tserver_master_addrs=127.20.171.126:33757
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.171.67
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786098956060137-21165-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:36:04.998376 22110 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:36:04.999804 22110 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:36:05.013975 22115 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:36:05.014051 22116 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:36:05.014485 22118 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:36:05.014967 22110 server_base.cc:1034] running on GCE node
I20260807 10:36:05.015566 22110 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:36:05.016568 22110 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:36:05.017792 22110 hybrid_clock.cc:648] HybridClock initialized: now 1786098965017708 us; error 74 us; skew 500 ppm
I20260807 10:36:05.018106 22110 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:36:05 dist-test-slave-0b58 krb5kdc[21721](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786098965, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:36:05.021190 22110 init.cc:377] Logged in from keytab as kudu/127.20.171.67@KRBTEST.COM (short username kudu)
I20260807 10:36:05.022689 22110 webserver.cc:460] Webserver started at http://127.20.171.67:39471/ using document root <none> and password file <none>
I20260807 10:36:05.023398 22110 fs_manager.cc:359] Metadata directory not provided
I20260807 10:36:05.023578 22110 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:36:05.023900 22110 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:36:05.027005 22110 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786098956060137-21165-0/minicluster-data/ts-2/data/instance:
uuid: "c79888fb63d644938182747700836c5c"
format_stamp: "Formatted at 2026-08-07 10:36:05 on dist-test-slave-0b58"
server_key: "e72a6d7093063d1fec78477ef8f3e676"
server_key_iv: "4aa650542e2790e3ba0ddfbe6e371131"
server_key_version: "encryptionkey@0"
I20260807 10:36:05.027968 22110 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786098956060137-21165-0/minicluster-data/ts-2/wal/instance:
uuid: "c79888fb63d644938182747700836c5c"
format_stamp: "Formatted at 2026-08-07 10:36:05 on dist-test-slave-0b58"
server_key: "e72a6d7093063d1fec78477ef8f3e676"
server_key_iv: "4aa650542e2790e3ba0ddfbe6e371131"
server_key_version: "encryptionkey@0"
I20260807 10:36:05.033491 22110 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260807 10:36:05.037236 22125 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:36:05.038658 22110 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260807 10:36:05.038885 22110 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786098956060137-21165-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786098956060137-21165-0/minicluster-data/ts-2/wal
uuid: "c79888fb63d644938182747700836c5c"
format_stamp: "Formatted at 2026-08-07 10:36:05 on dist-test-slave-0b58"
server_key: "e72a6d7093063d1fec78477ef8f3e676"
server_key_iv: "4aa650542e2790e3ba0ddfbe6e371131"
server_key_version: "encryptionkey@0"
I20260807 10:36:05.039052 22110 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786098956060137-21165-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786098956060137-21165-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786098956060137-21165-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:36:05.058429 22110 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:36:05.062157 22110 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:36:05.062388 22110 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:36:05.063220 22110 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:36:05.064463 22110 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:36:05.064534 22110 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:36:05.064620 22110 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:36:05.064663 22110 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:36:05.128949 21968 heartbeater.cc:503] Master 127.20.171.126:33757 was elected leader, sending a full tablet report...
I20260807 10:36:05.135828 22110 rpc_server.cc:307] RPC server started. Bound to: 127.20.171.67:46175
I20260807 10:36:05.136051 22243 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.171.67:46175 every 8 connection(s)
I20260807 10:36:05.137465 22110 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786098956060137-21165-0/minicluster-data/ts-2/data/info.pb
I20260807 10:36:05.140164 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 22110
I20260807 10:36:05.140529 21165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786098956060137-21165-0/minicluster-data/ts-2/wal/instance
I20260807 10:36:05.141291 21165 external_mini_cluster.cc:1428] Setting key cd00475ab92c1735c6526d54d2d9cc5c
Aug 07 10:36:05 dist-test-slave-0b58 krb5kdc[21721](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786098965, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.67@KRBTEST.COM for kudu/127.20.171.126@KRBTEST.COM
I20260807 10:36:05.164645 22246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:05.141635 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.67:56235 (local address 127.20.171.126:33757)
0807 10:36:05.143174 (+ 1539us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:05.143181 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:05.144276 (+ 1095us) server_negotiation.cc:407] Connection header received
0807 10:36:05.146692 (+ 2416us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:05.146697 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:05.146784 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:05.146891 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:36:05.148950 (+ 2059us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:05.150213 (+ 1263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:05.152203 (+ 1990us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:05.152775 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:05.152904 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:05.157262 (+ 4358us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:36:05.157267 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:36:05.157270 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:36:05.157300 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:36:05.160831 (+ 3531us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:05.161719 (+ 888us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:05.161723 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:05.161725 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:05.161871 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:05.162445 (+ 574us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:05.162455 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:05.162457 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:05.162811 (+ 354us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:36:05.162973 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:05.163732 (+ 759us) server_negotiation.cc:299] Negotiation successful
0807 10:36:05.164032 (+ 300us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1397,"thread_start_us":1208,"threads_started":1}
I20260807 10:36:05.165593 22247 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:05.142659 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:33757 (local address 127.20.171.67:56235)
0807 10:36:05.144105 (+ 1446us) negotiation.cc:107] Waiting for socket to connect
0807 10:36:05.144156 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0807 10:36:05.146439 (+ 2283us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:36:05.147146 (+ 707us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:36:05.147154 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:36:05.147906 (+ 752us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:36:05.148755 (+ 849us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:05.148798 (+ 43us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:05.150406 (+ 1608us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:05.150410 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:05.152045 (+ 1635us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:05.152058 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:05.153124 (+ 1066us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:05.153133 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:05.153414 (+ 281us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:05.154063 (+ 649us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:36:05.154085 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:36:05.157056 (+ 2971us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:36:05.160959 (+ 3903us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:36:05.160966 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:36:05.160980 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:36:05.161573 (+ 593us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:36:05.161982 (+ 409us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:36:05.161987 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:36:05.161991 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:36:05.162299 (+ 308us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:36:05.162944 (+ 645us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:36:05.162952 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:36:05.163336 (+ 384us) client_negotiation.cc:769] Sending connection context
0807 10:36:05.163625 (+ 289us) client_negotiation.cc:240] Negotiation successful
0807 10:36:05.164258 (+ 633us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1151,"thread_start_us":718,"threads_started":1}
I20260807 10:36:05.167197 22244 heartbeater.cc:347] Connected to a master server at 127.20.171.126:33757
I20260807 10:36:05.167652 22244 heartbeater.cc:464] Registering TS with master...
I20260807 10:36:05.168634 22244 heartbeater.cc:511] Master 127.20.171.126:33757 requested a full tablet report, sending...
I20260807 10:36:05.170401 21766 ts_manager.cc:194] Registered new tserver with Master: c79888fb63d644938182747700836c5c (127.20.171.67:46175)
I20260807 10:36:05.171399 21766 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.171.67@KRBTEST.COM'} at 127.20.171.67:56235
I20260807 10:36:05.182371 21165 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 10:36:05.207821 22246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:05.191309 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45716 (local address 127.20.171.126:33757)
0807 10:36:05.191497 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:05.191501 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:05.192083 (+ 582us) server_negotiation.cc:407] Connection header received
0807 10:36:05.192405 (+ 322us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:05.192409 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:05.192500 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:05.192606 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:36:05.195195 (+ 2589us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:05.196003 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:05.197246 (+ 1243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:05.197861 (+ 615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:05.198001 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:05.201070 (+ 3069us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:36:05.201075 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:36:05.201078 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:36:05.201109 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:36:05.204541 (+ 3432us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:05.205256 (+ 715us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:05.205265 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:05.205267 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:05.205437 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:05.205922 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:05.205928 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:05.205934 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:05.206344 (+ 410us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:36:05.206640 (+ 296us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:05.207101 (+ 461us) server_negotiation.cc:299] Negotiation successful
0807 10:36:05.207404 (+ 303us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260807 10:36:05.216566 21766 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45716:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 10:36:05.227315 21766 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 10:36:05.259635 22257 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:05.245312 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.65:44965 (local address 127.0.0.1:45496)
0807 10:36:05.246398 (+ 1086us) negotiation.cc:107] Waiting for socket to connect
0807 10:36:05.246438 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0807 10:36:05.246660 (+ 222us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:36:05.247773 (+ 1113us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:36:05.247783 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:36:05.247825 (+ 42us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:36:05.248480 (+ 655us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:05.248497 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:05.251248 (+ 2751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:05.251256 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:05.254865 (+ 3609us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:05.254904 (+ 39us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:05.258168 (+ 3264us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:05.258177 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:05.258515 (+ 338us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:05.258590 (+ 75us) client_negotiation.cc:769] Sending connection context
0807 10:36:05.258765 (+ 175us) client_negotiation.cc:240] Negotiation successful
0807 10:36:05.259028 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":757,"thread_start_us":1522,"threads_started":1}
I20260807 10:36:05.260792 22259 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:05.245943 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45496 (local address 127.20.171.65:44965)
0807 10:36:05.246952 (+ 1009us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:05.246965 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:05.247000 (+ 35us) server_negotiation.cc:407] Connection header received
0807 10:36:05.247123 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:05.247134 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:05.247488 (+ 354us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:05.247731 (+ 243us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:36:05.248715 (+ 984us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:05.251070 (+ 2355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:05.255148 (+ 4078us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:05.257491 (+ 2343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:05.257659 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:05.257971 (+ 312us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:05.260221 (+ 2250us) server_negotiation.cc:299] Negotiation successful
0807 10:36:05.260436 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":747,"thread_start_us":737,"threads_started":1}
I20260807 10:36:05.263594 22258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:05.245442 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.66:45401 (local address 127.0.0.1:60474)
0807 10:36:05.252022 (+ 6580us) negotiation.cc:107] Waiting for socket to connect
0807 10:36:05.252036 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 10:36:05.252116 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:36:05.253723 (+ 1607us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:36:05.253727 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:36:05.253749 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:36:05.254194 (+ 445us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:05.254202 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:05.256837 (+ 2635us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:05.256845 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:05.259967 (+ 3122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:05.259988 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:05.262754 (+ 2766us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:05.262760 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:05.262947 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:05.262975 (+ 28us) client_negotiation.cc:769] Sending connection context
0807 10:36:05.263058 (+ 83us) client_negotiation.cc:240] Negotiation successful
0807 10:36:05.263178 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6485,"thread_start_us":6713,"threads_started":1}
I20260807 10:36:05.264104 22260 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:05.246462 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60474 (local address 127.20.171.66:45401)
0807 10:36:05.252782 (+ 6320us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:05.252792 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:05.252821 (+ 29us) server_negotiation.cc:407] Connection header received
0807 10:36:05.252913 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:05.252920 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:05.253184 (+ 264us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:05.253382 (+ 198us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:36:05.254351 (+ 969us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:05.256609 (+ 2258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:05.260173 (+ 3564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:05.262174 (+ 2001us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:05.262317 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:05.262494 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:05.263514 (+ 1020us) server_negotiation.cc:299] Negotiation successful
0807 10:36:05.263702 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6136,"thread_start_us":7126,"threads_started":1}
I20260807 10:36:05.266278 21899 tablet_service.cc:1467] Processing CreateTablet for tablet c908a7f2e02d48c0b28d90fe7a0512fd (DEFAULT_TABLE table=test-table [id=a09da74c362f44dc8a1287beea8bf1a7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:36:05.267974 21899 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c908a7f2e02d48c0b28d90fe7a0512fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:36:05.267623 22039 tablet_service.cc:1467] Processing CreateTablet for tablet c908a7f2e02d48c0b28d90fe7a0512fd (DEFAULT_TABLE table=test-table [id=a09da74c362f44dc8a1287beea8bf1a7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:36:05.268955 22039 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c908a7f2e02d48c0b28d90fe7a0512fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:36:05.270718 22257 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:05.254495 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.67:46175 (local address 127.0.0.1:37508)
0807 10:36:05.261261 (+ 6766us) negotiation.cc:107] Waiting for socket to connect
0807 10:36:05.261278 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 10:36:05.261381 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:36:05.262670 (+ 1289us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:36:05.262675 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:36:05.262727 (+ 52us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:36:05.262963 (+ 236us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:05.262975 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:05.265670 (+ 2695us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:05.265676 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:05.267818 (+ 2142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:05.267832 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:05.269820 (+ 1988us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:05.269828 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:05.270060 (+ 232us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:05.270097 (+ 37us) client_negotiation.cc:769] Sending connection context
0807 10:36:05.270203 (+ 106us) client_negotiation.cc:240] Negotiation successful
0807 10:36:05.270360 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6640,"thread_start_us":7786,"threads_started":1}
I20260807 10:36:05.270918 22261 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:05.253022 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37508 (local address 127.20.171.67:46175)
0807 10:36:05.260756 (+ 7734us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:05.260765 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:05.261502 (+ 737us) server_negotiation.cc:407] Connection header received
0807 10:36:05.261605 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:05.261612 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:05.261870 (+ 258us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:05.263146 (+ 1276us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:36:05.263572 (+ 426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:05.265468 (+ 1896us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:05.267980 (+ 2512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:05.269623 (+ 1643us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:05.269762 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:05.270031 (+ 269us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:05.270273 (+ 242us) server_negotiation.cc:299] Negotiation successful
0807 10:36:05.270456 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7498,"thread_start_us":7293,"threads_started":1}
I20260807 10:36:05.275942 22176 tablet_service.cc:1467] Processing CreateTablet for tablet c908a7f2e02d48c0b28d90fe7a0512fd (DEFAULT_TABLE table=test-table [id=a09da74c362f44dc8a1287beea8bf1a7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:36:05.277585 22176 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c908a7f2e02d48c0b28d90fe7a0512fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:36:05.282477 22263 tablet_bootstrap.cc:492] T c908a7f2e02d48c0b28d90fe7a0512fd P bb0d8f44adf54fa9afe589cf18e1c411: Bootstrap starting.
I20260807 10:36:05.284956 22264 tablet_bootstrap.cc:492] T c908a7f2e02d48c0b28d90fe7a0512fd P 7580d9c03cdb41659eb08c761b2ca7f1: Bootstrap starting.
I20260807 10:36:05.288288 22263 tablet_bootstrap.cc:654] T c908a7f2e02d48c0b28d90fe7a0512fd P bb0d8f44adf54fa9afe589cf18e1c411: Neither blocks nor log segments found. Creating new log.
I20260807 10:36:05.288986 22264 tablet_bootstrap.cc:654] T c908a7f2e02d48c0b28d90fe7a0512fd P 7580d9c03cdb41659eb08c761b2ca7f1: Neither blocks nor log segments found. Creating new log.
I20260807 10:36:05.290537 22263 log.cc:824] T c908a7f2e02d48c0b28d90fe7a0512fd P bb0d8f44adf54fa9afe589cf18e1c411: Log is configured to *not* fsync() on all Append() calls
I20260807 10:36:05.291725 22264 log.cc:824] T c908a7f2e02d48c0b28d90fe7a0512fd P 7580d9c03cdb41659eb08c761b2ca7f1: Log is configured to *not* fsync() on all Append() calls
I20260807 10:36:05.292441 22265 tablet_bootstrap.cc:492] T c908a7f2e02d48c0b28d90fe7a0512fd P c79888fb63d644938182747700836c5c: Bootstrap starting.
I20260807 10:36:05.294867 22263 tablet_bootstrap.cc:492] T c908a7f2e02d48c0b28d90fe7a0512fd P bb0d8f44adf54fa9afe589cf18e1c411: No bootstrap required, opened a new log
I20260807 10:36:05.295140 22263 ts_tablet_manager.cc:1397] T c908a7f2e02d48c0b28d90fe7a0512fd P bb0d8f44adf54fa9afe589cf18e1c411: Time spent bootstrapping tablet: real 0.013s user 0.008s sys 0.004s
I20260807 10:36:05.295441 22265 tablet_bootstrap.cc:654] T c908a7f2e02d48c0b28d90fe7a0512fd P c79888fb63d644938182747700836c5c: Neither blocks nor log segments found. Creating new log.
I20260807 10:36:05.296468 22265 log.cc:824] T c908a7f2e02d48c0b28d90fe7a0512fd P c79888fb63d644938182747700836c5c: Log is configured to *not* fsync() on all Append() calls
I20260807 10:36:05.298094 22264 tablet_bootstrap.cc:492] T c908a7f2e02d48c0b28d90fe7a0512fd P 7580d9c03cdb41659eb08c761b2ca7f1: No bootstrap required, opened a new log
I20260807 10:36:05.298498 22264 ts_tablet_manager.cc:1397] T c908a7f2e02d48c0b28d90fe7a0512fd P 7580d9c03cdb41659eb08c761b2ca7f1: Time spent bootstrapping tablet: real 0.014s user 0.007s sys 0.002s
I20260807 10:36:05.299786 22265 tablet_bootstrap.cc:492] T c908a7f2e02d48c0b28d90fe7a0512fd P c79888fb63d644938182747700836c5c: No bootstrap required, opened a new log
I20260807 10:36:05.300027 22265 ts_tablet_manager.cc:1397] T c908a7f2e02d48c0b28d90fe7a0512fd P c79888fb63d644938182747700836c5c: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20260807 10:36:05.309453 22265 raft_consensus.cc:348] T c908a7f2e02d48c0b28d90fe7a0512fd P c79888fb63d644938182747700836c5c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb0d8f44adf54fa9afe589cf18e1c411" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 44965 } } peers { permanent_uuid: "7580d9c03cdb41659eb08c761b2ca7f1" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 45401 } } peers { permanent_uuid: "c79888fb63d644938182747700836c5c" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 46175 } }
I20260807 10:36:05.309820 22265 raft_consensus.cc:374] T c908a7f2e02d48c0b28d90fe7a0512fd P c79888fb63d644938182747700836c5c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:36:05.309909 22265 raft_consensus.cc:729] T c908a7f2e02d48c0b28d90fe7a0512fd P c79888fb63d644938182747700836c5c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c79888fb63d644938182747700836c5c, State: Initialized, Role: FOLLOWER
I20260807 10:36:05.310524 22265 consensus_queue.cc:260] T c908a7f2e02d48c0b28d90fe7a0512fd P c79888fb63d644938182747700836c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb0d8f44adf54fa9afe589cf18e1c411" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 44965 } } peers { permanent_uuid: "7580d9c03cdb41659eb08c761b2ca7f1" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 45401 } } peers { permanent_uuid: "c79888fb63d644938182747700836c5c" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 46175 } }
I20260807 10:36:05.311895 22244 heartbeater.cc:503] Master 127.20.171.126:33757 was elected leader, sending a full tablet report...
I20260807 10:36:05.311844 22263 raft_consensus.cc:348] T c908a7f2e02d48c0b28d90fe7a0512fd P bb0d8f44adf54fa9afe589cf18e1c411 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb0d8f44adf54fa9afe589cf18e1c411" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 44965 } } peers { permanent_uuid: "7580d9c03cdb41659eb08c761b2ca7f1" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 45401 } } peers { permanent_uuid: "c79888fb63d644938182747700836c5c" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 46175 } }
I20260807 10:36:05.312589 22263 raft_consensus.cc:374] T c908a7f2e02d48c0b28d90fe7a0512fd P bb0d8f44adf54fa9afe589cf18e1c411 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:36:05.312815 22263 raft_consensus.cc:729] T c908a7f2e02d48c0b28d90fe7a0512fd P bb0d8f44adf54fa9afe589cf18e1c411 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb0d8f44adf54fa9afe589cf18e1c411, State: Initialized, Role: FOLLOWER
I20260807 10:36:05.313390 22265 ts_tablet_manager.cc:1428] T c908a7f2e02d48c0b28d90fe7a0512fd P c79888fb63d644938182747700836c5c: Time spent starting tablet: real 0.013s user 0.004s sys 0.009s
I20260807 10:36:05.313896 22263 consensus_queue.cc:260] T c908a7f2e02d48c0b28d90fe7a0512fd P bb0d8f44adf54fa9afe589cf18e1c411 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb0d8f44adf54fa9afe589cf18e1c411" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 44965 } } peers { permanent_uuid: "7580d9c03cdb41659eb08c761b2ca7f1" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 45401 } } peers { permanent_uuid: "c79888fb63d644938182747700836c5c" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 46175 } }
I20260807 10:36:05.315999 22264 raft_consensus.cc:348] T c908a7f2e02d48c0b28d90fe7a0512fd P 7580d9c03cdb41659eb08c761b2ca7f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb0d8f44adf54fa9afe589cf18e1c411" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 44965 } } peers { permanent_uuid: "7580d9c03cdb41659eb08c761b2ca7f1" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 45401 } } peers { permanent_uuid: "c79888fb63d644938182747700836c5c" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 46175 } }
I20260807 10:36:05.316787 22264 raft_consensus.cc:374] T c908a7f2e02d48c0b28d90fe7a0512fd P 7580d9c03cdb41659eb08c761b2ca7f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:36:05.317034 22263 ts_tablet_manager.cc:1428] T c908a7f2e02d48c0b28d90fe7a0512fd P bb0d8f44adf54fa9afe589cf18e1c411: Time spent starting tablet: real 0.022s user 0.008s sys 0.013s
I20260807 10:36:05.317011 22264 raft_consensus.cc:729] T c908a7f2e02d48c0b28d90fe7a0512fd P 7580d9c03cdb41659eb08c761b2ca7f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7580d9c03cdb41659eb08c761b2ca7f1, State: Initialized, Role: FOLLOWER
I20260807 10:36:05.318019 22264 consensus_queue.cc:260] T c908a7f2e02d48c0b28d90fe7a0512fd P 7580d9c03cdb41659eb08c761b2ca7f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb0d8f44adf54fa9afe589cf18e1c411" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 44965 } } peers { permanent_uuid: "7580d9c03cdb41659eb08c761b2ca7f1" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 45401 } } peers { permanent_uuid: "c79888fb63d644938182747700836c5c" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 46175 } }
I20260807 10:36:05.320818 22105 heartbeater.cc:503] Master 127.20.171.126:33757 was elected leader, sending a full tablet report...
I20260807 10:36:05.321676 22264 ts_tablet_manager.cc:1428] T c908a7f2e02d48c0b28d90fe7a0512fd P 7580d9c03cdb41659eb08c761b2ca7f1: Time spent starting tablet: real 0.023s user 0.019s sys 0.004s
W20260807 10:36:05.346549 21969 tablet.cc:2369] T c908a7f2e02d48c0b28d90fe7a0512fd P bb0d8f44adf54fa9afe589cf18e1c411: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 10:36:05.347369 22106 tablet.cc:2369] T c908a7f2e02d48c0b28d90fe7a0512fd P 7580d9c03cdb41659eb08c761b2ca7f1: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 10:36:05.390770 22245 tablet.cc:2369] T c908a7f2e02d48c0b28d90fe7a0512fd P c79888fb63d644938182747700836c5c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 10:36:05.411204 22269 raft_consensus.cc:482] T c908a7f2e02d48c0b28d90fe7a0512fd P c79888fb63d644938182747700836c5c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 10:36:05.411577 22269 raft_consensus.cc:504] T c908a7f2e02d48c0b28d90fe7a0512fd P c79888fb63d644938182747700836c5c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb0d8f44adf54fa9afe589cf18e1c411" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 44965 } } peers { permanent_uuid: "7580d9c03cdb41659eb08c761b2ca7f1" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 45401 } } peers { permanent_uuid: "c79888fb63d644938182747700836c5c" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 46175 } }
I20260807 10:36:05.414175 22269 leader_election.cc:288] T c908a7f2e02d48c0b28d90fe7a0512fd P c79888fb63d644938182747700836c5c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb0d8f44adf54fa9afe589cf18e1c411 (127.20.171.65:44965), 7580d9c03cdb41659eb08c761b2ca7f1 (127.20.171.66:45401)
I20260807 10:36:05.423265 22247 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:05.414441 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.66:45401 (local address 127.20.171.67:36683)
0807 10:36:05.414768 (+ 327us) negotiation.cc:107] Waiting for socket to connect
0807 10:36:05.414789 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0807 10:36:05.414924 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:36:05.415464 (+ 540us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:36:05.415471 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:36:05.415504 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:36:05.415814 (+ 310us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:05.415832 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:05.417497 (+ 1665us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:05.417503 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:05.420469 (+ 2966us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:05.420501 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:05.422194 (+ 1693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:05.422202 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:05.422567 (+ 365us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:05.422600 (+ 33us) client_negotiation.cc:769] Sending connection context
0807 10:36:05.422727 (+ 127us) client_negotiation.cc:240] Negotiation successful
0807 10:36:05.422861 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":158,"mutex_wait_us":1}
I20260807 10:36:05.423368 22260 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:05.414653 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.67:36683 (local address 127.20.171.66:45401)
0807 10:36:05.414895 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:05.414901 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:05.414921 (+ 20us) server_negotiation.cc:407] Connection header received
0807 10:36:05.415102 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:05.415109 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:05.415187 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:05.415281 (+ 94us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:36:05.416022 (+ 741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:05.417251 (+ 1229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:05.420714 (+ 3463us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:05.422032 (+ 1318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:05.422221 (+ 189us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:05.422299 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:05.422861 (+ 562us) server_negotiation.cc:299] Negotiation successful
0807 10:36:05.422989 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
I20260807 10:36:05.425387 22259 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:05.415236 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.67:51353 (local address 127.20.171.65:44965)
0807 10:36:05.415453 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:05.415459 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:05.416346 (+ 887us) server_negotiation.cc:407] Connection header received
0807 10:36:05.416555 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:05.416561 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:05.416675 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:05.416805 (+ 130us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:36:05.417956 (+ 1151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:05.418717 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:05.421575 (+ 2858us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:05.423715 (+ 2140us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:05.423949 (+ 234us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:05.424034 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:05.424784 (+ 750us) server_negotiation.cc:299] Negotiation successful
0807 10:36:05.424958 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260807 10:36:05.425525 22272 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:05.414771 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.65:44965 (local address 127.20.171.67:51353)
0807 10:36:05.416196 (+ 1425us) negotiation.cc:107] Waiting for socket to connect
0807 10:36:05.416227 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0807 10:36:05.416381 (+ 154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:36:05.416820 (+ 439us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:36:05.416824 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:36:05.416849 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:36:05.417664 (+ 815us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:05.417677 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:05.418903 (+ 1226us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:05.418907 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:05.421322 (+ 2415us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:05.421337 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:05.424312 (+ 2975us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:05.424319 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:05.424552 (+ 233us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:05.424598 (+ 46us) client_negotiation.cc:769] Sending connection context
0807 10:36:05.424727 (+ 129us) client_negotiation.cc:240] Negotiation successful
0807 10:36:05.424866 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1266,"mutex_wait_us":53,"thread_start_us":995,"threads_started":1}
I20260807 10:36:05.425354 22059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c908a7f2e02d48c0b28d90fe7a0512fd" candidate_uuid: "c79888fb63d644938182747700836c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7580d9c03cdb41659eb08c761b2ca7f1" is_pre_election: true
I20260807 10:36:05.426419 22059 raft_consensus.cc:2454] T c908a7f2e02d48c0b28d90fe7a0512fd P 7580d9c03cdb41659eb08c761b2ca7f1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c79888fb63d644938182747700836c5c in term 0.
I20260807 10:36:05.426822 21920 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c908a7f2e02d48c0b28d90fe7a0512fd" candidate_uuid: "c79888fb63d644938182747700836c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb0d8f44adf54fa9afe589cf18e1c411" is_pre_election: true
I20260807 10:36:05.427496 22127 leader_election.cc:302] T c908a7f2e02d48c0b28d90fe7a0512fd P c79888fb63d644938182747700836c5c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7580d9c03cdb41659eb08c761b2ca7f1, c79888fb63d644938182747700836c5c; no voters:
I20260807 10:36:05.427584 21920 raft_consensus.cc:2454] T c908a7f2e02d48c0b28d90fe7a0512fd P bb0d8f44adf54fa9afe589cf18e1c411 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c79888fb63d644938182747700836c5c in term 0.
I20260807 10:36:05.427929 22269 raft_consensus.cc:2781] T c908a7f2e02d48c0b28d90fe7a0512fd P c79888fb63d644938182747700836c5c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 10:36:05.428117 22269 raft_consensus.cc:482] T c908a7f2e02d48c0b28d90fe7a0512fd P c79888fb63d644938182747700836c5c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 10:36:05.428301 22269 raft_consensus.cc:3037] T c908a7f2e02d48c0b28d90fe7a0512fd P c79888fb63d644938182747700836c5c [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:36:05.431577 22269 raft_consensus.cc:504] T c908a7f2e02d48c0b28d90fe7a0512fd P c79888fb63d644938182747700836c5c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb0d8f44adf54fa9afe589cf18e1c411" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 44965 } } peers { permanent_uuid: "7580d9c03cdb41659eb08c761b2ca7f1" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 45401 } } peers { permanent_uuid: "c79888fb63d644938182747700836c5c" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 46175 } }
I20260807 10:36:05.432576 22269 leader_election.cc:288] T c908a7f2e02d48c0b28d90fe7a0512fd P c79888fb63d644938182747700836c5c [CANDIDATE]: Term 1 election: Requested vote from peers bb0d8f44adf54fa9afe589cf18e1c411 (127.20.171.65:44965), 7580d9c03cdb41659eb08c761b2ca7f1 (127.20.171.66:45401)
I20260807 10:36:05.433033 21920 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c908a7f2e02d48c0b28d90fe7a0512fd" candidate_uuid: "c79888fb63d644938182747700836c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb0d8f44adf54fa9afe589cf18e1c411"
I20260807 10:36:05.433139 22059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c908a7f2e02d48c0b28d90fe7a0512fd" candidate_uuid: "c79888fb63d644938182747700836c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7580d9c03cdb41659eb08c761b2ca7f1"
I20260807 10:36:05.433353 22059 raft_consensus.cc:3037] T c908a7f2e02d48c0b28d90fe7a0512fd P 7580d9c03cdb41659eb08c761b2ca7f1 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:36:05.433435 21920 raft_consensus.cc:3037] T c908a7f2e02d48c0b28d90fe7a0512fd P bb0d8f44adf54fa9afe589cf18e1c411 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:36:05.436966 22059 raft_consensus.cc:2454] T c908a7f2e02d48c0b28d90fe7a0512fd P 7580d9c03cdb41659eb08c761b2ca7f1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c79888fb63d644938182747700836c5c in term 1.
I20260807 10:36:05.437472 22127 leader_election.cc:302] T c908a7f2e02d48c0b28d90fe7a0512fd P c79888fb63d644938182747700836c5c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7580d9c03cdb41659eb08c761b2ca7f1, c79888fb63d644938182747700836c5c; no voters:
I20260807 10:36:05.437907 22269 raft_consensus.cc:2781] T c908a7f2e02d48c0b28d90fe7a0512fd P c79888fb63d644938182747700836c5c [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:36:05.438905 21920 raft_consensus.cc:2454] T c908a7f2e02d48c0b28d90fe7a0512fd P bb0d8f44adf54fa9afe589cf18e1c411 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c79888fb63d644938182747700836c5c in term 1.
I20260807 10:36:05.438941 22269 raft_consensus.cc:686] T c908a7f2e02d48c0b28d90fe7a0512fd P c79888fb63d644938182747700836c5c [term 1 LEADER]: Becoming Leader. State: Replica: c79888fb63d644938182747700836c5c, State: Running, Role: LEADER
I20260807 10:36:05.439718 22269 consensus_queue.cc:237] T c908a7f2e02d48c0b28d90fe7a0512fd P c79888fb63d644938182747700836c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb0d8f44adf54fa9afe589cf18e1c411" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 44965 } } peers { permanent_uuid: "7580d9c03cdb41659eb08c761b2ca7f1" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 45401 } } peers { permanent_uuid: "c79888fb63d644938182747700836c5c" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 46175 } }
I20260807 10:36:05.446794 21766 catalog_manager.cc:5495] T c908a7f2e02d48c0b28d90fe7a0512fd P c79888fb63d644938182747700836c5c reported cstate change: term changed from 0 to 1, leader changed from <none> to c79888fb63d644938182747700836c5c (127.20.171.67). New cstate: current_term: 1 leader_uuid: "c79888fb63d644938182747700836c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb0d8f44adf54fa9afe589cf18e1c411" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 44965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7580d9c03cdb41659eb08c761b2ca7f1" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 45401 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c79888fb63d644938182747700836c5c" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 46175 } health_report { overall_health: HEALTHY } } }
Aug 07 10:36:05 dist-test-slave-0b58 krb5kdc[21721](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786098962, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.171.65@KRBTEST.COM
I20260807 10:36:05.485046 22259 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:05.464150 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45498 (local address 127.20.171.65:44965)
0807 10:36:05.464393 (+ 243us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:05.464397 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:05.465459 (+ 1062us) server_negotiation.cc:407] Connection header received
0807 10:36:05.465672 (+ 213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:05.465676 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:05.465742 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:05.465839 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:36:05.468870 (+ 3031us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:05.469918 (+ 1048us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:05.471511 (+ 1593us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:05.472077 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:05.472288 (+ 211us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:05.477834 (+ 5546us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:36:05.477851 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:36:05.477867 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:36:05.477914 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:36:05.481782 (+ 3868us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:05.482628 (+ 846us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:05.482635 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:05.482637 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:05.482850 (+ 213us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:05.483231 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:05.483234 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:05.483235 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:05.483676 (+ 441us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:36:05.483977 (+ 301us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:05.484329 (+ 352us) server_negotiation.cc:299] Negotiation successful
0807 10:36:05.484493 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
Aug 07 10:36:05 dist-test-slave-0b58 krb5kdc[21721](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786098965, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 07 10:36:05 dist-test-slave-0b58 krb5kdc[21721](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786098965, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.20.171.65@KRBTEST.COM
I20260807 10:36:05.549721 22259 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:05.531368 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45508 (local address 127.20.171.65:44965)
0807 10:36:05.531635 (+ 267us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:05.531642 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:05.531954 (+ 312us) server_negotiation.cc:407] Connection header received
0807 10:36:05.532103 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:05.532107 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:05.532176 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:05.532338 (+ 162us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:36:05.534586 (+ 2248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:05.535396 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:05.537191 (+ 1795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:05.537588 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:05.537682 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:05.543480 (+ 5798us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:36:05.543489 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:36:05.543496 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:36:05.543541 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:36:05.546776 (+ 3235us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:05.547423 (+ 647us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:05.547428 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:05.547430 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:05.547629 (+ 199us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:05.548091 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:05.548095 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:05.548097 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:05.548574 (+ 477us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:36:05.548892 (+ 318us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:05.548989 (+ 97us) server_negotiation.cc:299] Negotiation successful
0807 10:36:05.549177 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
Aug 07 10:36:05 dist-test-slave-0b58 krb5kdc[21721](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786098965, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 07 10:36:05 dist-test-slave-0b58 krb5kdc[21721](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786098965, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.171.65@KRBTEST.COM
I20260807 10:36:05.608393 22259 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:05.588546 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45520 (local address 127.20.171.65:44965)
0807 10:36:05.588797 (+ 251us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:05.588804 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:05.589257 (+ 453us) server_negotiation.cc:407] Connection header received
0807 10:36:05.589491 (+ 234us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:05.589496 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:05.589566 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:05.589672 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:36:05.591919 (+ 2247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:05.592666 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:05.594412 (+ 1746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:05.594864 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:05.595013 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:05.600540 (+ 5527us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:36:05.600547 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:36:05.600552 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:36:05.600605 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:36:05.605265 (+ 4660us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:05.605891 (+ 626us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:05.605897 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:05.605900 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:05.606116 (+ 216us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:05.606444 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:05.606449 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:05.606452 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:05.606997 (+ 545us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:36:05.607296 (+ 299us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:05.607454 (+ 158us) server_negotiation.cc:299] Negotiation successful
0807 10:36:05.607749 (+ 295us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
W20260807 10:36:05.610900 21879 tablet_service.cc:2908] Rejecting scan request for tablet c908a7f2e02d48c0b28d90fe7a0512fd: Uninitialized: clean time has not yet been initialized
I20260807 10:36:05.614959 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 21832
I20260807 10:36:05.630342 22259 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:05.615872 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45522 (local address 127.20.171.65:44965)
0807 10:36:05.616019 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:05.616023 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:05.616507 (+ 484us) server_negotiation.cc:407] Connection header received
0807 10:36:05.616660 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:05.616663 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:05.616734 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:05.616808 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:36:05.617903 (+ 1095us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:05.618542 (+ 639us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:05.619859 (+ 1317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:05.620496 (+ 637us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:05.620607 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:05.623752 (+ 3145us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:36:05.623756 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:36:05.623759 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:36:05.623788 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:36:05.627495 (+ 3707us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:05.628389 (+ 894us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:05.628393 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:05.628395 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:05.628587 (+ 192us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:05.628979 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:05.628982 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:05.628984 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:05.629373 (+ 389us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:36:05.629747 (+ 374us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:05.629872 (+ 125us) server_negotiation.cc:299] Negotiation successful
0807 10:36:05.630048 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260807 10:36:05.631117 21963 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:36:05.721091 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 21832
I20260807 10:36:05.743590 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 21974
Aug 07 10:36:05 dist-test-slave-0b58 krb5kdc[21721](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786098965, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.171.66@KRBTEST.COM
I20260807 10:36:05.758924 22260 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:05.744462 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60486 (local address 127.20.171.66:45401)
0807 10:36:05.744638 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:05.744646 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:05.744668 (+ 22us) server_negotiation.cc:407] Connection header received
0807 10:36:05.744746 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:05.744750 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:05.744808 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:05.744917 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:36:05.746590 (+ 1673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:05.747361 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:05.749029 (+ 1668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:05.749520 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:05.749714 (+ 194us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:05.753878 (+ 4164us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:36:05.753894 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:36:05.753909 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:36:05.753942 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:36:05.756518 (+ 2576us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:05.757297 (+ 779us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:05.757304 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:05.757306 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:05.757424 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:05.757753 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:05.757756 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:05.757758 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:05.758093 (+ 335us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:36:05.758326 (+ 233us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:05.758519 (+ 193us) server_negotiation.cc:299] Negotiation successful
0807 10:36:05.758685 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260807 10:36:05.759689 22100 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:36:05.848747 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 21974
I20260807 10:36:05.870007 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 22110
W20260807 10:36:05.870040 22127 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.20.171.66:45401 (error 108)
I20260807 10:36:05.872032 22272 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:05.871584 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.66:45401 (local address 127.20.171.67:45957)
0807 10:36:05.871733 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0807 10:36:05.871877 (+ 144us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.66:45401: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260807 10:36:05.872433 22127 consensus_peers.cc:487] T c908a7f2e02d48c0b28d90fe7a0512fd P c79888fb63d644938182747700836c5c -> Peer 7580d9c03cdb41659eb08c761b2ca7f1 (127.20.171.66:45401): Couldn't send request to peer 7580d9c03cdb41659eb08c761b2ca7f1. Status: Network error: Client connection negotiation failed: client connection to 127.20.171.66:45401: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
Aug 07 10:36:05 dist-test-slave-0b58 krb5kdc[21721](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786098965, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.171.67@KRBTEST.COM
I20260807 10:36:05.885751 22290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:05.870997 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37510 (local address 127.20.171.67:46175)
0807 10:36:05.871690 (+ 693us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:05.871696 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:05.871722 (+ 26us) server_negotiation.cc:407] Connection header received
0807 10:36:05.871786 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:05.871790 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:05.871851 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:05.871969 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:36:05.873555 (+ 1586us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:05.874257 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:05.875556 (+ 1299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:05.875988 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:05.876119 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:05.880216 (+ 4097us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:36:05.880234 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:36:05.880249 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:36:05.880332 (+ 83us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:36:05.882962 (+ 2630us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:05.883588 (+ 626us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:05.883597 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:05.883601 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:05.883768 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:05.884138 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:05.884144 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:05.884147 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:05.884533 (+ 386us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:36:05.884823 (+ 290us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:05.885124 (+ 301us) server_negotiation.cc:299] Negotiation successful
0807 10:36:05.885366 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":546,"thread_start_us":425,"threads_started":1}
I20260807 10:36:05.886445 22239 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:36:05.977022 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 22110
I20260807 10:36:05.998184 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 21734
I20260807 10:36:05.999339 21799 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:36:06.110572 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 21734
2026-08-07T10:36:06Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (4317 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786098956060137-21165-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 10:36:06 dist-test-slave-0b58 krb5kdc[22295](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 10:36:06 dist-test-slave-0b58 krb5kdc[22295](info): set up 2 sockets
Aug 07 10:36:06 dist-test-slave-0b58 krb5kdc[22295](info): commencing operation
krb5kdc: starting...
W20260807 10:36:07.212612 21165 mini_kdc.cc:121] Time spent starting KDC: real 1.053s user 0.002s sys 0.022s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786098956060137-21165-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786098956060137-21165-0/krb5kdc/test-user.keytab.
Aug 07 10:36:07 dist-test-slave-0b58 krb5kdc[22295](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786098967, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T10:36:07Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T10:36:07Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.171.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.171.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.171.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.126.keytab.
Entry for principal kudu/127.20.171.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.126.keytab.
I20260807 10:36:07.411510 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786098956060137-21165-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786098956060137-21165-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786098956060137-21165-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.171.126:41367
--webserver_interface=127.20.171.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.126.keytab
--principal=kudu/127.20.171.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.171.84:42245
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.171.126:41367
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786098956060137-21165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786098956060137-21165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786098956060137-21165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:36:07.739369 22308 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:36:07.739727 22308 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:36:07.740101 22308 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:36:07.747519 22308 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 10:36:07.747675 22308 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260807 10:36:07.747768 22308 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:36:07.747879 22308 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:36:07.747963 22308 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 10:36:07.748055 22308 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 10:36:07.758303 22308 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.171.84:42245
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786098956060137-21165-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786098956060137-21165-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.171.126:41367
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.126.keytab
--principal=kudu/127.20.171.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.171.126:41367
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.171.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786098956060137-21165-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:36:07.759658 22308 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:36:07.761077 22308 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:36:07.773284 22316 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:36:07.773231 22313 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:36:07.773231 22314 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:36:07.774003 22308 server_base.cc:1034] running on GCE node
I20260807 10:36:07.774796 22308 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:36:07.776151 22308 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:36:07.777387 22308 hybrid_clock.cc:648] HybridClock initialized: now 1786098967777307 us; error 54 us; skew 500 ppm
I20260807 10:36:07.777716 22308 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:36:07 dist-test-slave-0b58 krb5kdc[22295](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786098967, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:36:07.785487 22308 init.cc:377] Logged in from keytab as kudu/127.20.171.126@KRBTEST.COM (short username kudu)
I20260807 10:36:07.786999 22308 webserver.cc:460] Webserver started at http://127.20.171.126:33767/ using document root <none> and password file <none>
I20260807 10:36:07.787757 22308 fs_manager.cc:359] Metadata directory not provided
I20260807 10:36:07.787885 22308 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:36:07.788218 22308 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:36:07.791219 22308 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786098956060137-21165-0/minicluster-data/master-0/data/instance:
uuid: "354a384c0db64d32b785d2cdb18f968b"
format_stamp: "Formatted at 2026-08-07 10:36:07 on dist-test-slave-0b58"
server_key: "607ede43ddfdf4634a1af8ea2c3dc7dd"
server_key_iv: "f845f6f9bd64090431e5fca17d1c699e"
server_key_version: "encryptionkey@0"
I20260807 10:36:07.791990 22308 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786098956060137-21165-0/minicluster-data/master-0/wal/instance:
uuid: "354a384c0db64d32b785d2cdb18f968b"
format_stamp: "Formatted at 2026-08-07 10:36:07 on dist-test-slave-0b58"
server_key: "607ede43ddfdf4634a1af8ea2c3dc7dd"
server_key_iv: "f845f6f9bd64090431e5fca17d1c699e"
server_key_version: "encryptionkey@0"
I20260807 10:36:07.796931 22308 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.002s
I20260807 10:36:07.800221 22323 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:36:07.801548 22308 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260807 10:36:07.801731 22308 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786098956060137-21165-0/minicluster-data/master-0/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786098956060137-21165-0/minicluster-data/master-0/wal
uuid: "354a384c0db64d32b785d2cdb18f968b"
format_stamp: "Formatted at 2026-08-07 10:36:07 on dist-test-slave-0b58"
server_key: "607ede43ddfdf4634a1af8ea2c3dc7dd"
server_key_iv: "f845f6f9bd64090431e5fca17d1c699e"
server_key_version: "encryptionkey@0"
I20260807 10:36:07.801939 22308 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786098956060137-21165-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786098956060137-21165-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786098956060137-21165-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:36:07.820133 22308 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:36:07.824393 22308 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:36:07.824669 22308 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:36:07.846608 22308 rpc_server.cc:307] RPC server started. Bound to: 127.20.171.126:41367
I20260807 10:36:07.846622 22389 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.171.126:41367 every 8 connection(s)
I20260807 10:36:07.847952 22308 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
I20260807 10:36:07.849534 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 22308
I20260807 10:36:07.849790 21165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786098956060137-21165-0/minicluster-data/master-0/wal/instance
I20260807 10:36:07.850652 21165 external_mini_cluster.cc:1428] Setting key 4a54f469f7d7de496030d2c00617edf7
I20260807 10:36:07.852730 22390 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 07 10:36:07 dist-test-slave-0b58 krb5kdc[22295](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786098967, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.171.126@KRBTEST.COM
I20260807 10:36:07.866346 22390 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 354a384c0db64d32b785d2cdb18f968b: Bootstrap starting.
I20260807 10:36:07.869546 22390 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 354a384c0db64d32b785d2cdb18f968b: Neither blocks nor log segments found. Creating new log.
I20260807 10:36:07.870883 22390 log.cc:824] T 00000000000000000000000000000000 P 354a384c0db64d32b785d2cdb18f968b: Log is configured to *not* fsync() on all Append() calls
I20260807 10:36:07.873772 22393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:07.852700 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48248 (local address 127.20.171.126:41367)
0807 10:36:07.853509 (+ 809us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:07.853519 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:07.853557 (+ 38us) server_negotiation.cc:407] Connection header received
0807 10:36:07.855095 (+ 1538us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:07.855115 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:07.855488 (+ 373us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:07.855785 (+ 297us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:36:07.857583 (+ 1798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:07.859004 (+ 1421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:07.860785 (+ 1781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:07.861446 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:07.861579 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:07.866451 (+ 4872us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:36:07.866463 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:36:07.866483 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:36:07.866533 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:36:07.869563 (+ 3030us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:07.870412 (+ 849us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:07.870418 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:07.870425 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:07.870585 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:07.871048 (+ 463us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:07.871052 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:07.871054 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:07.871722 (+ 668us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:36:07.872053 (+ 331us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:07.872404 (+ 351us) server_negotiation.cc:299] Negotiation successful
0807 10:36:07.872799 (+ 395us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":600,"thread_start_us":386,"threads_started":1}
I20260807 10:36:07.874015 22390 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 354a384c0db64d32b785d2cdb18f968b: No bootstrap required, opened a new log
I20260807 10:36:07.882121 22390 raft_consensus.cc:348] T 00000000000000000000000000000000 P 354a384c0db64d32b785d2cdb18f968b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "354a384c0db64d32b785d2cdb18f968b" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 41367 } }
I20260807 10:36:07.882463 22390 raft_consensus.cc:374] T 00000000000000000000000000000000 P 354a384c0db64d32b785d2cdb18f968b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:36:07.882567 22390 raft_consensus.cc:729] T 00000000000000000000000000000000 P 354a384c0db64d32b785d2cdb18f968b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 354a384c0db64d32b785d2cdb18f968b, State: Initialized, Role: FOLLOWER
I20260807 10:36:07.883080 22390 consensus_queue.cc:260] T 00000000000000000000000000000000 P 354a384c0db64d32b785d2cdb18f968b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "354a384c0db64d32b785d2cdb18f968b" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 41367 } }
I20260807 10:36:07.883302 22390 raft_consensus.cc:388] T 00000000000000000000000000000000 P 354a384c0db64d32b785d2cdb18f968b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 10:36:07.883433 22390 raft_consensus.cc:482] T 00000000000000000000000000000000 P 354a384c0db64d32b785d2cdb18f968b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 10:36:07.883592 22390 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 354a384c0db64d32b785d2cdb18f968b [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:36:07.886050 22390 raft_consensus.cc:504] T 00000000000000000000000000000000 P 354a384c0db64d32b785d2cdb18f968b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "354a384c0db64d32b785d2cdb18f968b" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 41367 } }
I20260807 10:36:07.886575 22390 leader_election.cc:302] T 00000000000000000000000000000000 P 354a384c0db64d32b785d2cdb18f968b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 354a384c0db64d32b785d2cdb18f968b; no voters:
I20260807 10:36:07.887140 22390 leader_election.cc:288] T 00000000000000000000000000000000 P 354a384c0db64d32b785d2cdb18f968b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 10:36:07.887295 22395 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 354a384c0db64d32b785d2cdb18f968b [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:36:07.888036 22395 raft_consensus.cc:686] T 00000000000000000000000000000000 P 354a384c0db64d32b785d2cdb18f968b [term 1 LEADER]: Becoming Leader. State: Replica: 354a384c0db64d32b785d2cdb18f968b, State: Running, Role: LEADER
I20260807 10:36:07.888607 22395 consensus_queue.cc:237] T 00000000000000000000000000000000 P 354a384c0db64d32b785d2cdb18f968b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "354a384c0db64d32b785d2cdb18f968b" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 41367 } }
I20260807 10:36:07.889348 22390 sys_catalog.cc:564] T 00000000000000000000000000000000 P 354a384c0db64d32b785d2cdb18f968b [sys.catalog]: configured and running, proceeding with master startup.
I20260807 10:36:07.891633 22396 sys_catalog.cc:455] T 00000000000000000000000000000000 P 354a384c0db64d32b785d2cdb18f968b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "354a384c0db64d32b785d2cdb18f968b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "354a384c0db64d32b785d2cdb18f968b" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 41367 } } }
I20260807 10:36:07.891570 22397 sys_catalog.cc:455] T 00000000000000000000000000000000 P 354a384c0db64d32b785d2cdb18f968b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 354a384c0db64d32b785d2cdb18f968b. Latest consensus state: current_term: 1 leader_uuid: "354a384c0db64d32b785d2cdb18f968b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "354a384c0db64d32b785d2cdb18f968b" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 41367 } } }
I20260807 10:36:07.892112 22397 sys_catalog.cc:458] T 00000000000000000000000000000000 P 354a384c0db64d32b785d2cdb18f968b [sys.catalog]: This master's current role is: LEADER
I20260807 10:36:07.892679 22396 sys_catalog.cc:458] T 00000000000000000000000000000000 P 354a384c0db64d32b785d2cdb18f968b [sys.catalog]: This master's current role is: LEADER
I20260807 10:36:07.894440 22403 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 10:36:07.899741 22403 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 10:36:07.908434 22403 catalog_manager.cc:1347] Generated new cluster ID: a074aa48a437458e94aaabb903dc8cc2
I20260807 10:36:07.908536 22403 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 10:36:07.925829 22403 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 10:36:07.927178 22403 catalog_manager.cc:1504] Loading token signing keys...
I20260807 10:36:07.936709 22403 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 354a384c0db64d32b785d2cdb18f968b: Generated new TSK 0
I20260807 10:36:07.937608 22403 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.171.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.171.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.171.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.65.keytab.
Entry for principal kudu/127.20.171.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.65.keytab.
I20260807 10:36:08.001492 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786098956060137-21165-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786098956060137-21165-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786098956060137-21165-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786098956060137-21165-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.171.65:0
--local_ip_for_outbound_sockets=127.20.171.65
--webserver_interface=127.20.171.65
--webserver_port=0
--tserver_master_addrs=127.20.171.126:41367
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.65.keytab
--principal=kudu/127.20.171.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.171.84:42245
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786098956060137-21165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786098956060137-21165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786098956060137-21165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:36:08.332629 22416 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:36:08.332893 22416 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:36:08.333036 22416 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:36:08.339515 22416 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:36:08.339607 22416 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:36:08.339780 22416 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 10:36:08.339915 22416 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.171.65
I20260807 10:36:08.349099 22416 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.171.84:42245
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786098956060137-21165-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786098956060137-21165-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.65.keytab
--principal=kudu/127.20.171.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.171.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786098956060137-21165-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.171.65
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.20.171.126:41367
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.171.65
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786098956060137-21165-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:36:08.350302 22416 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:36:08.351580 22416 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:36:08.364159 22422 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:36:08.364203 22423 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:36:08.364122 22425 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:36:08.365705 22416 server_base.cc:1034] running on GCE node
I20260807 10:36:08.366333 22416 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:36:08.367210 22416 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:36:08.368433 22416 hybrid_clock.cc:648] HybridClock initialized: now 1786098968368382 us; error 45 us; skew 500 ppm
I20260807 10:36:08.368721 22416 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:36:08 dist-test-slave-0b58 krb5kdc[22295](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786098968, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:36:08.371889 22416 init.cc:377] Logged in from keytab as kudu/127.20.171.65@KRBTEST.COM (short username kudu)
I20260807 10:36:08.373493 22416 webserver.cc:460] Webserver started at http://127.20.171.65:46879/ using document root <none> and password file <none>
I20260807 10:36:08.374214 22416 fs_manager.cc:359] Metadata directory not provided
I20260807 10:36:08.374337 22416 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:36:08.374648 22416 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:36:08.377501 22416 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786098956060137-21165-0/minicluster-data/ts-0/data/instance:
uuid: "aae757a800134f73922107969cdfbbe3"
format_stamp: "Formatted at 2026-08-07 10:36:08 on dist-test-slave-0b58"
server_key: "1df137a0dd2c86b221021f425fc246da"
server_key_iv: "3e970b0c099383685f2e1d7abd00f595"
server_key_version: "encryptionkey@0"
I20260807 10:36:08.378360 22416 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786098956060137-21165-0/minicluster-data/ts-0/wal/instance:
uuid: "aae757a800134f73922107969cdfbbe3"
format_stamp: "Formatted at 2026-08-07 10:36:08 on dist-test-slave-0b58"
server_key: "1df137a0dd2c86b221021f425fc246da"
server_key_iv: "3e970b0c099383685f2e1d7abd00f595"
server_key_version: "encryptionkey@0"
I20260807 10:36:08.383276 22416 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.001s
I20260807 10:36:08.386628 22432 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:36:08.387853 22416 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 10:36:08.388016 22416 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786098956060137-21165-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786098956060137-21165-0/minicluster-data/ts-0/wal
uuid: "aae757a800134f73922107969cdfbbe3"
format_stamp: "Formatted at 2026-08-07 10:36:08 on dist-test-slave-0b58"
server_key: "1df137a0dd2c86b221021f425fc246da"
server_key_iv: "3e970b0c099383685f2e1d7abd00f595"
server_key_version: "encryptionkey@0"
I20260807 10:36:08.388230 22416 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786098956060137-21165-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786098956060137-21165-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786098956060137-21165-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:36:08.404140 22416 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:36:08.408473 22416 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:36:08.408730 22416 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:36:08.411379 22416 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:36:08.411486 22416 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:36:08.411633 22416 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:36:08.411751 22416 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.001s sys 0.000s
Aug 07 10:36:08 dist-test-slave-0b58 krb5kdc[22295](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786098968, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.65@KRBTEST.COM for kudu/127.20.171.126@KRBTEST.COM
I20260807 10:36:08.432982 22442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:08.411819 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.65:55749 (local address 127.20.171.126:41367)
0807 10:36:08.412293 (+ 474us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:08.412299 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:08.413430 (+ 1131us) server_negotiation.cc:407] Connection header received
0807 10:36:08.415535 (+ 2105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:08.415544 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:08.415652 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:08.415785 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:36:08.417774 (+ 1989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:08.419048 (+ 1274us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:08.421501 (+ 2453us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:08.421904 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:08.422028 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:08.425904 (+ 3876us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:36:08.425909 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:36:08.425912 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:36:08.425942 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:36:08.428764 (+ 2822us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:08.429980 (+ 1216us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:08.429988 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:08.429993 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:08.430160 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:08.430757 (+ 597us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:08.430765 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:08.430770 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:08.431216 (+ 446us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:36:08.431394 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:08.432087 (+ 693us) server_negotiation.cc:299] Negotiation successful
0807 10:36:08.432433 (+ 346us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":329,"thread_start_us":222,"threads_started":1}
I20260807 10:36:08.433807 22444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:08.412454 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:41367 (local address 127.20.171.65:55749)
0807 10:36:08.413260 (+ 806us) negotiation.cc:107] Waiting for socket to connect
0807 10:36:08.413306 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0807 10:36:08.415236 (+ 1930us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:36:08.416043 (+ 807us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:36:08.416053 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:36:08.416748 (+ 695us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:36:08.417564 (+ 816us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:08.417598 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:08.419228 (+ 1630us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:08.419236 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:08.421352 (+ 2116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:08.421367 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:08.422132 (+ 765us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:08.422140 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:08.422329 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:08.423048 (+ 719us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:36:08.423069 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:36:08.425683 (+ 2614us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:36:08.428937 (+ 3254us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:36:08.428949 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:36:08.428966 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:36:08.429812 (+ 846us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:36:08.430284 (+ 472us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:36:08.430289 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:36:08.430293 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:36:08.430615 (+ 322us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:36:08.431354 (+ 739us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:36:08.431360 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:36:08.431676 (+ 316us) client_negotiation.cc:769] Sending connection context
0807 10:36:08.431921 (+ 245us) client_negotiation.cc:240] Negotiation successful
0807 10:36:08.432417 (+ 496us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":564,"thread_start_us":353,"threads_started":1}
I20260807 10:36:08.455739 22442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:08.440160 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.65:36551 (local address 127.20.171.126:41367)
0807 10:36:08.440404 (+ 244us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:08.440412 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:08.441156 (+ 744us) server_negotiation.cc:407] Connection header received
0807 10:36:08.441346 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:08.441350 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:08.441411 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:08.441487 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:36:08.442941 (+ 1454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:08.443683 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:08.446094 (+ 2411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:08.446648 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:08.446786 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:08.449740 (+ 2954us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:36:08.449749 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:36:08.449757 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:36:08.449801 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:36:08.452939 (+ 3138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:08.453870 (+ 931us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:08.453876 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:08.453879 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:08.454009 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:08.454366 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:08.454370 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:08.454373 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:08.454622 (+ 249us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:36:08.454787 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:08.455185 (+ 398us) server_negotiation.cc:299] Negotiation successful
0807 10:36:08.455395 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260807 10:36:08.455837 22494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:08.440188 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:41367 (local address 127.20.171.65:36551)
0807 10:36:08.441027 (+ 839us) negotiation.cc:107] Waiting for socket to connect
0807 10:36:08.441052 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0807 10:36:08.441215 (+ 163us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:36:08.441544 (+ 329us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:36:08.441552 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:36:08.442317 (+ 765us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:36:08.442766 (+ 449us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:08.442781 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:08.443809 (+ 1028us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:08.443816 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:08.445935 (+ 2119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:08.445956 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:08.446942 (+ 986us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:08.446949 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:08.447253 (+ 304us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:08.448028 (+ 775us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:36:08.448053 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:36:08.449515 (+ 1462us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:36:08.453086 (+ 3571us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:36:08.453091 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:36:08.453095 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:36:08.453733 (+ 638us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:36:08.454114 (+ 381us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:36:08.454118 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:36:08.454122 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:36:08.454259 (+ 137us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:36:08.454739 (+ 480us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:36:08.454745 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:36:08.454926 (+ 181us) client_negotiation.cc:769] Sending connection context
0807 10:36:08.455053 (+ 127us) client_negotiation.cc:240] Negotiation successful
0807 10:36:08.455385 (+ 332us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":651,"thread_start_us":424,"threads_started":1}
I20260807 10:36:08.467032 22416 rpc_server.cc:307] RPC server started. Bound to: 127.20.171.65:41539
I20260807 10:36:08.467062 22559 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.171.65:41539 every 8 connection(s)
I20260807 10:36:08.468233 22416 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786098956060137-21165-0/minicluster-data/ts-0/data/info.pb
I20260807 10:36:08.470393 22561 heartbeater.cc:347] Connected to a master server at 127.20.171.126:41367
I20260807 10:36:08.470623 22561 heartbeater.cc:464] Registering TS with master...
I20260807 10:36:08.471288 22561 heartbeater.cc:511] Master 127.20.171.126:41367 requested a full tablet report, sending...
I20260807 10:36:08.473161 22343 ts_manager.cc:194] Registered new tserver with Master: aae757a800134f73922107969cdfbbe3 (127.20.171.65:41539)
I20260807 10:36:08.474170 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 22416
I20260807 10:36:08.474395 21165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786098956060137-21165-0/minicluster-data/ts-0/wal/instance
I20260807 10:36:08.475323 21165 external_mini_cluster.cc:1428] Setting key 37db1d8af706ac980b28356875e86cf0
I20260807 10:36:08.475288 22343 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.171.65@KRBTEST.COM'} at 127.20.171.65:55749
WARNING: no policy specified for kudu/127.20.171.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.171.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.171.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.66.keytab.
Entry for principal kudu/127.20.171.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.66.keytab.
I20260807 10:36:08.519392 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786098956060137-21165-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786098956060137-21165-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786098956060137-21165-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786098956060137-21165-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.171.66:0
--local_ip_for_outbound_sockets=127.20.171.66
--webserver_interface=127.20.171.66
--webserver_port=0
--tserver_master_addrs=127.20.171.126:41367
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.66.keytab
--principal=kudu/127.20.171.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.171.84:42245
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786098956060137-21165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786098956060137-21165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786098956060137-21165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:36:08.843619 22565 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:36:08.843915 22565 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:36:08.844067 22565 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:36:08.854147 22565 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:36:08.854286 22565 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:36:08.854419 22565 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 10:36:08.854544 22565 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.171.66
I20260807 10:36:08.867554 22565 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.171.84:42245
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786098956060137-21165-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786098956060137-21165-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.66.keytab
--principal=kudu/127.20.171.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.171.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786098956060137-21165-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.171.66
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.20.171.126:41367
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.171.66
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786098956060137-21165-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:36:08.868835 22565 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:36:08.870108 22565 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:36:08.883347 22570 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:36:08.883316 22571 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:36:08.883394 22573 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:36:08.884202 22565 server_base.cc:1034] running on GCE node
I20260807 10:36:08.884835 22565 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:36:08.885735 22565 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:36:08.886945 22565 hybrid_clock.cc:648] HybridClock initialized: now 1786098968886892 us; error 28 us; skew 500 ppm
I20260807 10:36:08.887243 22565 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:36:08 dist-test-slave-0b58 krb5kdc[22295](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786098968, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:36:08.890444 22565 init.cc:377] Logged in from keytab as kudu/127.20.171.66@KRBTEST.COM (short username kudu)
I20260807 10:36:08.891973 22565 webserver.cc:460] Webserver started at http://127.20.171.66:35453/ using document root <none> and password file <none>
I20260807 10:36:08.892791 22565 fs_manager.cc:359] Metadata directory not provided
I20260807 10:36:08.892920 22565 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:36:08.893215 22565 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:36:08.896328 22565 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786098956060137-21165-0/minicluster-data/ts-1/data/instance:
uuid: "9ea8e44a25c3465f8810bb827e067eef"
format_stamp: "Formatted at 2026-08-07 10:36:08 on dist-test-slave-0b58"
server_key: "18949e628053fbc475ae190a744c4a53"
server_key_iv: "3081318a9fed281de043984d106883c4"
server_key_version: "encryptionkey@0"
I20260807 10:36:08.897121 22565 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786098956060137-21165-0/minicluster-data/ts-1/wal/instance:
uuid: "9ea8e44a25c3465f8810bb827e067eef"
format_stamp: "Formatted at 2026-08-07 10:36:08 on dist-test-slave-0b58"
server_key: "18949e628053fbc475ae190a744c4a53"
server_key_iv: "3081318a9fed281de043984d106883c4"
server_key_version: "encryptionkey@0"
I20260807 10:36:08.902402 22565 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260807 10:36:08.905975 22580 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:36:08.907310 22565 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260807 10:36:08.907445 22565 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786098956060137-21165-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786098956060137-21165-0/minicluster-data/ts-1/wal
uuid: "9ea8e44a25c3465f8810bb827e067eef"
format_stamp: "Formatted at 2026-08-07 10:36:08 on dist-test-slave-0b58"
server_key: "18949e628053fbc475ae190a744c4a53"
server_key_iv: "3081318a9fed281de043984d106883c4"
server_key_version: "encryptionkey@0"
I20260807 10:36:08.907634 22565 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786098956060137-21165-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786098956060137-21165-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786098956060137-21165-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:36:08.929198 22565 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:36:08.933197 22565 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:36:08.933416 22565 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:36:08.936458 22565 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:36:08.936674 22565 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:36:08.937220 22565 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:36:08.937319 22565 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 07 10:36:08 dist-test-slave-0b58 krb5kdc[22295](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786098968, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.66@KRBTEST.COM for kudu/127.20.171.126@KRBTEST.COM
I20260807 10:36:08.958561 22442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:08.936777 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.66:59945 (local address 127.20.171.126:41367)
0807 10:36:08.936975 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:08.936983 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:08.938541 (+ 1558us) server_negotiation.cc:407] Connection header received
0807 10:36:08.940691 (+ 2150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:08.940700 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:08.940817 (+ 117us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:08.940942 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:36:08.942838 (+ 1896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:08.944188 (+ 1350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:08.946895 (+ 2707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:08.947340 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:08.947469 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:08.951691 (+ 4222us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:36:08.951696 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:36:08.951699 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:36:08.951738 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:36:08.954969 (+ 3231us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:08.956067 (+ 1098us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:08.956075 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:08.956080 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:08.956220 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:08.956738 (+ 518us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:08.956743 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:08.956746 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:08.957045 (+ 299us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:36:08.957196 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:08.957961 (+ 765us) server_negotiation.cc:299] Negotiation successful
0807 10:36:08.958193 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260807 10:36:08.960139 22589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:08.937276 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:41367 (local address 127.20.171.66:59945)
0807 10:36:08.938355 (+ 1079us) negotiation.cc:107] Waiting for socket to connect
0807 10:36:08.938406 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0807 10:36:08.940401 (+ 1995us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:36:08.941186 (+ 785us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:36:08.941195 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:36:08.941733 (+ 538us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:36:08.942586 (+ 853us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:08.942617 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:08.944397 (+ 1780us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:08.944407 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:08.946737 (+ 2330us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:08.946753 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:08.947592 (+ 839us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:08.947601 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:08.947812 (+ 211us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:08.948643 (+ 831us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:36:08.948697 (+ 54us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:36:08.951476 (+ 2779us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:36:08.955168 (+ 3692us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:36:08.955182 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:36:08.955212 (+ 30us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:36:08.955878 (+ 666us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:36:08.956370 (+ 492us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:36:08.956375 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:36:08.956379 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:36:08.956586 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:36:08.957182 (+ 596us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:36:08.957190 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:36:08.957582 (+ 392us) client_negotiation.cc:769] Sending connection context
0807 10:36:08.957850 (+ 268us) client_negotiation.cc:240] Negotiation successful
0807 10:36:08.958529 (+ 679us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":810,"thread_start_us":432,"threads_started":1}
I20260807 10:36:08.984112 22644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:08.966187 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:41367 (local address 127.20.171.66:48859)
0807 10:36:08.966965 (+ 778us) negotiation.cc:107] Waiting for socket to connect
0807 10:36:08.966991 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0807 10:36:08.967175 (+ 184us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:36:08.967529 (+ 354us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:36:08.967536 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:36:08.968348 (+ 812us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:36:08.969008 (+ 660us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:08.969026 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:08.970289 (+ 1263us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:08.970298 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:08.972513 (+ 2215us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:08.972531 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:08.973482 (+ 951us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:08.973493 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:08.973802 (+ 309us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:08.974707 (+ 905us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:36:08.974736 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:36:08.976141 (+ 1405us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:36:08.980972 (+ 4831us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:36:08.980979 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:36:08.980986 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:36:08.981566 (+ 580us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:36:08.982071 (+ 505us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:36:08.982076 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:36:08.982083 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:36:08.982287 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:36:08.983028 (+ 741us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:36:08.983032 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:36:08.983187 (+ 155us) client_negotiation.cc:769] Sending connection context
0807 10:36:08.983312 (+ 125us) client_negotiation.cc:240] Negotiation successful
0807 10:36:08.983569 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":570,"thread_start_us":393,"threads_started":1}
I20260807 10:36:08.984185 22442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:08.966232 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.66:48859 (local address 127.20.171.126:41367)
0807 10:36:08.966485 (+ 253us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:08.966495 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:08.967094 (+ 599us) server_negotiation.cc:407] Connection header received
0807 10:36:08.967306 (+ 212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:08.967309 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:08.967383 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:08.967460 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:36:08.969191 (+ 1731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:08.970125 (+ 934us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:08.972678 (+ 2553us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:08.973258 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:08.973405 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:08.976433 (+ 3028us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:36:08.976442 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:36:08.976450 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:36:08.976498 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:36:08.980817 (+ 4319us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:08.981759 (+ 942us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:08.981767 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:08.981772 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:08.981946 (+ 174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:08.982441 (+ 495us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:08.982446 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:08.982449 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:08.982910 (+ 461us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:36:08.983076 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:08.983452 (+ 376us) server_negotiation.cc:299] Negotiation successful
0807 10:36:08.983748 (+ 296us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260807 10:36:08.996543 22565 rpc_server.cc:307] RPC server started. Bound to: 127.20.171.66:33143
I20260807 10:36:08.996562 22703 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.171.66:33143 every 8 connection(s)
I20260807 10:36:08.997787 22565 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786098956060137-21165-0/minicluster-data/ts-1/data/info.pb
I20260807 10:36:08.999459 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 22565
I20260807 10:36:08.999675 21165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786098956060137-21165-0/minicluster-data/ts-1/wal/instance
I20260807 10:36:08.999840 22704 heartbeater.cc:347] Connected to a master server at 127.20.171.126:41367
I20260807 10:36:09.000072 22704 heartbeater.cc:464] Registering TS with master...
I20260807 10:36:09.000240 21165 external_mini_cluster.cc:1428] Setting key 32beb448aa79d1ee5f8433205e666079
I20260807 10:36:09.000770 22704 heartbeater.cc:511] Master 127.20.171.126:41367 requested a full tablet report, sending...
I20260807 10:36:09.002142 22342 ts_manager.cc:194] Registered new tserver with Master: 9ea8e44a25c3465f8810bb827e067eef (127.20.171.66:33143)
I20260807 10:36:09.002942 22342 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.171.66@KRBTEST.COM'} at 127.20.171.66:59945
WARNING: no policy specified for kudu/127.20.171.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.171.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.171.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.67.keytab.
Entry for principal kudu/127.20.171.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.67.keytab.
I20260807 10:36:09.047812 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786098956060137-21165-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786098956060137-21165-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786098956060137-21165-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786098956060137-21165-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.171.67:0
--local_ip_for_outbound_sockets=127.20.171.67
--webserver_interface=127.20.171.67
--webserver_port=0
--tserver_master_addrs=127.20.171.126:41367
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.67.keytab
--principal=kudu/127.20.171.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.171.84:42245
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786098956060137-21165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786098956060137-21165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786098956060137-21165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:36:09.390417 22708 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:36:09.390745 22708 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:36:09.390846 22708 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:36:09.398037 22708 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:36:09.398140 22708 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:36:09.398219 22708 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 10:36:09.398304 22708 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.171.67
I20260807 10:36:09.409252 22708 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.171.84:42245
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786098956060137-21165-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786098956060137-21165-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.67.keytab
--principal=kudu/127.20.171.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.171.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786098956060137-21165-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.171.67
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.20.171.126:41367
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.171.67
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786098956060137-21165-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:36:09.410543 22708 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:36:09.411912 22708 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:36:09.425115 22713 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:36:09.425065 22716 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:36:09.425032 22714 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:36:09.425841 22708 server_base.cc:1034] running on GCE node
I20260807 10:36:09.426543 22708 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:36:09.427513 22708 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:36:09.428757 22708 hybrid_clock.cc:648] HybridClock initialized: now 1786098969428691 us; error 42 us; skew 500 ppm
I20260807 10:36:09.429118 22708 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:36:09 dist-test-slave-0b58 krb5kdc[22295](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786098969, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:36:09.432900 22708 init.cc:377] Logged in from keytab as kudu/127.20.171.67@KRBTEST.COM (short username kudu)
I20260807 10:36:09.434363 22708 webserver.cc:460] Webserver started at http://127.20.171.67:34069/ using document root <none> and password file <none>
I20260807 10:36:09.435098 22708 fs_manager.cc:359] Metadata directory not provided
I20260807 10:36:09.435225 22708 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:36:09.435590 22708 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:36:09.438619 22708 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786098956060137-21165-0/minicluster-data/ts-2/data/instance:
uuid: "a9ed98413633427788f39efc24c4251f"
format_stamp: "Formatted at 2026-08-07 10:36:09 on dist-test-slave-0b58"
server_key: "085145b0d957c5ec720d5e965288c36f"
server_key_iv: "b463110e5888885083e39e2af740942d"
server_key_version: "encryptionkey@0"
I20260807 10:36:09.439415 22708 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786098956060137-21165-0/minicluster-data/ts-2/wal/instance:
uuid: "a9ed98413633427788f39efc24c4251f"
format_stamp: "Formatted at 2026-08-07 10:36:09 on dist-test-slave-0b58"
server_key: "085145b0d957c5ec720d5e965288c36f"
server_key_iv: "b463110e5888885083e39e2af740942d"
server_key_version: "encryptionkey@0"
I20260807 10:36:09.444636 22708 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260807 10:36:09.448135 22723 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:36:09.449553 22708 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260807 10:36:09.449745 22708 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786098956060137-21165-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786098956060137-21165-0/minicluster-data/ts-2/wal
uuid: "a9ed98413633427788f39efc24c4251f"
format_stamp: "Formatted at 2026-08-07 10:36:09 on dist-test-slave-0b58"
server_key: "085145b0d957c5ec720d5e965288c36f"
server_key_iv: "b463110e5888885083e39e2af740942d"
server_key_version: "encryptionkey@0"
I20260807 10:36:09.449999 22708 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786098956060137-21165-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786098956060137-21165-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786098956060137-21165-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:36:09.466892 22708 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:36:09.472335 22708 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:36:09.472637 22708 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:36:09.475504 22708 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:36:09.475618 22708 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:36:09.475770 22708 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:36:09.475845 22708 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:36:09.478391 22561 heartbeater.cc:503] Master 127.20.171.126:41367 was elected leader, sending a full tablet report...
Aug 07 10:36:09 dist-test-slave-0b58 krb5kdc[22295](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786098969, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.67@KRBTEST.COM for kudu/127.20.171.126@KRBTEST.COM
I20260807 10:36:09.501963 22442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:09.476206 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.67:60437 (local address 127.20.171.126:41367)
0807 10:36:09.476435 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:09.476441 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:09.477885 (+ 1444us) server_negotiation.cc:407] Connection header received
0807 10:36:09.481247 (+ 3362us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:09.481254 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:09.481356 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:09.481485 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:36:09.483700 (+ 2215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:09.485161 (+ 1461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:09.487819 (+ 2658us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:09.488450 (+ 631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:09.488581 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:09.493620 (+ 5039us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:36:09.493625 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:36:09.493628 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:36:09.493688 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:36:09.497411 (+ 3723us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:09.498525 (+ 1114us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:09.498532 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:09.498536 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:09.498669 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:09.499337 (+ 668us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:09.499342 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:09.499350 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:09.499734 (+ 384us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:36:09.499895 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:09.501031 (+ 1136us) server_negotiation.cc:299] Negotiation successful
0807 10:36:09.501388 (+ 357us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":101}
I20260807 10:36:09.502664 22732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:09.476802 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:41367 (local address 127.20.171.67:60437)
0807 10:36:09.477678 (+ 876us) negotiation.cc:107] Waiting for socket to connect
0807 10:36:09.477725 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0807 10:36:09.480978 (+ 3253us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:36:09.481773 (+ 795us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:36:09.481788 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:36:09.482584 (+ 796us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:36:09.483496 (+ 912us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:09.483525 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:09.485350 (+ 1825us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:09.485358 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:09.487658 (+ 2300us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:09.487674 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:09.488703 (+ 1029us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:09.488711 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:09.488914 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:09.489673 (+ 759us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:36:09.489715 (+ 42us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:36:09.493375 (+ 3660us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:36:09.497614 (+ 4239us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:36:09.497623 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:36:09.497639 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:36:09.498367 (+ 728us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:36:09.498794 (+ 427us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:36:09.498799 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:36:09.498802 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:36:09.499166 (+ 364us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:36:09.499979 (+ 813us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:36:09.499986 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:36:09.500560 (+ 574us) client_negotiation.cc:769] Sending connection context
0807 10:36:09.500905 (+ 345us) client_negotiation.cc:240] Negotiation successful
0807 10:36:09.501427 (+ 522us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":584,"thread_start_us":338,"threads_started":1}
I20260807 10:36:09.525847 22442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:09.509067 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.67:33095 (local address 127.20.171.126:41367)
0807 10:36:09.509298 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:09.509307 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:09.510057 (+ 750us) server_negotiation.cc:407] Connection header received
0807 10:36:09.510207 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:09.510215 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:09.510334 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:09.510466 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:36:09.511425 (+ 959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:09.512811 (+ 1386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:09.514849 (+ 2038us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:09.515513 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:09.515671 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:09.518413 (+ 2742us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:36:09.518422 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:36:09.518430 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:36:09.518469 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:36:09.522181 (+ 3712us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:09.523341 (+ 1160us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:09.523347 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:09.523351 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:09.523532 (+ 181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:09.524007 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:09.524014 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:09.524020 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:09.524498 (+ 478us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:36:09.524695 (+ 197us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:09.525208 (+ 513us) server_negotiation.cc:299] Negotiation successful
0807 10:36:09.525442 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260807 10:36:09.525975 22799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:09.509287 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:41367 (local address 127.20.171.67:33095)
0807 10:36:09.509964 (+ 677us) negotiation.cc:107] Waiting for socket to connect
0807 10:36:09.509980 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 10:36:09.510087 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:36:09.510480 (+ 393us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:36:09.510483 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:36:09.510981 (+ 498us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:36:09.511270 (+ 289us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:09.511279 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:09.512972 (+ 1693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:09.512980 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:09.514700 (+ 1720us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:09.514713 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:09.515753 (+ 1040us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:09.515762 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:09.516023 (+ 261us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:09.516985 (+ 962us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:36:09.517019 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:36:09.518196 (+ 1177us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:36:09.522386 (+ 4190us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:36:09.522391 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:36:09.522396 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:36:09.523159 (+ 763us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:36:09.523654 (+ 495us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:36:09.523659 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:36:09.523662 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:36:09.523846 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:36:09.524673 (+ 827us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:36:09.524681 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:36:09.524940 (+ 259us) client_negotiation.cc:769] Sending connection context
0807 10:36:09.525110 (+ 170us) client_negotiation.cc:240] Negotiation successful
0807 10:36:09.525446 (+ 336us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":523,"thread_start_us":338,"threads_started":1}
I20260807 10:36:09.531787 22708 rpc_server.cc:307] RPC server started. Bound to: 127.20.171.67:42801
I20260807 10:36:09.531810 22846 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.171.67:42801 every 8 connection(s)
I20260807 10:36:09.533056 22708 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786098956060137-21165-0/minicluster-data/ts-2/data/info.pb
I20260807 10:36:09.535043 22847 heartbeater.cc:347] Connected to a master server at 127.20.171.126:41367
I20260807 10:36:09.535269 22847 heartbeater.cc:464] Registering TS with master...
I20260807 10:36:09.535967 22847 heartbeater.cc:511] Master 127.20.171.126:41367 requested a full tablet report, sending...
I20260807 10:36:09.537437 22342 ts_manager.cc:194] Registered new tserver with Master: a9ed98413633427788f39efc24c4251f (127.20.171.67:42801)
I20260807 10:36:09.538261 22342 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.171.67@KRBTEST.COM'} at 127.20.171.67:60437
I20260807 10:36:09.538970 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 22708
I20260807 10:36:09.539147 21165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786098956060137-21165-0/minicluster-data/ts-2/wal/instance
I20260807 10:36:09.539588 21165 external_mini_cluster.cc:1428] Setting key 227b6f9af37defc6582774bc78a2e945
I20260807 10:36:09.542420 21165 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 07 10:36:09 dist-test-slave-0b58 krb5kdc[22295](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786098969, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 07 10:36:09 dist-test-slave-0b58 krb5kdc[22295](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786098969, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.20.171.126@KRBTEST.COM
I20260807 10:36:09.599074 22442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:09.581430 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48256 (local address 127.20.171.126:41367)
0807 10:36:09.581605 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:09.581609 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:09.581981 (+ 372us) server_negotiation.cc:407] Connection header received
0807 10:36:09.582140 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:09.582144 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:09.582212 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:09.582302 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:36:09.583769 (+ 1467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:09.584560 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:09.586600 (+ 2040us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:09.587009 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:09.587104 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:09.592912 (+ 5808us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:36:09.592921 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:36:09.592927 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:36:09.592969 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:36:09.596040 (+ 3071us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:09.596725 (+ 685us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:09.596729 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:09.596731 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:09.596909 (+ 178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:09.597345 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:09.597348 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:09.597350 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:09.597806 (+ 456us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:36:09.598099 (+ 293us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:09.598337 (+ 238us) server_negotiation.cc:299] Negotiation successful
0807 10:36:09.598560 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260807 10:36:09.603542 22342 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:48256:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 10:36:09.612865 22342 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 10:36:09.646806 22863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:09.627990 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52316 (local address 127.20.171.65:41539)
0807 10:36:09.629113 (+ 1123us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:09.629119 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:09.635949 (+ 6830us) server_negotiation.cc:407] Connection header received
0807 10:36:09.636437 (+ 488us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:09.636446 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:09.636711 (+ 265us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:09.636885 (+ 174us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:36:09.638524 (+ 1639us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:09.640418 (+ 1894us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:09.643873 (+ 3455us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:09.645290 (+ 1417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:09.645440 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:09.645713 (+ 273us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:09.646193 (+ 480us) server_negotiation.cc:299] Negotiation successful
0807 10:36:09.646407 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":983,"thread_start_us":802,"threads_started":1}
I20260807 10:36:09.648159 22862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:09.627128 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55156 (local address 127.20.171.66:33143)
0807 10:36:09.628492 (+ 1364us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:09.628504 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:09.635555 (+ 7051us) server_negotiation.cc:407] Connection header received
0807 10:36:09.635687 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:09.635714 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:09.636097 (+ 383us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:09.636338 (+ 241us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:36:09.638408 (+ 2070us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:09.639946 (+ 1538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:09.644246 (+ 4300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:09.646143 (+ 1897us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:09.646291 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:09.646574 (+ 283us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:09.647502 (+ 928us) server_negotiation.cc:299] Negotiation successful
0807 10:36:09.647713 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1135,"thread_start_us":874,"threads_started":1}
I20260807 10:36:09.648598 22864 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:09.626752 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.66:33143 (local address 127.0.0.1:55156)
0807 10:36:09.634950 (+ 8198us) negotiation.cc:107] Waiting for socket to connect
0807 10:36:09.635012 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0807 10:36:09.635286 (+ 274us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:36:09.636687 (+ 1401us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:36:09.636695 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:36:09.636737 (+ 42us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:36:09.638098 (+ 1361us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:09.638116 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:09.640153 (+ 2037us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:09.640160 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:09.643974 (+ 3814us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:09.644020 (+ 46us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:09.647114 (+ 3094us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:09.647121 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:09.647314 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:09.647351 (+ 37us) client_negotiation.cc:769] Sending connection context
0807 10:36:09.647443 (+ 92us) client_negotiation.cc:240] Negotiation successful
0807 10:36:09.647626 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7906,"mutex_wait_us":57,"thread_start_us":9769,"threads_started":1}
I20260807 10:36:09.648698 22866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:09.627286 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.65:41539 (local address 127.0.0.1:52316)
0807 10:36:09.635819 (+ 8533us) negotiation.cc:107] Waiting for socket to connect
0807 10:36:09.635846 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0807 10:36:09.636185 (+ 339us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:36:09.637107 (+ 922us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:36:09.637112 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:36:09.637144 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:36:09.638299 (+ 1155us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:09.638313 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:09.640546 (+ 2233us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:09.640553 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:09.643696 (+ 3143us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:09.643709 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:09.645611 (+ 1902us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:09.645619 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:09.645896 (+ 277us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:09.645953 (+ 57us) client_negotiation.cc:769] Sending connection context
0807 10:36:09.647392 (+ 1439us) client_negotiation.cc:240] Negotiation successful
0807 10:36:09.647645 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8349,"mutex_wait_us":128,"thread_start_us":7012,"threads_started":1}
I20260807 10:36:09.650198 22861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:09.632666 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.67:42801 (local address 127.0.0.1:35458)
0807 10:36:09.637089 (+ 4423us) negotiation.cc:107] Waiting for socket to connect
0807 10:36:09.637111 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0807 10:36:09.637288 (+ 177us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:36:09.638618 (+ 1330us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:36:09.638625 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:36:09.638650 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:36:09.639508 (+ 858us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:09.639522 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:09.642559 (+ 3037us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:09.642564 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:09.645917 (+ 3353us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:09.645934 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:09.649078 (+ 3144us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:09.649086 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:09.649380 (+ 294us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:09.649411 (+ 31us) client_negotiation.cc:769] Sending connection context
0807 10:36:09.649508 (+ 97us) client_negotiation.cc:240] Negotiation successful
0807 10:36:09.649626 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4243,"mutex_wait_us":23,"thread_start_us":2662,"threads_started":1}
I20260807 10:36:09.650261 22865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:09.628178 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35458 (local address 127.20.171.67:42801)
0807 10:36:09.633858 (+ 5680us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:09.633870 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:09.637272 (+ 3402us) server_negotiation.cc:407] Connection header received
0807 10:36:09.637479 (+ 207us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:09.637503 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:09.637770 (+ 267us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:09.638020 (+ 250us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:36:09.639918 (+ 1898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:09.642313 (+ 2395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:09.646308 (+ 3995us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:09.648366 (+ 2058us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:09.648518 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:09.648865 (+ 347us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:09.649597 (+ 732us) server_negotiation.cc:299] Negotiation successful
0807 10:36:09.649774 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5458,"thread_start_us":5139,"threads_started":1}
I20260807 10:36:09.653385 22631 tablet_service.cc:1467] Processing CreateTablet for tablet 8b4499a92209470594f53d4c36ed6c08 (DEFAULT_TABLE table=test-table [id=d896bb493ec5496dacfcefd8057e5688]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:36:09.653417 22487 tablet_service.cc:1467] Processing CreateTablet for tablet 8b4499a92209470594f53d4c36ed6c08 (DEFAULT_TABLE table=test-table [id=d896bb493ec5496dacfcefd8057e5688]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:36:09.654901 22631 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8b4499a92209470594f53d4c36ed6c08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:36:09.654403 22775 tablet_service.cc:1467] Processing CreateTablet for tablet 8b4499a92209470594f53d4c36ed6c08 (DEFAULT_TABLE table=test-table [id=d896bb493ec5496dacfcefd8057e5688]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:36:09.655241 22487 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8b4499a92209470594f53d4c36ed6c08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:36:09.656199 22775 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8b4499a92209470594f53d4c36ed6c08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:36:09.670142 22867 tablet_bootstrap.cc:492] T 8b4499a92209470594f53d4c36ed6c08 P 9ea8e44a25c3465f8810bb827e067eef: Bootstrap starting.
I20260807 10:36:09.673544 22867 tablet_bootstrap.cc:654] T 8b4499a92209470594f53d4c36ed6c08 P 9ea8e44a25c3465f8810bb827e067eef: Neither blocks nor log segments found. Creating new log.
I20260807 10:36:09.676278 22869 tablet_bootstrap.cc:492] T 8b4499a92209470594f53d4c36ed6c08 P a9ed98413633427788f39efc24c4251f: Bootstrap starting.
I20260807 10:36:09.676712 22867 log.cc:824] T 8b4499a92209470594f53d4c36ed6c08 P 9ea8e44a25c3465f8810bb827e067eef: Log is configured to *not* fsync() on all Append() calls
I20260807 10:36:09.680517 22868 tablet_bootstrap.cc:492] T 8b4499a92209470594f53d4c36ed6c08 P aae757a800134f73922107969cdfbbe3: Bootstrap starting.
I20260807 10:36:09.681402 22867 tablet_bootstrap.cc:492] T 8b4499a92209470594f53d4c36ed6c08 P 9ea8e44a25c3465f8810bb827e067eef: No bootstrap required, opened a new log
I20260807 10:36:09.681720 22867 ts_tablet_manager.cc:1397] T 8b4499a92209470594f53d4c36ed6c08 P 9ea8e44a25c3465f8810bb827e067eef: Time spent bootstrapping tablet: real 0.012s user 0.007s sys 0.002s
I20260807 10:36:09.682893 22869 tablet_bootstrap.cc:654] T 8b4499a92209470594f53d4c36ed6c08 P a9ed98413633427788f39efc24c4251f: Neither blocks nor log segments found. Creating new log.
I20260807 10:36:09.684008 22868 tablet_bootstrap.cc:654] T 8b4499a92209470594f53d4c36ed6c08 P aae757a800134f73922107969cdfbbe3: Neither blocks nor log segments found. Creating new log.
I20260807 10:36:09.685402 22869 log.cc:824] T 8b4499a92209470594f53d4c36ed6c08 P a9ed98413633427788f39efc24c4251f: Log is configured to *not* fsync() on all Append() calls
I20260807 10:36:09.685910 22868 log.cc:824] T 8b4499a92209470594f53d4c36ed6c08 P aae757a800134f73922107969cdfbbe3: Log is configured to *not* fsync() on all Append() calls
I20260807 10:36:09.690292 22869 tablet_bootstrap.cc:492] T 8b4499a92209470594f53d4c36ed6c08 P a9ed98413633427788f39efc24c4251f: No bootstrap required, opened a new log
I20260807 10:36:09.690774 22869 ts_tablet_manager.cc:1397] T 8b4499a92209470594f53d4c36ed6c08 P a9ed98413633427788f39efc24c4251f: Time spent bootstrapping tablet: real 0.015s user 0.010s sys 0.000s
I20260807 10:36:09.691437 22868 tablet_bootstrap.cc:492] T 8b4499a92209470594f53d4c36ed6c08 P aae757a800134f73922107969cdfbbe3: No bootstrap required, opened a new log
I20260807 10:36:09.691787 22868 ts_tablet_manager.cc:1397] T 8b4499a92209470594f53d4c36ed6c08 P aae757a800134f73922107969cdfbbe3: Time spent bootstrapping tablet: real 0.013s user 0.004s sys 0.005s
I20260807 10:36:09.696692 22867 raft_consensus.cc:348] T 8b4499a92209470594f53d4c36ed6c08 P 9ea8e44a25c3465f8810bb827e067eef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ea8e44a25c3465f8810bb827e067eef" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 33143 } } peers { permanent_uuid: "aae757a800134f73922107969cdfbbe3" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 41539 } } peers { permanent_uuid: "a9ed98413633427788f39efc24c4251f" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 42801 } }
I20260807 10:36:09.697396 22867 raft_consensus.cc:374] T 8b4499a92209470594f53d4c36ed6c08 P 9ea8e44a25c3465f8810bb827e067eef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:36:09.697685 22867 raft_consensus.cc:729] T 8b4499a92209470594f53d4c36ed6c08 P 9ea8e44a25c3465f8810bb827e067eef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ea8e44a25c3465f8810bb827e067eef, State: Initialized, Role: FOLLOWER
I20260807 10:36:09.698508 22867 consensus_queue.cc:260] T 8b4499a92209470594f53d4c36ed6c08 P 9ea8e44a25c3465f8810bb827e067eef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ea8e44a25c3465f8810bb827e067eef" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 33143 } } peers { permanent_uuid: "aae757a800134f73922107969cdfbbe3" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 41539 } } peers { permanent_uuid: "a9ed98413633427788f39efc24c4251f" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 42801 } }
I20260807 10:36:09.700137 22704 heartbeater.cc:503] Master 127.20.171.126:41367 was elected leader, sending a full tablet report...
I20260807 10:36:09.701094 22867 ts_tablet_manager.cc:1428] T 8b4499a92209470594f53d4c36ed6c08 P 9ea8e44a25c3465f8810bb827e067eef: Time spent starting tablet: real 0.019s user 0.012s sys 0.008s
I20260807 10:36:09.704191 22868 raft_consensus.cc:348] T 8b4499a92209470594f53d4c36ed6c08 P aae757a800134f73922107969cdfbbe3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ea8e44a25c3465f8810bb827e067eef" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 33143 } } peers { permanent_uuid: "aae757a800134f73922107969cdfbbe3" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 41539 } } peers { permanent_uuid: "a9ed98413633427788f39efc24c4251f" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 42801 } }
I20260807 10:36:09.704730 22868 raft_consensus.cc:374] T 8b4499a92209470594f53d4c36ed6c08 P aae757a800134f73922107969cdfbbe3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:36:09.704909 22868 raft_consensus.cc:729] T 8b4499a92209470594f53d4c36ed6c08 P aae757a800134f73922107969cdfbbe3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aae757a800134f73922107969cdfbbe3, State: Initialized, Role: FOLLOWER
I20260807 10:36:09.705634 22868 consensus_queue.cc:260] T 8b4499a92209470594f53d4c36ed6c08 P aae757a800134f73922107969cdfbbe3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ea8e44a25c3465f8810bb827e067eef" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 33143 } } peers { permanent_uuid: "aae757a800134f73922107969cdfbbe3" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 41539 } } peers { permanent_uuid: "a9ed98413633427788f39efc24c4251f" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 42801 } }
I20260807 10:36:09.705874 22869 raft_consensus.cc:348] T 8b4499a92209470594f53d4c36ed6c08 P a9ed98413633427788f39efc24c4251f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ea8e44a25c3465f8810bb827e067eef" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 33143 } } peers { permanent_uuid: "aae757a800134f73922107969cdfbbe3" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 41539 } } peers { permanent_uuid: "a9ed98413633427788f39efc24c4251f" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 42801 } }
I20260807 10:36:09.706571 22869 raft_consensus.cc:374] T 8b4499a92209470594f53d4c36ed6c08 P a9ed98413633427788f39efc24c4251f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:36:09.706784 22869 raft_consensus.cc:729] T 8b4499a92209470594f53d4c36ed6c08 P a9ed98413633427788f39efc24c4251f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9ed98413633427788f39efc24c4251f, State: Initialized, Role: FOLLOWER
I20260807 10:36:09.707475 22869 consensus_queue.cc:260] T 8b4499a92209470594f53d4c36ed6c08 P a9ed98413633427788f39efc24c4251f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ea8e44a25c3465f8810bb827e067eef" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 33143 } } peers { permanent_uuid: "aae757a800134f73922107969cdfbbe3" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 41539 } } peers { permanent_uuid: "a9ed98413633427788f39efc24c4251f" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 42801 } }
I20260807 10:36:09.709038 22847 heartbeater.cc:503] Master 127.20.171.126:41367 was elected leader, sending a full tablet report...
I20260807 10:36:09.709611 22869 ts_tablet_manager.cc:1428] T 8b4499a92209470594f53d4c36ed6c08 P a9ed98413633427788f39efc24c4251f: Time spent starting tablet: real 0.019s user 0.006s sys 0.014s
I20260807 10:36:09.710052 22868 ts_tablet_manager.cc:1428] T 8b4499a92209470594f53d4c36ed6c08 P aae757a800134f73922107969cdfbbe3: Time spent starting tablet: real 0.018s user 0.009s sys 0.010s
W20260807 10:36:09.720742 22562 tablet.cc:2369] T 8b4499a92209470594f53d4c36ed6c08 P aae757a800134f73922107969cdfbbe3: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 10:36:09.749779 22705 tablet.cc:2369] T 8b4499a92209470594f53d4c36ed6c08 P 9ea8e44a25c3465f8810bb827e067eef: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 10:36:09.783106 22873 raft_consensus.cc:482] T 8b4499a92209470594f53d4c36ed6c08 P 9ea8e44a25c3465f8810bb827e067eef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 10:36:09.783609 22873 raft_consensus.cc:504] T 8b4499a92209470594f53d4c36ed6c08 P 9ea8e44a25c3465f8810bb827e067eef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ea8e44a25c3465f8810bb827e067eef" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 33143 } } peers { permanent_uuid: "aae757a800134f73922107969cdfbbe3" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 41539 } } peers { permanent_uuid: "a9ed98413633427788f39efc24c4251f" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 42801 } }
W20260807 10:36:09.784727 22848 tablet.cc:2369] T 8b4499a92209470594f53d4c36ed6c08 P a9ed98413633427788f39efc24c4251f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 10:36:09.786322 22873 leader_election.cc:288] T 8b4499a92209470594f53d4c36ed6c08 P 9ea8e44a25c3465f8810bb827e067eef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aae757a800134f73922107969cdfbbe3 (127.20.171.65:41539), a9ed98413633427788f39efc24c4251f (127.20.171.67:42801)
I20260807 10:36:09.799309 22863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:09.787012 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.66:57881 (local address 127.20.171.65:41539)
0807 10:36:09.787283 (+ 271us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:09.787289 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:09.789141 (+ 1852us) server_negotiation.cc:407] Connection header received
0807 10:36:09.789412 (+ 271us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:09.789417 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:09.789551 (+ 134us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:09.789655 (+ 104us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:36:09.791065 (+ 1410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:09.792222 (+ 1157us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:09.796081 (+ 3859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:09.797910 (+ 1829us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:09.798125 (+ 215us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:09.798208 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:09.798861 (+ 653us) server_negotiation.cc:299] Negotiation successful
0807 10:36:09.798998 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260807 10:36:09.799427 22865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:09.786767 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.66:37843 (local address 127.20.171.67:42801)
0807 10:36:09.787005 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:09.787010 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:09.788862 (+ 1852us) server_negotiation.cc:407] Connection header received
0807 10:36:09.789123 (+ 261us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:09.789128 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:09.789319 (+ 191us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:09.789423 (+ 104us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:36:09.790554 (+ 1131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:09.791975 (+ 1421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:09.795952 (+ 3977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:09.797948 (+ 1996us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:09.798161 (+ 213us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:09.798236 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:09.798861 (+ 625us) server_negotiation.cc:299] Negotiation successful
0807 10:36:09.798998 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260807 10:36:09.799786 22877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:09.787557 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.65:41539 (local address 127.20.171.66:57881)
0807 10:36:09.789053 (+ 1496us) negotiation.cc:107] Waiting for socket to connect
0807 10:36:09.789067 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 10:36:09.789263 (+ 196us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:36:09.789708 (+ 445us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:36:09.789712 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:36:09.789769 (+ 57us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:36:09.790871 (+ 1102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:09.790883 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:09.792440 (+ 1557us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:09.792456 (+ 16us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:09.795904 (+ 3448us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:09.795918 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:09.798402 (+ 2484us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:09.798411 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:09.798661 (+ 250us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:09.798700 (+ 39us) client_negotiation.cc:769] Sending connection context
0807 10:36:09.798803 (+ 103us) client_negotiation.cc:240] Negotiation successful
0807 10:36:09.799012 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1363,"mutex_wait_us":115,"spinlock_wait_cycles":34176,"thread_start_us":1157,"threads_started":1}
I20260807 10:36:09.800105 22876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:09.786635 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.67:42801 (local address 127.20.171.66:37843)
0807 10:36:09.788751 (+ 2116us) negotiation.cc:107] Waiting for socket to connect
0807 10:36:09.788769 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 10:36:09.788973 (+ 204us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:36:09.789461 (+ 488us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:36:09.789464 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:36:09.789484 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:36:09.790361 (+ 877us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:09.790386 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:09.792125 (+ 1739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:09.792129 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:09.795721 (+ 3592us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:09.795740 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:09.798437 (+ 2697us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:09.798443 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:09.798666 (+ 223us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:09.798699 (+ 33us) client_negotiation.cc:769] Sending connection context
0807 10:36:09.798803 (+ 104us) client_negotiation.cc:240] Negotiation successful
0807 10:36:09.799012 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1569,"mutex_wait_us":137,"thread_start_us":1238,"threads_started":1}
I20260807 10:36:09.801218 22512 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b4499a92209470594f53d4c36ed6c08" candidate_uuid: "9ea8e44a25c3465f8810bb827e067eef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aae757a800134f73922107969cdfbbe3" is_pre_election: true
I20260807 10:36:09.801219 22800 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b4499a92209470594f53d4c36ed6c08" candidate_uuid: "9ea8e44a25c3465f8810bb827e067eef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9ed98413633427788f39efc24c4251f" is_pre_election: true
I20260807 10:36:09.801847 22512 raft_consensus.cc:2454] T 8b4499a92209470594f53d4c36ed6c08 P aae757a800134f73922107969cdfbbe3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ea8e44a25c3465f8810bb827e067eef in term 0.
I20260807 10:36:09.801959 22800 raft_consensus.cc:2454] T 8b4499a92209470594f53d4c36ed6c08 P a9ed98413633427788f39efc24c4251f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ea8e44a25c3465f8810bb827e067eef in term 0.
I20260807 10:36:09.802772 22583 leader_election.cc:302] T 8b4499a92209470594f53d4c36ed6c08 P 9ea8e44a25c3465f8810bb827e067eef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 9ea8e44a25c3465f8810bb827e067eef, a9ed98413633427788f39efc24c4251f, aae757a800134f73922107969cdfbbe3; no voters:
I20260807 10:36:09.803443 22873 raft_consensus.cc:2781] T 8b4499a92209470594f53d4c36ed6c08 P 9ea8e44a25c3465f8810bb827e067eef [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 10:36:09.803707 22873 raft_consensus.cc:482] T 8b4499a92209470594f53d4c36ed6c08 P 9ea8e44a25c3465f8810bb827e067eef [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 10:36:09.803927 22873 raft_consensus.cc:3037] T 8b4499a92209470594f53d4c36ed6c08 P 9ea8e44a25c3465f8810bb827e067eef [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:36:09.807054 22873 raft_consensus.cc:504] T 8b4499a92209470594f53d4c36ed6c08 P 9ea8e44a25c3465f8810bb827e067eef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ea8e44a25c3465f8810bb827e067eef" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 33143 } } peers { permanent_uuid: "aae757a800134f73922107969cdfbbe3" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 41539 } } peers { permanent_uuid: "a9ed98413633427788f39efc24c4251f" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 42801 } }
I20260807 10:36:09.807972 22873 leader_election.cc:288] T 8b4499a92209470594f53d4c36ed6c08 P 9ea8e44a25c3465f8810bb827e067eef [CANDIDATE]: Term 1 election: Requested vote from peers aae757a800134f73922107969cdfbbe3 (127.20.171.65:41539), a9ed98413633427788f39efc24c4251f (127.20.171.67:42801)
I20260807 10:36:09.808465 22512 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b4499a92209470594f53d4c36ed6c08" candidate_uuid: "9ea8e44a25c3465f8810bb827e067eef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aae757a800134f73922107969cdfbbe3"
I20260807 10:36:09.808561 22800 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b4499a92209470594f53d4c36ed6c08" candidate_uuid: "9ea8e44a25c3465f8810bb827e067eef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9ed98413633427788f39efc24c4251f"
I20260807 10:36:09.808698 22512 raft_consensus.cc:3037] T 8b4499a92209470594f53d4c36ed6c08 P aae757a800134f73922107969cdfbbe3 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:36:09.808859 22800 raft_consensus.cc:3037] T 8b4499a92209470594f53d4c36ed6c08 P a9ed98413633427788f39efc24c4251f [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:36:09.812110 22512 raft_consensus.cc:2454] T 8b4499a92209470594f53d4c36ed6c08 P aae757a800134f73922107969cdfbbe3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ea8e44a25c3465f8810bb827e067eef in term 1.
I20260807 10:36:09.812120 22800 raft_consensus.cc:2454] T 8b4499a92209470594f53d4c36ed6c08 P a9ed98413633427788f39efc24c4251f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ea8e44a25c3465f8810bb827e067eef in term 1.
I20260807 10:36:09.812757 22584 leader_election.cc:302] T 8b4499a92209470594f53d4c36ed6c08 P 9ea8e44a25c3465f8810bb827e067eef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 9ea8e44a25c3465f8810bb827e067eef, a9ed98413633427788f39efc24c4251f, aae757a800134f73922107969cdfbbe3; no voters:
I20260807 10:36:09.813280 22873 raft_consensus.cc:2781] T 8b4499a92209470594f53d4c36ed6c08 P 9ea8e44a25c3465f8810bb827e067eef [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:36:09.814102 22873 raft_consensus.cc:686] T 8b4499a92209470594f53d4c36ed6c08 P 9ea8e44a25c3465f8810bb827e067eef [term 1 LEADER]: Becoming Leader. State: Replica: 9ea8e44a25c3465f8810bb827e067eef, State: Running, Role: LEADER
I20260807 10:36:09.814703 22873 consensus_queue.cc:237] T 8b4499a92209470594f53d4c36ed6c08 P 9ea8e44a25c3465f8810bb827e067eef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ea8e44a25c3465f8810bb827e067eef" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 33143 } } peers { permanent_uuid: "aae757a800134f73922107969cdfbbe3" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 41539 } } peers { permanent_uuid: "a9ed98413633427788f39efc24c4251f" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 42801 } }
I20260807 10:36:09.819835 22343 catalog_manager.cc:5495] T 8b4499a92209470594f53d4c36ed6c08 P 9ea8e44a25c3465f8810bb827e067eef reported cstate change: term changed from 0 to 1, leader changed from <none> to 9ea8e44a25c3465f8810bb827e067eef (127.20.171.66). New cstate: current_term: 1 leader_uuid: "9ea8e44a25c3465f8810bb827e067eef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ea8e44a25c3465f8810bb827e067eef" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 33143 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aae757a800134f73922107969cdfbbe3" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 41539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a9ed98413633427788f39efc24c4251f" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 42801 } health_report { overall_health: UNKNOWN } } }
I20260807 10:36:09.850212 22862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:09.843332 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55164 (local address 127.20.171.66:33143)
0807 10:36:09.843630 (+ 298us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:09.843638 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:09.843699 (+ 61us) server_negotiation.cc:407] Connection header received
0807 10:36:09.844061 (+ 362us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:09.844066 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:09.844165 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:09.844342 (+ 177us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 10:36:09.844700 (+ 358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:09.845651 (+ 951us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:09.847396 (+ 1745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:09.848017 (+ 621us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:09.848125 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:09.848869 (+ 744us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 10:36:09.849571 (+ 702us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 10:36:09.849713 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:09.849851 (+ 138us) server_negotiation.cc:299] Negotiation successful
0807 10:36:09.849938 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260807 10:36:09.862145 22800 raft_consensus.cc:1261] T 8b4499a92209470594f53d4c36ed6c08 P a9ed98413633427788f39efc24c4251f [term 1 FOLLOWER]: Refusing update from remote peer 9ea8e44a25c3465f8810bb827e067eef: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 10:36:09.862409 22512 raft_consensus.cc:1261] T 8b4499a92209470594f53d4c36ed6c08 P aae757a800134f73922107969cdfbbe3 [term 1 FOLLOWER]: Refusing update from remote peer 9ea8e44a25c3465f8810bb827e067eef: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 10:36:09.863525 22878 consensus_queue.cc:1035] T 8b4499a92209470594f53d4c36ed6c08 P 9ea8e44a25c3465f8810bb827e067eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9ed98413633427788f39efc24c4251f" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 42801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 10:36:09.864017 22873 consensus_queue.cc:1035] T 8b4499a92209470594f53d4c36ed6c08 P 9ea8e44a25c3465f8810bb827e067eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "aae757a800134f73922107969cdfbbe3" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 41539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 10:36:09.878108 22881 mvcc.cc:205] Tried to move back new op lower bound from 7315861380542656512 to 7315861380365484032. Current Snapshot: MvccSnapshot[applied={T|T < 7315861380542656512}]
I20260807 10:36:09.908543 22343 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:48256:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 10:36:09.908980 22343 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:48256:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 10:36:09.913488 22343 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 354a384c0db64d32b785d2cdb18f968b: Sending DeleteTablet for 3 replicas of tablet 8b4499a92209470594f53d4c36ed6c08
I20260807 10:36:09.914851 22631 tablet_service.cc:1514] Processing DeleteTablet for tablet 8b4499a92209470594f53d4c36ed6c08 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:36:09 UTC) from {username='kudu', principal='kudu/127.20.171.126@KRBTEST.COM'} at 127.0.0.1:55156
I20260807 10:36:09.915019 22487 tablet_service.cc:1514] Processing DeleteTablet for tablet 8b4499a92209470594f53d4c36ed6c08 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:36:09 UTC) from {username='kudu', principal='kudu/127.20.171.126@KRBTEST.COM'} at 127.0.0.1:52316
I20260807 10:36:09.915124 22775 tablet_service.cc:1514] Processing DeleteTablet for tablet 8b4499a92209470594f53d4c36ed6c08 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:36:09 UTC) from {username='kudu', principal='kudu/127.20.171.126@KRBTEST.COM'} at 127.0.0.1:35458
I20260807 10:36:09.919709 22343 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:48256:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 10:36:09.921725 22343 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 10:36:09.928644 22891 tablet_replica.cc:330] T 8b4499a92209470594f53d4c36ed6c08 P aae757a800134f73922107969cdfbbe3: stopping tablet replica
I20260807 10:36:09.929232 22893 tablet_replica.cc:330] T 8b4499a92209470594f53d4c36ed6c08 P a9ed98413633427788f39efc24c4251f: stopping tablet replica
I20260807 10:36:09.929529 22891 raft_consensus.cc:2229] T 8b4499a92209470594f53d4c36ed6c08 P aae757a800134f73922107969cdfbbe3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 10:36:09.929774 22893 raft_consensus.cc:2229] T 8b4499a92209470594f53d4c36ed6c08 P a9ed98413633427788f39efc24c4251f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 10:36:09.930126 22892 tablet_replica.cc:330] T 8b4499a92209470594f53d4c36ed6c08 P 9ea8e44a25c3465f8810bb827e067eef: stopping tablet replica
I20260807 10:36:09.930163 22891 raft_consensus.cc:2258] T 8b4499a92209470594f53d4c36ed6c08 P aae757a800134f73922107969cdfbbe3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:36:09.930613 22892 raft_consensus.cc:2229] T 8b4499a92209470594f53d4c36ed6c08 P 9ea8e44a25c3465f8810bb827e067eef [term 1 LEADER]: Raft consensus shutting down.
I20260807 10:36:09.931494 22892 raft_consensus.cc:2258] T 8b4499a92209470594f53d4c36ed6c08 P 9ea8e44a25c3465f8810bb827e067eef [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:36:09.932050 22486 tablet_service.cc:1467] Processing CreateTablet for tablet ff69b167fa4841578817d5904d9a4146 (DEFAULT_TABLE table=test-table [id=065f01075d4344beb7ee4cade1e411e8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:36:09.932196 22631 tablet_service.cc:1467] Processing CreateTablet for tablet ff69b167fa4841578817d5904d9a4146 (DEFAULT_TABLE table=test-table [id=065f01075d4344beb7ee4cade1e411e8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:36:09.932379 22893 raft_consensus.cc:2258] T 8b4499a92209470594f53d4c36ed6c08 P a9ed98413633427788f39efc24c4251f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:36:09.932546 22486 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ff69b167fa4841578817d5904d9a4146. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:36:09.932713 22631 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ff69b167fa4841578817d5904d9a4146. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:36:09.934949 22893 ts_tablet_manager.cc:1905] T 8b4499a92209470594f53d4c36ed6c08 P a9ed98413633427788f39efc24c4251f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 10:36:09.936554 22775 tablet_service.cc:1467] Processing CreateTablet for tablet ff69b167fa4841578817d5904d9a4146 (DEFAULT_TABLE table=test-table [id=065f01075d4344beb7ee4cade1e411e8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:36:09.938090 22892 ts_tablet_manager.cc:1905] T 8b4499a92209470594f53d4c36ed6c08 P 9ea8e44a25c3465f8810bb827e067eef: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 10:36:09.940068 22867 tablet_bootstrap.cc:492] T ff69b167fa4841578817d5904d9a4146 P 9ea8e44a25c3465f8810bb827e067eef: Bootstrap starting.
I20260807 10:36:09.942301 22867 tablet_bootstrap.cc:654] T ff69b167fa4841578817d5904d9a4146 P 9ea8e44a25c3465f8810bb827e067eef: Neither blocks nor log segments found. Creating new log.
I20260807 10:36:09.944739 22775 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ff69b167fa4841578817d5904d9a4146. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:36:09.946051 22892 ts_tablet_manager.cc:1918] T 8b4499a92209470594f53d4c36ed6c08 P 9ea8e44a25c3465f8810bb827e067eef: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 10:36:09.946395 22892 log.cc:1196] T 8b4499a92209470594f53d4c36ed6c08 P 9ea8e44a25c3465f8810bb827e067eef: Deleting WAL directory at /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786098956060137-21165-0/minicluster-data/ts-1/wal/wals/8b4499a92209470594f53d4c36ed6c08
I20260807 10:36:09.947153 22892 ts_tablet_manager.cc:1939] T 8b4499a92209470594f53d4c36ed6c08 P 9ea8e44a25c3465f8810bb827e067eef: Deleting consensus metadata
I20260807 10:36:09.949055 22324 catalog_manager.cc:4841] TS 9ea8e44a25c3465f8810bb827e067eef (127.20.171.66:33143): tablet 8b4499a92209470594f53d4c36ed6c08 (table test-table [id=d896bb493ec5496dacfcefd8057e5688]) successfully deleted
I20260807 10:36:09.950551 22868 tablet_bootstrap.cc:492] T ff69b167fa4841578817d5904d9a4146 P aae757a800134f73922107969cdfbbe3: Bootstrap starting.
I20260807 10:36:09.952934 22868 tablet_bootstrap.cc:654] T ff69b167fa4841578817d5904d9a4146 P aae757a800134f73922107969cdfbbe3: Neither blocks nor log segments found. Creating new log.
I20260807 10:36:09.953297 22893 ts_tablet_manager.cc:1918] T 8b4499a92209470594f53d4c36ed6c08 P a9ed98413633427788f39efc24c4251f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 10:36:09.953652 22893 log.cc:1196] T 8b4499a92209470594f53d4c36ed6c08 P a9ed98413633427788f39efc24c4251f: Deleting WAL directory at /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786098956060137-21165-0/minicluster-data/ts-2/wal/wals/8b4499a92209470594f53d4c36ed6c08
I20260807 10:36:09.954568 22893 ts_tablet_manager.cc:1939] T 8b4499a92209470594f53d4c36ed6c08 P a9ed98413633427788f39efc24c4251f: Deleting consensus metadata
I20260807 10:36:09.957151 22326 catalog_manager.cc:4841] TS a9ed98413633427788f39efc24c4251f (127.20.171.67:42801): tablet 8b4499a92209470594f53d4c36ed6c08 (table test-table [id=d896bb493ec5496dacfcefd8057e5688]) successfully deleted
I20260807 10:36:09.961560 22867 tablet_bootstrap.cc:492] T ff69b167fa4841578817d5904d9a4146 P 9ea8e44a25c3465f8810bb827e067eef: No bootstrap required, opened a new log
I20260807 10:36:09.961946 22867 ts_tablet_manager.cc:1397] T ff69b167fa4841578817d5904d9a4146 P 9ea8e44a25c3465f8810bb827e067eef: Time spent bootstrapping tablet: real 0.022s user 0.005s sys 0.000s
I20260807 10:36:09.963788 22867 raft_consensus.cc:348] T ff69b167fa4841578817d5904d9a4146 P 9ea8e44a25c3465f8810bb827e067eef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aae757a800134f73922107969cdfbbe3" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 41539 } } peers { permanent_uuid: "9ea8e44a25c3465f8810bb827e067eef" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 33143 } } peers { permanent_uuid: "a9ed98413633427788f39efc24c4251f" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 42801 } }
I20260807 10:36:09.964337 22867 raft_consensus.cc:374] T ff69b167fa4841578817d5904d9a4146 P 9ea8e44a25c3465f8810bb827e067eef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:36:09.964582 22891 ts_tablet_manager.cc:1905] T 8b4499a92209470594f53d4c36ed6c08 P aae757a800134f73922107969cdfbbe3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 10:36:09.964695 22867 raft_consensus.cc:729] T ff69b167fa4841578817d5904d9a4146 P 9ea8e44a25c3465f8810bb827e067eef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ea8e44a25c3465f8810bb827e067eef, State: Initialized, Role: FOLLOWER
I20260807 10:36:09.966794 22867 consensus_queue.cc:260] T ff69b167fa4841578817d5904d9a4146 P 9ea8e44a25c3465f8810bb827e067eef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aae757a800134f73922107969cdfbbe3" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 41539 } } peers { permanent_uuid: "9ea8e44a25c3465f8810bb827e067eef" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 33143 } } peers { permanent_uuid: "a9ed98413633427788f39efc24c4251f" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 42801 } }
I20260807 10:36:09.968330 22867 ts_tablet_manager.cc:1428] T ff69b167fa4841578817d5904d9a4146 P 9ea8e44a25c3465f8810bb827e067eef: Time spent starting tablet: real 0.006s user 0.000s sys 0.003s
I20260807 10:36:09.973264 22869 tablet_bootstrap.cc:492] T ff69b167fa4841578817d5904d9a4146 P a9ed98413633427788f39efc24c4251f: Bootstrap starting.
I20260807 10:36:09.975871 22868 tablet_bootstrap.cc:492] T ff69b167fa4841578817d5904d9a4146 P aae757a800134f73922107969cdfbbe3: No bootstrap required, opened a new log
I20260807 10:36:09.976163 22868 ts_tablet_manager.cc:1397] T ff69b167fa4841578817d5904d9a4146 P aae757a800134f73922107969cdfbbe3: Time spent bootstrapping tablet: real 0.026s user 0.012s sys 0.010s
I20260807 10:36:09.976212 22869 tablet_bootstrap.cc:654] T ff69b167fa4841578817d5904d9a4146 P a9ed98413633427788f39efc24c4251f: Neither blocks nor log segments found. Creating new log.
I20260807 10:36:09.977608 22868 raft_consensus.cc:348] T ff69b167fa4841578817d5904d9a4146 P aae757a800134f73922107969cdfbbe3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aae757a800134f73922107969cdfbbe3" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 41539 } } peers { permanent_uuid: "9ea8e44a25c3465f8810bb827e067eef" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 33143 } } peers { permanent_uuid: "a9ed98413633427788f39efc24c4251f" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 42801 } }
I20260807 10:36:09.978086 22868 raft_consensus.cc:374] T ff69b167fa4841578817d5904d9a4146 P aae757a800134f73922107969cdfbbe3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:36:09.978332 22868 raft_consensus.cc:729] T ff69b167fa4841578817d5904d9a4146 P aae757a800134f73922107969cdfbbe3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aae757a800134f73922107969cdfbbe3, State: Initialized, Role: FOLLOWER
I20260807 10:36:09.978916 22868 consensus_queue.cc:260] T ff69b167fa4841578817d5904d9a4146 P aae757a800134f73922107969cdfbbe3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aae757a800134f73922107969cdfbbe3" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 41539 } } peers { permanent_uuid: "9ea8e44a25c3465f8810bb827e067eef" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 33143 } } peers { permanent_uuid: "a9ed98413633427788f39efc24c4251f" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 42801 } }
I20260807 10:36:09.979250 22891 ts_tablet_manager.cc:1918] T 8b4499a92209470594f53d4c36ed6c08 P aae757a800134f73922107969cdfbbe3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 10:36:09.979600 22891 log.cc:1196] T 8b4499a92209470594f53d4c36ed6c08 P aae757a800134f73922107969cdfbbe3: Deleting WAL directory at /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786098956060137-21165-0/minicluster-data/ts-0/wal/wals/8b4499a92209470594f53d4c36ed6c08
I20260807 10:36:09.980670 22891 ts_tablet_manager.cc:1939] T 8b4499a92209470594f53d4c36ed6c08 P aae757a800134f73922107969cdfbbe3: Deleting consensus metadata
I20260807 10:36:09.982703 22868 ts_tablet_manager.cc:1428] T ff69b167fa4841578817d5904d9a4146 P aae757a800134f73922107969cdfbbe3: Time spent starting tablet: real 0.006s user 0.004s sys 0.000s
I20260807 10:36:09.982764 22327 catalog_manager.cc:4841] TS aae757a800134f73922107969cdfbbe3 (127.20.171.65:41539): tablet 8b4499a92209470594f53d4c36ed6c08 (table test-table [id=d896bb493ec5496dacfcefd8057e5688]) successfully deleted
I20260807 10:36:09.985008 22869 tablet_bootstrap.cc:492] T ff69b167fa4841578817d5904d9a4146 P a9ed98413633427788f39efc24c4251f: No bootstrap required, opened a new log
I20260807 10:36:09.985220 22869 ts_tablet_manager.cc:1397] T ff69b167fa4841578817d5904d9a4146 P a9ed98413633427788f39efc24c4251f: Time spent bootstrapping tablet: real 0.012s user 0.004s sys 0.002s
I20260807 10:36:09.986105 22869 raft_consensus.cc:348] T ff69b167fa4841578817d5904d9a4146 P a9ed98413633427788f39efc24c4251f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aae757a800134f73922107969cdfbbe3" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 41539 } } peers { permanent_uuid: "9ea8e44a25c3465f8810bb827e067eef" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 33143 } } peers { permanent_uuid: "a9ed98413633427788f39efc24c4251f" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 42801 } }
I20260807 10:36:09.986333 22869 raft_consensus.cc:374] T ff69b167fa4841578817d5904d9a4146 P a9ed98413633427788f39efc24c4251f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:36:09.986498 22869 raft_consensus.cc:729] T ff69b167fa4841578817d5904d9a4146 P a9ed98413633427788f39efc24c4251f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9ed98413633427788f39efc24c4251f, State: Initialized, Role: FOLLOWER
I20260807 10:36:09.986819 22869 consensus_queue.cc:260] T ff69b167fa4841578817d5904d9a4146 P a9ed98413633427788f39efc24c4251f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aae757a800134f73922107969cdfbbe3" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 41539 } } peers { permanent_uuid: "9ea8e44a25c3465f8810bb827e067eef" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 33143 } } peers { permanent_uuid: "a9ed98413633427788f39efc24c4251f" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 42801 } }
I20260807 10:36:09.987502 22869 ts_tablet_manager.cc:1428] T ff69b167fa4841578817d5904d9a4146 P a9ed98413633427788f39efc24c4251f: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260807 10:36:10.016304 22873 raft_consensus.cc:482] T ff69b167fa4841578817d5904d9a4146 P 9ea8e44a25c3465f8810bb827e067eef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 10:36:10.016592 22873 raft_consensus.cc:504] T ff69b167fa4841578817d5904d9a4146 P 9ea8e44a25c3465f8810bb827e067eef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aae757a800134f73922107969cdfbbe3" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 41539 } } peers { permanent_uuid: "9ea8e44a25c3465f8810bb827e067eef" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 33143 } } peers { permanent_uuid: "a9ed98413633427788f39efc24c4251f" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 42801 } }
I20260807 10:36:10.017535 22873 leader_election.cc:288] T ff69b167fa4841578817d5904d9a4146 P 9ea8e44a25c3465f8810bb827e067eef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aae757a800134f73922107969cdfbbe3 (127.20.171.65:41539), a9ed98413633427788f39efc24c4251f (127.20.171.67:42801)
I20260807 10:36:10.018111 22512 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff69b167fa4841578817d5904d9a4146" candidate_uuid: "9ea8e44a25c3465f8810bb827e067eef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aae757a800134f73922107969cdfbbe3" is_pre_election: true
I20260807 10:36:10.018427 22512 raft_consensus.cc:2454] T ff69b167fa4841578817d5904d9a4146 P aae757a800134f73922107969cdfbbe3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ea8e44a25c3465f8810bb827e067eef in term 0.
I20260807 10:36:10.018428 22800 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff69b167fa4841578817d5904d9a4146" candidate_uuid: "9ea8e44a25c3465f8810bb827e067eef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9ed98413633427788f39efc24c4251f" is_pre_election: true
I20260807 10:36:10.018716 22800 raft_consensus.cc:2454] T ff69b167fa4841578817d5904d9a4146 P a9ed98413633427788f39efc24c4251f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ea8e44a25c3465f8810bb827e067eef in term 0.
I20260807 10:36:10.018872 22584 leader_election.cc:302] T ff69b167fa4841578817d5904d9a4146 P 9ea8e44a25c3465f8810bb827e067eef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ea8e44a25c3465f8810bb827e067eef, aae757a800134f73922107969cdfbbe3; no voters:
I20260807 10:36:10.019470 22873 raft_consensus.cc:2781] T ff69b167fa4841578817d5904d9a4146 P 9ea8e44a25c3465f8810bb827e067eef [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 10:36:10.019675 22873 raft_consensus.cc:482] T ff69b167fa4841578817d5904d9a4146 P 9ea8e44a25c3465f8810bb827e067eef [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 10:36:10.019852 22873 raft_consensus.cc:3037] T ff69b167fa4841578817d5904d9a4146 P 9ea8e44a25c3465f8810bb827e067eef [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:36:10.024091 22873 raft_consensus.cc:504] T ff69b167fa4841578817d5904d9a4146 P 9ea8e44a25c3465f8810bb827e067eef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aae757a800134f73922107969cdfbbe3" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 41539 } } peers { permanent_uuid: "9ea8e44a25c3465f8810bb827e067eef" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 33143 } } peers { permanent_uuid: "a9ed98413633427788f39efc24c4251f" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 42801 } }
I20260807 10:36:10.025123 22873 leader_election.cc:288] T ff69b167fa4841578817d5904d9a4146 P 9ea8e44a25c3465f8810bb827e067eef [CANDIDATE]: Term 1 election: Requested vote from peers aae757a800134f73922107969cdfbbe3 (127.20.171.65:41539), a9ed98413633427788f39efc24c4251f (127.20.171.67:42801)
I20260807 10:36:10.025480 22512 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff69b167fa4841578817d5904d9a4146" candidate_uuid: "9ea8e44a25c3465f8810bb827e067eef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aae757a800134f73922107969cdfbbe3"
I20260807 10:36:10.025484 22800 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff69b167fa4841578817d5904d9a4146" candidate_uuid: "9ea8e44a25c3465f8810bb827e067eef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9ed98413633427788f39efc24c4251f"
I20260807 10:36:10.025802 22800 raft_consensus.cc:3037] T ff69b167fa4841578817d5904d9a4146 P a9ed98413633427788f39efc24c4251f [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:36:10.025802 22512 raft_consensus.cc:3037] T ff69b167fa4841578817d5904d9a4146 P aae757a800134f73922107969cdfbbe3 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:36:10.029651 22800 raft_consensus.cc:2454] T ff69b167fa4841578817d5904d9a4146 P a9ed98413633427788f39efc24c4251f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ea8e44a25c3465f8810bb827e067eef in term 1.
I20260807 10:36:10.029723 22512 raft_consensus.cc:2454] T ff69b167fa4841578817d5904d9a4146 P aae757a800134f73922107969cdfbbe3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ea8e44a25c3465f8810bb827e067eef in term 1.
I20260807 10:36:10.030104 22583 leader_election.cc:302] T ff69b167fa4841578817d5904d9a4146 P 9ea8e44a25c3465f8810bb827e067eef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ea8e44a25c3465f8810bb827e067eef, a9ed98413633427788f39efc24c4251f; no voters:
I20260807 10:36:10.030468 22873 raft_consensus.cc:2781] T ff69b167fa4841578817d5904d9a4146 P 9ea8e44a25c3465f8810bb827e067eef [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:36:10.030704 22873 raft_consensus.cc:686] T ff69b167fa4841578817d5904d9a4146 P 9ea8e44a25c3465f8810bb827e067eef [term 1 LEADER]: Becoming Leader. State: Replica: 9ea8e44a25c3465f8810bb827e067eef, State: Running, Role: LEADER
I20260807 10:36:10.031057 22873 consensus_queue.cc:237] T ff69b167fa4841578817d5904d9a4146 P 9ea8e44a25c3465f8810bb827e067eef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aae757a800134f73922107969cdfbbe3" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 41539 } } peers { permanent_uuid: "9ea8e44a25c3465f8810bb827e067eef" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 33143 } } peers { permanent_uuid: "a9ed98413633427788f39efc24c4251f" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 42801 } }
I20260807 10:36:10.033725 22343 catalog_manager.cc:5495] T ff69b167fa4841578817d5904d9a4146 P 9ea8e44a25c3465f8810bb827e067eef reported cstate change: term changed from 0 to 1, leader changed from <none> to 9ea8e44a25c3465f8810bb827e067eef (127.20.171.66). New cstate: current_term: 1 leader_uuid: "9ea8e44a25c3465f8810bb827e067eef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aae757a800134f73922107969cdfbbe3" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 41539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ea8e44a25c3465f8810bb827e067eef" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 33143 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a9ed98413633427788f39efc24c4251f" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 42801 } health_report { overall_health: UNKNOWN } } }
Aug 07 10:36:10 dist-test-slave-0b58 krb5kdc[22295](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786098967, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.126@KRBTEST.COM for kudu/127.20.171.126@KRBTEST.COM
I20260807 10:36:10.094281 22442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:10.075662 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48272 (local address 127.20.171.126:41367)
0807 10:36:10.075901 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:10.075909 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:10.077010 (+ 1101us) server_negotiation.cc:407] Connection header received
0807 10:36:10.077221 (+ 211us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:10.077224 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:10.077320 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:10.077429 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:36:10.079112 (+ 1683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:10.080089 (+ 977us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:10.081810 (+ 1721us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:10.082323 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:10.082450 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:10.086895 (+ 4445us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:36:10.086900 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:36:10.086903 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:36:10.086932 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:36:10.090281 (+ 3349us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:10.091624 (+ 1343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:10.091628 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:10.091630 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:10.091858 (+ 228us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:10.092359 (+ 501us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:10.092362 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:10.092364 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:10.092756 (+ 392us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:36:10.092859 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:10.093452 (+ 593us) server_negotiation.cc:299] Negotiation successful
0807 10:36:10.093926 (+ 474us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":277,"server-negotiator.queue_time_us":66}
I20260807 10:36:10.094708 22904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:10.075969 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:41367 (local address 127.0.0.1:48272)
0807 10:36:10.076903 (+ 934us) negotiation.cc:107] Waiting for socket to connect
0807 10:36:10.076922 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 10:36:10.077087 (+ 165us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:36:10.077462 (+ 375us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:36:10.077466 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:36:10.078403 (+ 937us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:36:10.078958 (+ 555us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:10.078970 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:10.080228 (+ 1258us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:10.080237 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:10.081677 (+ 1440us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:10.081690 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:10.082566 (+ 876us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:10.082572 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:10.082725 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:10.083436 (+ 711us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:36:10.083452 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:36:10.086681 (+ 3229us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:36:10.090410 (+ 3729us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:36:10.090423 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:36:10.090431 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:36:10.091479 (+ 1048us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:36:10.091981 (+ 502us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:36:10.091986 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:36:10.091989 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:36:10.092240 (+ 251us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:36:10.092878 (+ 638us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:36:10.092887 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:36:10.093113 (+ 226us) client_negotiation.cc:769] Sending connection context
0807 10:36:10.093314 (+ 201us) client_negotiation.cc:240] Negotiation successful
0807 10:36:10.093789 (+ 475us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":756,"thread_start_us":571,"threads_started":1}
I20260807 10:36:10.100452 22343 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.20.171.126@KRBTEST.COM'} at 127.0.0.1:48272:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260807 10:36:10.101796 22343 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 10:36:10.109287 22486 tablet_service.cc:1467] Processing CreateTablet for tablet eae43eca6d6f44b487171ba8e45703ed (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=f9abc459c11e4838a934c527e2372e90]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 10:36:10.109633 22775 tablet_service.cc:1467] Processing CreateTablet for tablet eae43eca6d6f44b487171ba8e45703ed (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=f9abc459c11e4838a934c527e2372e90]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 10:36:10.109944 22486 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eae43eca6d6f44b487171ba8e45703ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:36:10.110260 22775 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eae43eca6d6f44b487171ba8e45703ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:36:10.116914 22631 tablet_service.cc:1467] Processing CreateTablet for tablet eae43eca6d6f44b487171ba8e45703ed (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=f9abc459c11e4838a934c527e2372e90]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 10:36:10.117511 22631 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eae43eca6d6f44b487171ba8e45703ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:36:10.119369 22868 tablet_bootstrap.cc:492] T eae43eca6d6f44b487171ba8e45703ed P aae757a800134f73922107969cdfbbe3: Bootstrap starting.
I20260807 10:36:10.120507 22869 tablet_bootstrap.cc:492] T eae43eca6d6f44b487171ba8e45703ed P a9ed98413633427788f39efc24c4251f: Bootstrap starting.
I20260807 10:36:10.121903 22868 tablet_bootstrap.cc:654] T eae43eca6d6f44b487171ba8e45703ed P aae757a800134f73922107969cdfbbe3: Neither blocks nor log segments found. Creating new log.
I20260807 10:36:10.122329 22869 tablet_bootstrap.cc:654] T eae43eca6d6f44b487171ba8e45703ed P a9ed98413633427788f39efc24c4251f: Neither blocks nor log segments found. Creating new log.
I20260807 10:36:10.129010 22867 tablet_bootstrap.cc:492] T eae43eca6d6f44b487171ba8e45703ed P 9ea8e44a25c3465f8810bb827e067eef: Bootstrap starting.
I20260807 10:36:10.130095 22869 tablet_bootstrap.cc:492] T eae43eca6d6f44b487171ba8e45703ed P a9ed98413633427788f39efc24c4251f: No bootstrap required, opened a new log
I20260807 10:36:10.130345 22869 ts_tablet_manager.cc:1397] T eae43eca6d6f44b487171ba8e45703ed P a9ed98413633427788f39efc24c4251f: Time spent bootstrapping tablet: real 0.010s user 0.000s sys 0.009s
I20260807 10:36:10.131244 22869 raft_consensus.cc:348] T eae43eca6d6f44b487171ba8e45703ed P a9ed98413633427788f39efc24c4251f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aae757a800134f73922107969cdfbbe3" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 41539 } } peers { permanent_uuid: "9ea8e44a25c3465f8810bb827e067eef" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 33143 } } peers { permanent_uuid: "a9ed98413633427788f39efc24c4251f" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 42801 } }
I20260807 10:36:10.131597 22869 raft_consensus.cc:374] T eae43eca6d6f44b487171ba8e45703ed P a9ed98413633427788f39efc24c4251f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:36:10.131948 22867 tablet_bootstrap.cc:654] T eae43eca6d6f44b487171ba8e45703ed P 9ea8e44a25c3465f8810bb827e067eef: Neither blocks nor log segments found. Creating new log.
I20260807 10:36:10.132385 22869 raft_consensus.cc:729] T eae43eca6d6f44b487171ba8e45703ed P a9ed98413633427788f39efc24c4251f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9ed98413633427788f39efc24c4251f, State: Initialized, Role: FOLLOWER
I20260807 10:36:10.132738 22868 tablet_bootstrap.cc:492] T eae43eca6d6f44b487171ba8e45703ed P aae757a800134f73922107969cdfbbe3: No bootstrap required, opened a new log
I20260807 10:36:10.132853 22869 consensus_queue.cc:260] T eae43eca6d6f44b487171ba8e45703ed P a9ed98413633427788f39efc24c4251f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aae757a800134f73922107969cdfbbe3" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 41539 } } peers { permanent_uuid: "9ea8e44a25c3465f8810bb827e067eef" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 33143 } } peers { permanent_uuid: "a9ed98413633427788f39efc24c4251f" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 42801 } }
I20260807 10:36:10.133178 22868 ts_tablet_manager.cc:1397] T eae43eca6d6f44b487171ba8e45703ed P aae757a800134f73922107969cdfbbe3: Time spent bootstrapping tablet: real 0.014s user 0.008s sys 0.003s
I20260807 10:36:10.133605 22869 ts_tablet_manager.cc:1428] T eae43eca6d6f44b487171ba8e45703ed P a9ed98413633427788f39efc24c4251f: Time spent starting tablet: real 0.003s user 0.001s sys 0.002s
I20260807 10:36:10.133548 22875 tablet_replica.cc:439] T eae43eca6d6f44b487171ba8e45703ed P a9ed98413633427788f39efc24c4251f: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aae757a800134f73922107969cdfbbe3" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 41539 } } peers { permanent_uuid: "9ea8e44a25c3465f8810bb827e067eef" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 33143 } } peers { permanent_uuid: "a9ed98413633427788f39efc24c4251f" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 42801 } } }
I20260807 10:36:10.133970 22875 tablet_replica.cc:442] T eae43eca6d6f44b487171ba8e45703ed P a9ed98413633427788f39efc24c4251f: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 10:36:10.139907 22868 raft_consensus.cc:348] T eae43eca6d6f44b487171ba8e45703ed P aae757a800134f73922107969cdfbbe3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aae757a800134f73922107969cdfbbe3" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 41539 } } peers { permanent_uuid: "9ea8e44a25c3465f8810bb827e067eef" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 33143 } } peers { permanent_uuid: "a9ed98413633427788f39efc24c4251f" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 42801 } }
I20260807 10:36:10.140331 22868 raft_consensus.cc:374] T eae43eca6d6f44b487171ba8e45703ed P aae757a800134f73922107969cdfbbe3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:36:10.140512 22868 raft_consensus.cc:729] T eae43eca6d6f44b487171ba8e45703ed P aae757a800134f73922107969cdfbbe3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aae757a800134f73922107969cdfbbe3, State: Initialized, Role: FOLLOWER
I20260807 10:36:10.140908 22868 consensus_queue.cc:260] T eae43eca6d6f44b487171ba8e45703ed P aae757a800134f73922107969cdfbbe3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aae757a800134f73922107969cdfbbe3" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 41539 } } peers { permanent_uuid: "9ea8e44a25c3465f8810bb827e067eef" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 33143 } } peers { permanent_uuid: "a9ed98413633427788f39efc24c4251f" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 42801 } }
I20260807 10:36:10.142414 22868 ts_tablet_manager.cc:1428] T eae43eca6d6f44b487171ba8e45703ed P aae757a800134f73922107969cdfbbe3: Time spent starting tablet: real 0.006s user 0.001s sys 0.003s
I20260807 10:36:10.141896 22874 tablet_replica.cc:439] T eae43eca6d6f44b487171ba8e45703ed P aae757a800134f73922107969cdfbbe3: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aae757a800134f73922107969cdfbbe3" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 41539 } } peers { permanent_uuid: "9ea8e44a25c3465f8810bb827e067eef" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 33143 } } peers { permanent_uuid: "a9ed98413633427788f39efc24c4251f" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 42801 } } }
I20260807 10:36:10.143070 22874 tablet_replica.cc:442] T eae43eca6d6f44b487171ba8e45703ed P aae757a800134f73922107969cdfbbe3: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 10:36:10.149039 22867 tablet_bootstrap.cc:492] T eae43eca6d6f44b487171ba8e45703ed P 9ea8e44a25c3465f8810bb827e067eef: No bootstrap required, opened a new log
I20260807 10:36:10.149309 22867 ts_tablet_manager.cc:1397] T eae43eca6d6f44b487171ba8e45703ed P 9ea8e44a25c3465f8810bb827e067eef: Time spent bootstrapping tablet: real 0.020s user 0.000s sys 0.018s
I20260807 10:36:10.150368 22867 raft_consensus.cc:348] T eae43eca6d6f44b487171ba8e45703ed P 9ea8e44a25c3465f8810bb827e067eef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aae757a800134f73922107969cdfbbe3" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 41539 } } peers { permanent_uuid: "9ea8e44a25c3465f8810bb827e067eef" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 33143 } } peers { permanent_uuid: "a9ed98413633427788f39efc24c4251f" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 42801 } }
I20260807 10:36:10.150631 22867 raft_consensus.cc:374] T eae43eca6d6f44b487171ba8e45703ed P 9ea8e44a25c3465f8810bb827e067eef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:36:10.150756 22867 raft_consensus.cc:729] T eae43eca6d6f44b487171ba8e45703ed P 9ea8e44a25c3465f8810bb827e067eef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ea8e44a25c3465f8810bb827e067eef, State: Initialized, Role: FOLLOWER
I20260807 10:36:10.151130 22867 consensus_queue.cc:260] T eae43eca6d6f44b487171ba8e45703ed P 9ea8e44a25c3465f8810bb827e067eef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aae757a800134f73922107969cdfbbe3" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 41539 } } peers { permanent_uuid: "9ea8e44a25c3465f8810bb827e067eef" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 33143 } } peers { permanent_uuid: "a9ed98413633427788f39efc24c4251f" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 42801 } }
I20260807 10:36:10.151816 22867 ts_tablet_manager.cc:1428] T eae43eca6d6f44b487171ba8e45703ed P 9ea8e44a25c3465f8810bb827e067eef: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260807 10:36:10.151711 22873 tablet_replica.cc:439] T eae43eca6d6f44b487171ba8e45703ed P 9ea8e44a25c3465f8810bb827e067eef: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aae757a800134f73922107969cdfbbe3" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 41539 } } peers { permanent_uuid: "9ea8e44a25c3465f8810bb827e067eef" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 33143 } } peers { permanent_uuid: "a9ed98413633427788f39efc24c4251f" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 42801 } } }
I20260807 10:36:10.152047 22873 tablet_replica.cc:442] T eae43eca6d6f44b487171ba8e45703ed P 9ea8e44a25c3465f8810bb827e067eef: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 10:36:10.234299 22875 raft_consensus.cc:482] T eae43eca6d6f44b487171ba8e45703ed P a9ed98413633427788f39efc24c4251f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 10:36:10.234544 22875 raft_consensus.cc:504] T eae43eca6d6f44b487171ba8e45703ed P a9ed98413633427788f39efc24c4251f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aae757a800134f73922107969cdfbbe3" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 41539 } } peers { permanent_uuid: "9ea8e44a25c3465f8810bb827e067eef" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 33143 } } peers { permanent_uuid: "a9ed98413633427788f39efc24c4251f" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 42801 } }
I20260807 10:36:10.236487 22875 leader_election.cc:288] T eae43eca6d6f44b487171ba8e45703ed P a9ed98413633427788f39efc24c4251f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aae757a800134f73922107969cdfbbe3 (127.20.171.65:41539), 9ea8e44a25c3465f8810bb827e067eef (127.20.171.66:33143)
I20260807 10:36:10.247203 22863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:10.237554 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.67:49691 (local address 127.20.171.65:41539)
0807 10:36:10.237793 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:10.237798 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:10.238562 (+ 764us) server_negotiation.cc:407] Connection header received
0807 10:36:10.238725 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:10.238732 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:10.238899 (+ 167us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:10.239004 (+ 105us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:36:10.240453 (+ 1449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:10.241361 (+ 908us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:10.244664 (+ 3303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:10.246124 (+ 1460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:10.246331 (+ 207us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:10.246405 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:10.246660 (+ 255us) server_negotiation.cc:299] Negotiation successful
0807 10:36:10.246809 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260807 10:36:10.247288 22909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:10.237007 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.65:41539 (local address 127.20.171.67:49691)
0807 10:36:10.238447 (+ 1440us) negotiation.cc:107] Waiting for socket to connect
0807 10:36:10.238463 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 10:36:10.238572 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:36:10.239026 (+ 454us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:36:10.239030 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:36:10.239048 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:36:10.240160 (+ 1112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:10.240175 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:10.241496 (+ 1321us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:10.241502 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:10.244506 (+ 3004us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:10.244531 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:10.246342 (+ 1811us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:10.246347 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:10.246488 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:10.246514 (+ 26us) client_negotiation.cc:769] Sending connection context
0807 10:36:10.246620 (+ 106us) client_negotiation.cc:240] Negotiation successful
0807 10:36:10.246747 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1336,"mutex_wait_us":4,"thread_start_us":1133,"threads_started":1}
I20260807 10:36:10.248238 22512 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eae43eca6d6f44b487171ba8e45703ed" candidate_uuid: "a9ed98413633427788f39efc24c4251f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aae757a800134f73922107969cdfbbe3" is_pre_election: true
I20260807 10:36:10.248703 22512 raft_consensus.cc:2454] T eae43eca6d6f44b487171ba8e45703ed P aae757a800134f73922107969cdfbbe3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9ed98413633427788f39efc24c4251f in term 0.
I20260807 10:36:10.249436 22862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:10.237258 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.67:33383 (local address 127.20.171.66:33143)
0807 10:36:10.237535 (+ 277us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:10.237543 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:10.238034 (+ 491us) server_negotiation.cc:407] Connection header received
0807 10:36:10.238372 (+ 338us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:10.238378 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:10.238462 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:10.238535 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:36:10.239825 (+ 1290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:10.241630 (+ 1805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:10.246499 (+ 4869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:10.248042 (+ 1543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:10.248183 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:10.248246 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:10.248867 (+ 621us) server_negotiation.cc:299] Negotiation successful
0807 10:36:10.249005 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":107}
I20260807 10:36:10.249387 22727 leader_election.cc:302] T eae43eca6d6f44b487171ba8e45703ed P a9ed98413633427788f39efc24c4251f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9ed98413633427788f39efc24c4251f, aae757a800134f73922107969cdfbbe3; no voters:
I20260807 10:36:10.249990 22875 raft_consensus.cc:2781] T eae43eca6d6f44b487171ba8e45703ed P a9ed98413633427788f39efc24c4251f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 10:36:10.250185 22875 raft_consensus.cc:482] T eae43eca6d6f44b487171ba8e45703ed P a9ed98413633427788f39efc24c4251f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 10:36:10.250358 22875 raft_consensus.cc:3037] T eae43eca6d6f44b487171ba8e45703ed P a9ed98413633427788f39efc24c4251f [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:36:10.250406 22908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:10.236667 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.66:33143 (local address 127.20.171.67:33383)
0807 10:36:10.237910 (+ 1243us) negotiation.cc:107] Waiting for socket to connect
0807 10:36:10.237932 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0807 10:36:10.238168 (+ 236us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:36:10.238848 (+ 680us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:36:10.238851 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:36:10.238885 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:36:10.239559 (+ 674us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:10.239573 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:10.241844 (+ 2271us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:10.241849 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:10.244525 (+ 2676us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:10.244532 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:10.248408 (+ 3876us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:10.248416 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:10.248638 (+ 222us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:10.248697 (+ 59us) client_negotiation.cc:769] Sending connection context
0807 10:36:10.249685 (+ 988us) client_negotiation.cc:240] Negotiation successful
0807 10:36:10.249836 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":965,"mutex_wait_us":1,"thread_start_us":899,"threads_started":1}
I20260807 10:36:10.253948 22875 raft_consensus.cc:504] T eae43eca6d6f44b487171ba8e45703ed P a9ed98413633427788f39efc24c4251f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aae757a800134f73922107969cdfbbe3" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 41539 } } peers { permanent_uuid: "9ea8e44a25c3465f8810bb827e067eef" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 33143 } } peers { permanent_uuid: "a9ed98413633427788f39efc24c4251f" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 42801 } }
I20260807 10:36:10.254622 22875 leader_election.cc:288] T eae43eca6d6f44b487171ba8e45703ed P a9ed98413633427788f39efc24c4251f [CANDIDATE]: Term 1 election: Requested vote from peers aae757a800134f73922107969cdfbbe3 (127.20.171.65:41539), 9ea8e44a25c3465f8810bb827e067eef (127.20.171.66:33143)
I20260807 10:36:10.254540 22656 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eae43eca6d6f44b487171ba8e45703ed" candidate_uuid: "a9ed98413633427788f39efc24c4251f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ea8e44a25c3465f8810bb827e067eef" is_pre_election: true
I20260807 10:36:10.255210 22656 raft_consensus.cc:2454] T eae43eca6d6f44b487171ba8e45703ed P 9ea8e44a25c3465f8810bb827e067eef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9ed98413633427788f39efc24c4251f in term 0.
I20260807 10:36:10.255214 22655 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eae43eca6d6f44b487171ba8e45703ed" candidate_uuid: "a9ed98413633427788f39efc24c4251f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ea8e44a25c3465f8810bb827e067eef"
I20260807 10:36:10.255690 22512 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eae43eca6d6f44b487171ba8e45703ed" candidate_uuid: "a9ed98413633427788f39efc24c4251f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aae757a800134f73922107969cdfbbe3"
I20260807 10:36:10.255716 22655 raft_consensus.cc:3037] T eae43eca6d6f44b487171ba8e45703ed P 9ea8e44a25c3465f8810bb827e067eef [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:36:10.256043 22512 raft_consensus.cc:3037] T eae43eca6d6f44b487171ba8e45703ed P aae757a800134f73922107969cdfbbe3 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:36:10.258713 22512 raft_consensus.cc:2454] T eae43eca6d6f44b487171ba8e45703ed P aae757a800134f73922107969cdfbbe3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9ed98413633427788f39efc24c4251f in term 1.
I20260807 10:36:10.259092 22727 leader_election.cc:302] T eae43eca6d6f44b487171ba8e45703ed P a9ed98413633427788f39efc24c4251f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9ed98413633427788f39efc24c4251f, aae757a800134f73922107969cdfbbe3; no voters:
I20260807 10:36:10.259374 22875 raft_consensus.cc:2781] T eae43eca6d6f44b487171ba8e45703ed P a9ed98413633427788f39efc24c4251f [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:36:10.259994 22875 raft_consensus.cc:686] T eae43eca6d6f44b487171ba8e45703ed P a9ed98413633427788f39efc24c4251f [term 1 LEADER]: Becoming Leader. State: Replica: a9ed98413633427788f39efc24c4251f, State: Running, Role: LEADER
I20260807 10:36:10.260542 22875 consensus_queue.cc:237] T eae43eca6d6f44b487171ba8e45703ed P a9ed98413633427788f39efc24c4251f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aae757a800134f73922107969cdfbbe3" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 41539 } } peers { permanent_uuid: "9ea8e44a25c3465f8810bb827e067eef" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 33143 } } peers { permanent_uuid: "a9ed98413633427788f39efc24c4251f" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 42801 } }
I20260807 10:36:10.261065 22655 raft_consensus.cc:2454] T eae43eca6d6f44b487171ba8e45703ed P 9ea8e44a25c3465f8810bb827e067eef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9ed98413633427788f39efc24c4251f in term 1.
I20260807 10:36:10.263509 22910 tablet_replica.cc:439] T eae43eca6d6f44b487171ba8e45703ed P a9ed98413633427788f39efc24c4251f: TxnStatusTablet state changed. Reason: New leader a9ed98413633427788f39efc24c4251f. Latest consensus state: current_term: 1 leader_uuid: "a9ed98413633427788f39efc24c4251f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aae757a800134f73922107969cdfbbe3" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 41539 } } peers { permanent_uuid: "9ea8e44a25c3465f8810bb827e067eef" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 33143 } } peers { permanent_uuid: "a9ed98413633427788f39efc24c4251f" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 42801 } } }
I20260807 10:36:10.264246 22910 tablet_replica.cc:442] T eae43eca6d6f44b487171ba8e45703ed P a9ed98413633427788f39efc24c4251f: This TxnStatusTablet replica's current role is: LEADER
I20260807 10:36:10.265134 22342 catalog_manager.cc:5495] T eae43eca6d6f44b487171ba8e45703ed P a9ed98413633427788f39efc24c4251f reported cstate change: term changed from 0 to 1, leader changed from <none> to a9ed98413633427788f39efc24c4251f (127.20.171.67). New cstate: current_term: 1 leader_uuid: "a9ed98413633427788f39efc24c4251f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aae757a800134f73922107969cdfbbe3" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 41539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ea8e44a25c3465f8810bb827e067eef" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 33143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a9ed98413633427788f39efc24c4251f" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 42801 } health_report { overall_health: HEALTHY } } }
I20260807 10:36:10.265416 22912 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260807 10:36:10.265829 22912 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260807 10:36:10.300514 22865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:10.291408 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35462 (local address 127.20.171.67:42801)
0807 10:36:10.291809 (+ 401us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:10.291818 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:10.292587 (+ 769us) server_negotiation.cc:407] Connection header received
0807 10:36:10.293022 (+ 435us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:10.293045 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:10.293269 (+ 224us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:10.293582 (+ 313us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 10:36:10.294829 (+ 1247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:10.296118 (+ 1289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:10.297608 (+ 1490us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:10.298174 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:10.298316 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:10.298825 (+ 509us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 10:36:10.299279 (+ 454us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 10:36:10.299591 (+ 312us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:10.299649 (+ 58us) server_negotiation.cc:299] Negotiation successful
0807 10:36:10.299739 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":117}
I20260807 10:36:10.300515 22904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:10.292139 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.67:42801 (local address 127.0.0.1:35462)
0807 10:36:10.292489 (+ 350us) negotiation.cc:107] Waiting for socket to connect
0807 10:36:10.292511 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0807 10:36:10.292734 (+ 223us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:36:10.293686 (+ 952us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:36:10.293694 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:36:10.293709 (+ 15us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 10:36:10.294468 (+ 759us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:10.294501 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:10.296251 (+ 1750us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:10.296280 (+ 29us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:10.297469 (+ 1189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:10.297482 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:10.298341 (+ 859us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:10.298347 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:10.298538 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:10.298593 (+ 55us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 10:36:10.299474 (+ 881us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 10:36:10.299500 (+ 26us) client_negotiation.cc:769] Sending connection context
0807 10:36:10.299591 (+ 91us) client_negotiation.cc:240] Negotiation successful
0807 10:36:10.299754 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":89}
I20260807 10:36:10.305655 22512 raft_consensus.cc:1261] T eae43eca6d6f44b487171ba8e45703ed P aae757a800134f73922107969cdfbbe3 [term 1 FOLLOWER]: Refusing update from remote peer a9ed98413633427788f39efc24c4251f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 10:36:10.305735 22655 raft_consensus.cc:1261] T eae43eca6d6f44b487171ba8e45703ed P 9ea8e44a25c3465f8810bb827e067eef [term 1 FOLLOWER]: Refusing update from remote peer a9ed98413633427788f39efc24c4251f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 10:36:10.306411 22875 consensus_queue.cc:1035] T eae43eca6d6f44b487171ba8e45703ed P a9ed98413633427788f39efc24c4251f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aae757a800134f73922107969cdfbbe3" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 41539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 10:36:10.307174 22875 consensus_queue.cc:1035] T eae43eca6d6f44b487171ba8e45703ed P a9ed98413633427788f39efc24c4251f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ea8e44a25c3465f8810bb827e067eef" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 33143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 10:36:10.319226 22874 tablet_replica.cc:439] T eae43eca6d6f44b487171ba8e45703ed P aae757a800134f73922107969cdfbbe3: TxnStatusTablet state changed. Reason: New leader a9ed98413633427788f39efc24c4251f. Latest consensus state: current_term: 1 leader_uuid: "a9ed98413633427788f39efc24c4251f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aae757a800134f73922107969cdfbbe3" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 41539 } } peers { permanent_uuid: "9ea8e44a25c3465f8810bb827e067eef" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 33143 } } peers { permanent_uuid: "a9ed98413633427788f39efc24c4251f" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 42801 } } }
I20260807 10:36:10.319916 22874 tablet_replica.cc:442] T eae43eca6d6f44b487171ba8e45703ed P aae757a800134f73922107969cdfbbe3: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 10:36:10.321427 22873 tablet_replica.cc:439] T eae43eca6d6f44b487171ba8e45703ed P 9ea8e44a25c3465f8810bb827e067eef: TxnStatusTablet state changed. Reason: New leader a9ed98413633427788f39efc24c4251f. Latest consensus state: current_term: 1 leader_uuid: "a9ed98413633427788f39efc24c4251f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aae757a800134f73922107969cdfbbe3" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 41539 } } peers { permanent_uuid: "9ea8e44a25c3465f8810bb827e067eef" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 33143 } } peers { permanent_uuid: "a9ed98413633427788f39efc24c4251f" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 42801 } } }
I20260807 10:36:10.323055 22873 tablet_replica.cc:442] T eae43eca6d6f44b487171ba8e45703ed P 9ea8e44a25c3465f8810bb827e067eef: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 10:36:10.324410 22883 mvcc.cc:205] Tried to move back new op lower bound from 7315861382362595328 to 7315861382192246784. Current Snapshot: MvccSnapshot[applied={T|T < 7315861382362595328}]
I20260807 10:36:10.324117 22875 tablet_replica.cc:439] T eae43eca6d6f44b487171ba8e45703ed P a9ed98413633427788f39efc24c4251f: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "a9ed98413633427788f39efc24c4251f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aae757a800134f73922107969cdfbbe3" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 41539 } } peers { permanent_uuid: "9ea8e44a25c3465f8810bb827e067eef" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 33143 } } peers { permanent_uuid: "a9ed98413633427788f39efc24c4251f" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 42801 } } }
I20260807 10:36:10.326615 22875 tablet_replica.cc:442] T eae43eca6d6f44b487171ba8e45703ed P a9ed98413633427788f39efc24c4251f: This TxnStatusTablet replica's current role is: LEADER
I20260807 10:36:10.327885 22875 tablet_replica.cc:439] T eae43eca6d6f44b487171ba8e45703ed P a9ed98413633427788f39efc24c4251f: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "a9ed98413633427788f39efc24c4251f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aae757a800134f73922107969cdfbbe3" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 41539 } } peers { permanent_uuid: "9ea8e44a25c3465f8810bb827e067eef" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 33143 } } peers { permanent_uuid: "a9ed98413633427788f39efc24c4251f" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 42801 } } }
I20260807 10:36:10.328272 22875 tablet_replica.cc:442] T eae43eca6d6f44b487171ba8e45703ed P a9ed98413633427788f39efc24c4251f: This TxnStatusTablet replica's current role is: LEADER
I20260807 10:36:10.332968 22873 tablet_replica.cc:439] T eae43eca6d6f44b487171ba8e45703ed P 9ea8e44a25c3465f8810bb827e067eef: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "a9ed98413633427788f39efc24c4251f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aae757a800134f73922107969cdfbbe3" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 41539 } } peers { permanent_uuid: "9ea8e44a25c3465f8810bb827e067eef" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 33143 } } peers { permanent_uuid: "a9ed98413633427788f39efc24c4251f" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 42801 } } }
I20260807 10:36:10.333431 22873 tablet_replica.cc:442] T eae43eca6d6f44b487171ba8e45703ed P 9ea8e44a25c3465f8810bb827e067eef: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 10:36:10.339522 22874 tablet_replica.cc:439] T eae43eca6d6f44b487171ba8e45703ed P aae757a800134f73922107969cdfbbe3: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "a9ed98413633427788f39efc24c4251f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aae757a800134f73922107969cdfbbe3" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 41539 } } peers { permanent_uuid: "9ea8e44a25c3465f8810bb827e067eef" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 33143 } } peers { permanent_uuid: "a9ed98413633427788f39efc24c4251f" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 42801 } } }
I20260807 10:36:10.339911 22874 tablet_replica.cc:442] T eae43eca6d6f44b487171ba8e45703ed P aae757a800134f73922107969cdfbbe3: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 10:36:10.359982 22865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:10.351791 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.66:44521 (local address 127.20.171.67:42801)
0807 10:36:10.352050 (+ 259us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:10.352059 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:10.353310 (+ 1251us) server_negotiation.cc:407] Connection header received
0807 10:36:10.353636 (+ 326us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:10.353641 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:10.353712 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:10.353797 (+ 85us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 10:36:10.354515 (+ 718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:10.355454 (+ 939us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:10.357744 (+ 2290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:10.358376 (+ 632us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:10.358527 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:10.359077 (+ 550us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 10:36:10.359179 (+ 102us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 10:36:10.359271 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:10.359417 (+ 146us) server_negotiation.cc:299] Negotiation successful
0807 10:36:10.359492 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260807 10:36:10.360528 22920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:10.351264 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.67:42801 (local address 127.20.171.66:44521)
0807 10:36:10.353203 (+ 1939us) negotiation.cc:107] Waiting for socket to connect
0807 10:36:10.353227 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0807 10:36:10.353446 (+ 219us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:36:10.353811 (+ 365us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:36:10.353815 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:36:10.353826 (+ 11us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 10:36:10.354361 (+ 535us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:10.354370 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:10.355587 (+ 1217us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:10.355592 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:10.357610 (+ 2018us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:10.357623 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:10.358666 (+ 1043us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:10.358673 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:10.358816 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:10.358867 (+ 51us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 10:36:10.359272 (+ 405us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 10:36:10.359285 (+ 13us) client_negotiation.cc:769] Sending connection context
0807 10:36:10.359395 (+ 110us) client_negotiation.cc:240] Negotiation successful
0807 10:36:10.359522 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1794,"thread_start_us":1568,"threads_started":1}
I20260807 10:36:10.371528 22512 raft_consensus.cc:1261] T ff69b167fa4841578817d5904d9a4146 P aae757a800134f73922107969cdfbbe3 [term 1 FOLLOWER]: Refusing update from remote peer 9ea8e44a25c3465f8810bb827e067eef: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 10:36:10.371577 22800 raft_consensus.cc:1261] T ff69b167fa4841578817d5904d9a4146 P a9ed98413633427788f39efc24c4251f [term 1 FOLLOWER]: Refusing update from remote peer 9ea8e44a25c3465f8810bb827e067eef: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 10:36:10.372308 22888 consensus_queue.cc:1035] T ff69b167fa4841578817d5904d9a4146 P 9ea8e44a25c3465f8810bb827e067eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9ed98413633427788f39efc24c4251f" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 42801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 10:36:10.373569 22873 consensus_queue.cc:1035] T ff69b167fa4841578817d5904d9a4146 P 9ea8e44a25c3465f8810bb827e067eef [LEADER]: Connected to new peer: Peer: permanent_uuid: "aae757a800134f73922107969cdfbbe3" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 41539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 10:36:10.452869 22862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:10.443379 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.67:48239 (local address 127.20.171.66:33143)
0807 10:36:10.443610 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:10.443617 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:10.444837 (+ 1220us) server_negotiation.cc:407] Connection header received
0807 10:36:10.445063 (+ 226us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:10.445068 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:10.445140 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:10.445222 (+ 82us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 10:36:10.446942 (+ 1720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:10.448147 (+ 1205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:10.450675 (+ 2528us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:10.451265 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:10.451394 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:10.451975 (+ 581us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 10:36:10.452113 (+ 138us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 10:36:10.452207 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:10.452381 (+ 174us) server_negotiation.cc:299] Negotiation successful
0807 10:36:10.452465 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260807 10:36:10.453862 22926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:10.443322 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.66:33143 (local address 127.20.171.67:48239)
0807 10:36:10.444739 (+ 1417us) negotiation.cc:107] Waiting for socket to connect
0807 10:36:10.444754 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 10:36:10.444920 (+ 166us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:36:10.445248 (+ 328us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:36:10.445252 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:36:10.445263 (+ 11us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 10:36:10.446696 (+ 1433us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:10.446717 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:10.448398 (+ 1681us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:10.448403 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:10.450532 (+ 2129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:10.450545 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:10.451548 (+ 1003us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:10.451554 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:10.451719 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:10.451778 (+ 59us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 10:36:10.452211 (+ 433us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 10:36:10.452222 (+ 11us) client_negotiation.cc:769] Sending connection context
0807 10:36:10.453058 (+ 836us) client_negotiation.cc:240] Negotiation successful
0807 10:36:10.453272 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1190,"thread_start_us":986,"threads_started":1}
I20260807 10:36:10.495560 22342 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:48256:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 10:36:10.495842 22342 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:48256:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 10:36:10.499408 22342 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 354a384c0db64d32b785d2cdb18f968b: Sending DeleteTablet for 3 replicas of tablet ff69b167fa4841578817d5904d9a4146
I20260807 10:36:10.500774 22486 tablet_service.cc:1514] Processing DeleteTablet for tablet ff69b167fa4841578817d5904d9a4146 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:36:10 UTC) from {username='kudu', principal='kudu/127.20.171.126@KRBTEST.COM'} at 127.0.0.1:52316
I20260807 10:36:10.501293 22631 tablet_service.cc:1514] Processing DeleteTablet for tablet ff69b167fa4841578817d5904d9a4146 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:36:10 UTC) from {username='kudu', principal='kudu/127.20.171.126@KRBTEST.COM'} at 127.0.0.1:55156
I20260807 10:36:10.501782 22775 tablet_service.cc:1514] Processing DeleteTablet for tablet ff69b167fa4841578817d5904d9a4146 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:36:10 UTC) from {username='kudu', principal='kudu/127.20.171.126@KRBTEST.COM'} at 127.0.0.1:35458
I20260807 10:36:10.521299 22928 tablet_replica.cc:330] T ff69b167fa4841578817d5904d9a4146 P aae757a800134f73922107969cdfbbe3: stopping tablet replica
I20260807 10:36:10.521756 22928 raft_consensus.cc:2229] T ff69b167fa4841578817d5904d9a4146 P aae757a800134f73922107969cdfbbe3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 10:36:10.522197 22928 raft_consensus.cc:2258] T ff69b167fa4841578817d5904d9a4146 P aae757a800134f73922107969cdfbbe3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:36:10.523828 22928 ts_tablet_manager.cc:1905] T ff69b167fa4841578817d5904d9a4146 P aae757a800134f73922107969cdfbbe3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 10:36:10.539897 22930 tablet_replica.cc:330] T ff69b167fa4841578817d5904d9a4146 P a9ed98413633427788f39efc24c4251f: stopping tablet replica
I20260807 10:36:10.540172 22930 raft_consensus.cc:2229] T ff69b167fa4841578817d5904d9a4146 P a9ed98413633427788f39efc24c4251f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 10:36:10.540768 22930 raft_consensus.cc:2258] T ff69b167fa4841578817d5904d9a4146 P a9ed98413633427788f39efc24c4251f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:36:10.542121 22930 ts_tablet_manager.cc:1905] T ff69b167fa4841578817d5904d9a4146 P a9ed98413633427788f39efc24c4251f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 10:36:10.545635 22929 tablet_replica.cc:330] T ff69b167fa4841578817d5904d9a4146 P 9ea8e44a25c3465f8810bb827e067eef: stopping tablet replica
I20260807 10:36:10.545902 22929 raft_consensus.cc:2229] T ff69b167fa4841578817d5904d9a4146 P 9ea8e44a25c3465f8810bb827e067eef [term 1 LEADER]: Raft consensus shutting down.
I20260807 10:36:10.546422 22929 raft_consensus.cc:2258] T ff69b167fa4841578817d5904d9a4146 P 9ea8e44a25c3465f8810bb827e067eef [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:36:10.547559 22928 ts_tablet_manager.cc:1918] T ff69b167fa4841578817d5904d9a4146 P aae757a800134f73922107969cdfbbe3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 10:36:10.547740 22928 log.cc:1196] T ff69b167fa4841578817d5904d9a4146 P aae757a800134f73922107969cdfbbe3: Deleting WAL directory at /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786098956060137-21165-0/minicluster-data/ts-0/wal/wals/ff69b167fa4841578817d5904d9a4146
I20260807 10:36:10.548220 22928 ts_tablet_manager.cc:1939] T ff69b167fa4841578817d5904d9a4146 P aae757a800134f73922107969cdfbbe3: Deleting consensus metadata
I20260807 10:36:10.549556 22327 catalog_manager.cc:4841] TS aae757a800134f73922107969cdfbbe3 (127.20.171.65:41539): tablet ff69b167fa4841578817d5904d9a4146 (table test-table [id=065f01075d4344beb7ee4cade1e411e8]) successfully deleted
I20260807 10:36:10.553719 22930 ts_tablet_manager.cc:1918] T ff69b167fa4841578817d5904d9a4146 P a9ed98413633427788f39efc24c4251f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 10:36:10.553956 22930 log.cc:1196] T ff69b167fa4841578817d5904d9a4146 P a9ed98413633427788f39efc24c4251f: Deleting WAL directory at /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786098956060137-21165-0/minicluster-data/ts-2/wal/wals/ff69b167fa4841578817d5904d9a4146
I20260807 10:36:10.554512 22929 ts_tablet_manager.cc:1905] T ff69b167fa4841578817d5904d9a4146 P 9ea8e44a25c3465f8810bb827e067eef: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 10:36:10.554780 22930 ts_tablet_manager.cc:1939] T ff69b167fa4841578817d5904d9a4146 P a9ed98413633427788f39efc24c4251f: Deleting consensus metadata
I20260807 10:36:10.555907 22326 catalog_manager.cc:4841] TS a9ed98413633427788f39efc24c4251f (127.20.171.67:42801): tablet ff69b167fa4841578817d5904d9a4146 (table test-table [id=065f01075d4344beb7ee4cade1e411e8]) successfully deleted
Aug 07 10:36:10 dist-test-slave-0b58 krb5kdc[22295](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786098969, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.20.171.65@KRBTEST.COM
I20260807 10:36:10.565060 22929 ts_tablet_manager.cc:1918] T ff69b167fa4841578817d5904d9a4146 P 9ea8e44a25c3465f8810bb827e067eef: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 10:36:10.565320 22929 log.cc:1196] T ff69b167fa4841578817d5904d9a4146 P 9ea8e44a25c3465f8810bb827e067eef: Deleting WAL directory at /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786098956060137-21165-0/minicluster-data/ts-1/wal/wals/ff69b167fa4841578817d5904d9a4146
I20260807 10:36:10.566164 22929 ts_tablet_manager.cc:1939] T ff69b167fa4841578817d5904d9a4146 P 9ea8e44a25c3465f8810bb827e067eef: Deleting consensus metadata
I20260807 10:36:10.567553 22324 catalog_manager.cc:4841] TS 9ea8e44a25c3465f8810bb827e067eef (127.20.171.66:33143): tablet ff69b167fa4841578817d5904d9a4146 (table test-table [id=065f01075d4344beb7ee4cade1e411e8]) successfully deleted
I20260807 10:36:10.574303 22863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:10.544681 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52318 (local address 127.20.171.65:41539)
0807 10:36:10.544863 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:10.544868 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:10.550727 (+ 5859us) server_negotiation.cc:407] Connection header received
0807 10:36:10.550940 (+ 213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:10.550946 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:10.551024 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:10.551176 (+ 152us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:36:10.554407 (+ 3231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:10.555633 (+ 1226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:10.557451 (+ 1818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:10.557994 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:10.558136 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:10.564066 (+ 5930us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:36:10.564083 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:36:10.564102 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:36:10.564161 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:36:10.568846 (+ 4685us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:10.570060 (+ 1214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:10.570070 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:10.570074 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:10.570372 (+ 298us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:10.570911 (+ 539us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:10.570917 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:10.570920 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:10.571463 (+ 543us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:36:10.571859 (+ 396us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:10.573650 (+ 1791us) server_negotiation.cc:299] Negotiation successful
0807 10:36:10.573869 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
W20260807 10:36:10.575268 22554 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:52318
I20260807 10:36:10.612735 22442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:10.584753 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52908 (local address 127.20.171.126:41367)
0807 10:36:10.585020 (+ 267us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:10.585026 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:10.591646 (+ 6620us) server_negotiation.cc:407] Connection header received
0807 10:36:10.592597 (+ 951us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:10.592604 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:10.592705 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:10.592800 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:36:10.595842 (+ 3042us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:10.597157 (+ 1315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:10.599409 (+ 2252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:10.600319 (+ 910us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:10.600428 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:10.604544 (+ 4116us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:36:10.604552 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:36:10.604557 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:36:10.604596 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:36:10.609262 (+ 4666us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:10.610107 (+ 845us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:10.610114 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:10.610117 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:10.610301 (+ 184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:10.610720 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:10.610726 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:10.610731 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:10.611161 (+ 430us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:36:10.611544 (+ 383us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:10.611788 (+ 244us) server_negotiation.cc:299] Negotiation successful
0807 10:36:10.612005 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":95}
W20260807 10:36:10.613713 22342 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:52908
I20260807 10:36:10.616122 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 22416
I20260807 10:36:10.644132 22863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:10.617499 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41012 (local address 127.20.171.65:41539)
0807 10:36:10.617756 (+ 257us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:10.617761 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:10.623031 (+ 5270us) server_negotiation.cc:407] Connection header received
0807 10:36:10.623216 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:10.623221 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:10.623302 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:10.623424 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:36:10.624931 (+ 1507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:10.626509 (+ 1578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:10.628962 (+ 2453us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:10.629987 (+ 1025us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:10.630145 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:10.634910 (+ 4765us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:36:10.634917 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:36:10.634923 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:36:10.634963 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:36:10.640214 (+ 5251us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:10.641330 (+ 1116us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:10.641337 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:10.641340 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:10.641515 (+ 175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:10.642020 (+ 505us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:10.642025 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:10.642028 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:10.642426 (+ 398us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:36:10.642801 (+ 375us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:10.643417 (+ 616us) server_negotiation.cc:299] Negotiation successful
0807 10:36:10.643643 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
W20260807 10:36:10.646019 22554 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:41012
W20260807 10:36:10.646864 21165 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 22416: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260807 10:36:10.647125 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 22416
I20260807 10:36:10.678233 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 22565
Aug 07 10:36:10 dist-test-slave-0b58 krb5kdc[22295](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786098969, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.20.171.66@KRBTEST.COM
I20260807 10:36:10.699110 22862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:10.679051 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59748 (local address 127.20.171.66:33143)
0807 10:36:10.679224 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:10.679230 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:10.679329 (+ 99us) server_negotiation.cc:407] Connection header received
0807 10:36:10.679493 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:10.679498 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:10.679579 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:10.679684 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:36:10.681421 (+ 1737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:10.682443 (+ 1022us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:10.684125 (+ 1682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:10.684786 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:10.684912 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:10.691150 (+ 6238us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:36:10.691163 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:36:10.691191 (+ 28us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:36:10.691259 (+ 68us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:36:10.696087 (+ 4828us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:10.696749 (+ 662us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:10.696758 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:10.696761 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:10.696947 (+ 186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:10.697264 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:10.697269 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:10.697272 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:10.697784 (+ 512us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:36:10.698250 (+ 466us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:10.698451 (+ 201us) server_negotiation.cc:299] Negotiation successful
0807 10:36:10.698689 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
W20260807 10:36:10.699831 22698 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:59748
W20260807 10:36:10.700503 21165 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 22565: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260807 10:36:10.700687 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 22565
I20260807 10:36:10.728011 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 22708
Aug 07 10:36:10 dist-test-slave-0b58 krb5kdc[22295](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786098969, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.20.171.67@KRBTEST.COM
I20260807 10:36:10.744421 22865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:10.728896 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39186 (local address 127.20.171.67:42801)
0807 10:36:10.729099 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:10.729106 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:10.729174 (+ 68us) server_negotiation.cc:407] Connection header received
0807 10:36:10.729401 (+ 227us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:10.729406 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:10.729474 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:10.729602 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:36:10.730952 (+ 1350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:10.731757 (+ 805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:10.733214 (+ 1457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:10.733700 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:10.733836 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:10.738053 (+ 4217us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:36:10.738065 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:36:10.738078 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:36:10.738113 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:36:10.741609 (+ 3496us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:10.742337 (+ 728us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:10.742349 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:10.742351 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:10.742497 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:10.742856 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:10.742861 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:10.742864 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:10.743207 (+ 343us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:36:10.743548 (+ 341us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:10.743791 (+ 243us) server_negotiation.cc:299] Negotiation successful
0807 10:36:10.744042 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
W20260807 10:36:10.745113 22842 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39186
W20260807 10:36:10.745791 21165 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 22708: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260807 10:36:10.745920 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 22708
I20260807 10:36:10.769369 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 22308
I20260807 10:36:10.770560 22385 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:36:10.886891 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 22308
2026-08-07T10:36:10Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (4773 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786098956060137-21165-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 10:36:10 dist-test-slave-0b58 krb5kdc[22940](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 10:36:10 dist-test-slave-0b58 krb5kdc[22940](info): set up 2 sockets
Aug 07 10:36:10 dist-test-slave-0b58 krb5kdc[22940](info): commencing operation
krb5kdc: starting...
W20260807 10:36:11.972465 21165 mini_kdc.cc:121] Time spent starting KDC: real 1.040s user 0.000s sys 0.023s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786098956060137-21165-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786098956060137-21165-0/krb5kdc/test-user.keytab.
Aug 07 10:36:12 dist-test-slave-0b58 krb5kdc[22940](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786098972, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T10:36:12Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T10:36:12Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.171.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.171.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.171.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.126.keytab.
Entry for principal kudu/127.20.171.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.126.keytab.
I20260807 10:36:12.179126 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786098956060137-21165-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786098956060137-21165-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786098956060137-21165-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.171.126:41919
--webserver_interface=127.20.171.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.126.keytab
--principal=kudu/127.20.171.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.171.84:36847
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.171.126:41919
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786098956060137-21165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786098956060137-21165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786098956060137-21165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:36:12.502581 22954 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:36:12.502851 22954 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:36:12.503021 22954 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:36:12.510082 22954 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 10:36:12.510186 22954 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260807 10:36:12.510288 22954 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:36:12.510416 22954 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:36:12.510493 22954 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 10:36:12.510600 22954 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 10:36:12.520473 22954 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.171.84:36847
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786098956060137-21165-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786098956060137-21165-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.171.126:41919
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.126.keytab
--principal=kudu/127.20.171.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.171.126:41919
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.171.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786098956060137-21165-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:36:12.521786 22954 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:36:12.523108 22954 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:36:12.534744 22960 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:36:12.534813 22962 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:36:12.534837 22959 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:36:12.535879 22954 server_base.cc:1034] running on GCE node
I20260807 10:36:12.536754 22954 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:36:12.538086 22954 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:36:12.539338 22954 hybrid_clock.cc:648] HybridClock initialized: now 1786098972539276 us; error 37 us; skew 500 ppm
I20260807 10:36:12.539757 22954 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:36:12 dist-test-slave-0b58 krb5kdc[22940](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786098972, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:36:12.542943 22954 init.cc:377] Logged in from keytab as kudu/127.20.171.126@KRBTEST.COM (short username kudu)
I20260807 10:36:12.544461 22954 webserver.cc:460] Webserver started at http://127.20.171.126:45515/ using document root <none> and password file <none>
I20260807 10:36:12.545147 22954 fs_manager.cc:359] Metadata directory not provided
I20260807 10:36:12.545275 22954 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:36:12.545580 22954 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:36:12.548596 22954 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786098956060137-21165-0/minicluster-data/master-0/data/instance:
uuid: "95c5073aefc9420fa0091dba7c7479a1"
format_stamp: "Formatted at 2026-08-07 10:36:12 on dist-test-slave-0b58"
server_key: "071fa9f6aa2d11259dda002eb12b2ed7"
server_key_iv: "22753e681732ac2a4799dbf6881e7802"
server_key_version: "encryptionkey@0"
I20260807 10:36:12.549384 22954 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786098956060137-21165-0/minicluster-data/master-0/wal/instance:
uuid: "95c5073aefc9420fa0091dba7c7479a1"
format_stamp: "Formatted at 2026-08-07 10:36:12 on dist-test-slave-0b58"
server_key: "071fa9f6aa2d11259dda002eb12b2ed7"
server_key_iv: "22753e681732ac2a4799dbf6881e7802"
server_key_version: "encryptionkey@0"
I20260807 10:36:12.554730 22954 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260807 10:36:12.558142 22969 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:36:12.559463 22954 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.001s
I20260807 10:36:12.559643 22954 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786098956060137-21165-0/minicluster-data/master-0/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786098956060137-21165-0/minicluster-data/master-0/wal
uuid: "95c5073aefc9420fa0091dba7c7479a1"
format_stamp: "Formatted at 2026-08-07 10:36:12 on dist-test-slave-0b58"
server_key: "071fa9f6aa2d11259dda002eb12b2ed7"
server_key_iv: "22753e681732ac2a4799dbf6881e7802"
server_key_version: "encryptionkey@0"
I20260807 10:36:12.559875 22954 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786098956060137-21165-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786098956060137-21165-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786098956060137-21165-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:36:12.578267 22954 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:36:12.582641 22954 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:36:12.582926 22954 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:36:12.604718 22954 rpc_server.cc:307] RPC server started. Bound to: 127.20.171.126:41919
I20260807 10:36:12.604736 23033 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.171.126:41919 every 8 connection(s)
I20260807 10:36:12.606062 22954 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
I20260807 10:36:12.607641 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 22954
I20260807 10:36:12.607843 21165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786098956060137-21165-0/minicluster-data/master-0/wal/instance
I20260807 10:36:12.608707 21165 external_mini_cluster.cc:1428] Setting key 2d3583dc80073b0fb7f02a049b0104fd
I20260807 10:36:12.610811 23034 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 07 10:36:12 dist-test-slave-0b58 krb5kdc[22940](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786098972, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.171.126@KRBTEST.COM
I20260807 10:36:12.624470 23034 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 95c5073aefc9420fa0091dba7c7479a1: Bootstrap starting.
I20260807 10:36:12.628433 23034 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 95c5073aefc9420fa0091dba7c7479a1: Neither blocks nor log segments found. Creating new log.
I20260807 10:36:12.629704 23034 log.cc:824] T 00000000000000000000000000000000 P 95c5073aefc9420fa0091dba7c7479a1: Log is configured to *not* fsync() on all Append() calls
I20260807 10:36:12.633118 23034 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 95c5073aefc9420fa0091dba7c7479a1: No bootstrap required, opened a new log
I20260807 10:36:12.633697 23037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:12.610733 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60856 (local address 127.20.171.126:41919)
0807 10:36:12.611589 (+ 856us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:12.611603 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:12.611650 (+ 47us) server_negotiation.cc:407] Connection header received
0807 10:36:12.613887 (+ 2237us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:12.613914 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:12.614425 (+ 511us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:12.614898 (+ 473us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:36:12.616192 (+ 1294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:12.618253 (+ 2061us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:12.619461 (+ 1208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:12.620527 (+ 1066us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:12.620713 (+ 186us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:12.625509 (+ 4796us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:36:12.625517 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:36:12.625530 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:36:12.625564 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:36:12.629372 (+ 3808us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:12.630313 (+ 941us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:12.630325 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:12.630335 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:12.630583 (+ 248us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:12.630983 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:12.630988 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:12.630990 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:12.631576 (+ 586us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:36:12.631807 (+ 231us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:12.632325 (+ 518us) server_negotiation.cc:299] Negotiation successful
0807 10:36:12.632675 (+ 350us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":646,"thread_start_us":401,"threads_started":1}
I20260807 10:36:12.640442 23034 raft_consensus.cc:348] T 00000000000000000000000000000000 P 95c5073aefc9420fa0091dba7c7479a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "95c5073aefc9420fa0091dba7c7479a1" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 41919 } }
I20260807 10:36:12.640821 23034 raft_consensus.cc:374] T 00000000000000000000000000000000 P 95c5073aefc9420fa0091dba7c7479a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:36:12.640938 23034 raft_consensus.cc:729] T 00000000000000000000000000000000 P 95c5073aefc9420fa0091dba7c7479a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95c5073aefc9420fa0091dba7c7479a1, State: Initialized, Role: FOLLOWER
I20260807 10:36:12.641574 23034 consensus_queue.cc:260] T 00000000000000000000000000000000 P 95c5073aefc9420fa0091dba7c7479a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "95c5073aefc9420fa0091dba7c7479a1" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 41919 } }
I20260807 10:36:12.641808 23034 raft_consensus.cc:388] T 00000000000000000000000000000000 P 95c5073aefc9420fa0091dba7c7479a1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 10:36:12.641937 23034 raft_consensus.cc:482] T 00000000000000000000000000000000 P 95c5073aefc9420fa0091dba7c7479a1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 10:36:12.642119 23034 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 95c5073aefc9420fa0091dba7c7479a1 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:36:12.644321 23034 raft_consensus.cc:504] T 00000000000000000000000000000000 P 95c5073aefc9420fa0091dba7c7479a1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "95c5073aefc9420fa0091dba7c7479a1" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 41919 } }
I20260807 10:36:12.644801 23034 leader_election.cc:302] T 00000000000000000000000000000000 P 95c5073aefc9420fa0091dba7c7479a1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 95c5073aefc9420fa0091dba7c7479a1; no voters:
I20260807 10:36:12.645403 23034 leader_election.cc:288] T 00000000000000000000000000000000 P 95c5073aefc9420fa0091dba7c7479a1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 10:36:12.645542 23039 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 95c5073aefc9420fa0091dba7c7479a1 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:36:12.646261 23039 raft_consensus.cc:686] T 00000000000000000000000000000000 P 95c5073aefc9420fa0091dba7c7479a1 [term 1 LEADER]: Becoming Leader. State: Replica: 95c5073aefc9420fa0091dba7c7479a1, State: Running, Role: LEADER
I20260807 10:36:12.646827 23039 consensus_queue.cc:237] T 00000000000000000000000000000000 P 95c5073aefc9420fa0091dba7c7479a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "95c5073aefc9420fa0091dba7c7479a1" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 41919 } }
I20260807 10:36:12.647540 23034 sys_catalog.cc:564] T 00000000000000000000000000000000 P 95c5073aefc9420fa0091dba7c7479a1 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 10:36:12.649816 23040 sys_catalog.cc:455] T 00000000000000000000000000000000 P 95c5073aefc9420fa0091dba7c7479a1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "95c5073aefc9420fa0091dba7c7479a1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "95c5073aefc9420fa0091dba7c7479a1" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 41919 } } }
I20260807 10:36:12.649806 23041 sys_catalog.cc:455] T 00000000000000000000000000000000 P 95c5073aefc9420fa0091dba7c7479a1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 95c5073aefc9420fa0091dba7c7479a1. Latest consensus state: current_term: 1 leader_uuid: "95c5073aefc9420fa0091dba7c7479a1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "95c5073aefc9420fa0091dba7c7479a1" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 41919 } } }
I20260807 10:36:12.650321 23040 sys_catalog.cc:458] T 00000000000000000000000000000000 P 95c5073aefc9420fa0091dba7c7479a1 [sys.catalog]: This master's current role is: LEADER
I20260807 10:36:12.650368 23041 sys_catalog.cc:458] T 00000000000000000000000000000000 P 95c5073aefc9420fa0091dba7c7479a1 [sys.catalog]: This master's current role is: LEADER
I20260807 10:36:12.651929 23046 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 10:36:12.657773 23046 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 10:36:12.666505 23046 catalog_manager.cc:1347] Generated new cluster ID: 8e30a59dc2e147d8af3509b6c85c51ab
I20260807 10:36:12.666627 23046 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 10:36:12.687541 23046 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 10:36:12.688946 23046 catalog_manager.cc:1504] Loading token signing keys...
I20260807 10:36:12.697716 23046 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 95c5073aefc9420fa0091dba7c7479a1: Generated new TSK 0
I20260807 10:36:12.698479 23046 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.171.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.171.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.171.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.65.keytab.
Entry for principal kudu/127.20.171.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.65.keytab.
I20260807 10:36:12.748219 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786098956060137-21165-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786098956060137-21165-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786098956060137-21165-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786098956060137-21165-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.171.65:0
--local_ip_for_outbound_sockets=127.20.171.65
--webserver_interface=127.20.171.65
--webserver_port=0
--tserver_master_addrs=127.20.171.126:41919
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.65.keytab
--principal=kudu/127.20.171.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.171.84:36847
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786098956060137-21165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786098956060137-21165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786098956060137-21165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:36:13.083441 23060 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:36:13.083675 23060 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:36:13.083809 23060 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:36:13.090847 23060 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:36:13.090973 23060 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:36:13.091123 23060 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260807 10:36:13.091202 23060 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 10:36:13.091348 23060 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.171.65
I20260807 10:36:13.100724 23060 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.171.84:36847
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786098956060137-21165-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786098956060137-21165-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.65.keytab
--principal=kudu/127.20.171.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.171.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786098956060137-21165-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.171.65
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.20.171.126:41919
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.171.65
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786098956060137-21165-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:36:13.101971 23060 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:36:13.103262 23060 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:36:13.116212 23066 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:36:13.116294 23068 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:36:13.116328 23065 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:36:13.117501 23060 server_base.cc:1034] running on GCE node
I20260807 10:36:13.118098 23060 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:36:13.119017 23060 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:36:13.120219 23060 hybrid_clock.cc:648] HybridClock initialized: now 1786098973120161 us; error 50 us; skew 500 ppm
I20260807 10:36:13.120565 23060 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:36:13 dist-test-slave-0b58 krb5kdc[22940](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786098973, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:36:13.126567 23060 init.cc:377] Logged in from keytab as kudu/127.20.171.65@KRBTEST.COM (short username kudu)
I20260807 10:36:13.128053 23060 webserver.cc:460] Webserver started at http://127.20.171.65:42061/ using document root <none> and password file <none>
I20260807 10:36:13.128750 23060 fs_manager.cc:359] Metadata directory not provided
I20260807 10:36:13.128845 23060 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:36:13.129106 23060 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:36:13.131904 23060 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786098956060137-21165-0/minicluster-data/ts-0/data/instance:
uuid: "a3d1e4c904da4a68909c233e148b45c2"
format_stamp: "Formatted at 2026-08-07 10:36:13 on dist-test-slave-0b58"
server_key: "b1c3c0b2f8408e3f8ffe025570ae2a0a"
server_key_iv: "655a85741d0a812615399a3ac074be62"
server_key_version: "encryptionkey@0"
I20260807 10:36:13.132659 23060 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786098956060137-21165-0/minicluster-data/ts-0/wal/instance:
uuid: "a3d1e4c904da4a68909c233e148b45c2"
format_stamp: "Formatted at 2026-08-07 10:36:13 on dist-test-slave-0b58"
server_key: "b1c3c0b2f8408e3f8ffe025570ae2a0a"
server_key_iv: "655a85741d0a812615399a3ac074be62"
server_key_version: "encryptionkey@0"
I20260807 10:36:13.138036 23060 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260807 10:36:13.141290 23076 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:36:13.142570 23060 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260807 10:36:13.142726 23060 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786098956060137-21165-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786098956060137-21165-0/minicluster-data/ts-0/wal
uuid: "a3d1e4c904da4a68909c233e148b45c2"
format_stamp: "Formatted at 2026-08-07 10:36:13 on dist-test-slave-0b58"
server_key: "b1c3c0b2f8408e3f8ffe025570ae2a0a"
server_key_iv: "655a85741d0a812615399a3ac074be62"
server_key_version: "encryptionkey@0"
I20260807 10:36:13.142946 23060 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786098956060137-21165-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786098956060137-21165-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786098956060137-21165-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:36:13.158442 23060 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:36:13.162405 23060 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:36:13.162686 23060 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:36:13.165557 23060 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:36:13.165652 23060 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:36:13.165863 23060 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:36:13.165961 23060 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 07 10:36:13 dist-test-slave-0b58 krb5kdc[22940](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786098973, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.65@KRBTEST.COM for kudu/127.20.171.126@KRBTEST.COM
I20260807 10:36:13.188911 23084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:13.165946 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.65:47475 (local address 127.20.171.126:41919)
0807 10:36:13.166461 (+ 515us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:13.166467 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:13.167719 (+ 1252us) server_negotiation.cc:407] Connection header received
0807 10:36:13.170689 (+ 2970us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:13.170693 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:13.170760 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:13.170877 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:36:13.173052 (+ 2175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:13.174102 (+ 1050us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:13.176735 (+ 2633us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:13.177138 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:13.177276 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:13.182078 (+ 4802us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:36:13.182083 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:36:13.182087 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:36:13.182148 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:36:13.185449 (+ 3301us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:13.186151 (+ 702us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:13.186158 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:13.186162 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:13.186330 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:13.186899 (+ 569us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:13.186906 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:13.186911 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:13.187299 (+ 388us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:36:13.187472 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:13.188290 (+ 818us) server_negotiation.cc:299] Negotiation successful
0807 10:36:13.188528 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":391,"thread_start_us":267,"threads_started":1}
I20260807 10:36:13.190167 23086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:13.166611 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:41919 (local address 127.20.171.65:47475)
0807 10:36:13.167469 (+ 858us) negotiation.cc:107] Waiting for socket to connect
0807 10:36:13.167525 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0807 10:36:13.170356 (+ 2831us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:36:13.171123 (+ 767us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:36:13.171131 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:36:13.171904 (+ 773us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:36:13.172857 (+ 953us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:13.172892 (+ 35us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:13.174269 (+ 1377us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:13.174272 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:13.176553 (+ 2281us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:13.176576 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:13.177407 (+ 831us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:13.177414 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:13.177883 (+ 469us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:13.178627 (+ 744us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:36:13.178671 (+ 44us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:36:13.181780 (+ 3109us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:36:13.185582 (+ 3802us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:36:13.185591 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:36:13.185605 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:36:13.186011 (+ 406us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:36:13.186476 (+ 465us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:36:13.186483 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:36:13.186490 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:36:13.186701 (+ 211us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:36:13.187458 (+ 757us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:36:13.187465 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:36:13.187827 (+ 362us) client_negotiation.cc:769] Sending connection context
0807 10:36:13.188140 (+ 313us) client_negotiation.cc:240] Negotiation successful
0807 10:36:13.188733 (+ 593us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":543,"thread_start_us":305,"threads_started":1}
I20260807 10:36:13.209913 23084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:13.196461 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.65:50315 (local address 127.20.171.126:41919)
0807 10:36:13.196629 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:13.196636 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:13.197401 (+ 765us) server_negotiation.cc:407] Connection header received
0807 10:36:13.197630 (+ 229us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:13.197635 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:13.197703 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:13.197823 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:36:13.198770 (+ 947us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:13.199453 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:13.201372 (+ 1919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:13.201966 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:13.202059 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:13.204599 (+ 2540us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:36:13.204604 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:36:13.204609 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:36:13.204643 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:36:13.207069 (+ 2426us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:13.207734 (+ 665us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:13.207739 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:13.207743 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:13.207882 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:13.208279 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:13.208287 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:13.208293 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:13.208675 (+ 382us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:36:13.208839 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:13.209346 (+ 507us) server_negotiation.cc:299] Negotiation successful
0807 10:36:13.209581 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260807 10:36:13.211058 23155 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:13.196621 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:41919 (local address 127.20.171.65:50315)
0807 10:36:13.197297 (+ 676us) negotiation.cc:107] Waiting for socket to connect
0807 10:36:13.197318 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0807 10:36:13.197513 (+ 195us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:36:13.197844 (+ 331us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:36:13.197849 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:36:13.198359 (+ 510us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:36:13.198629 (+ 270us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:13.198637 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:13.199581 (+ 944us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:13.199586 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:13.201142 (+ 1556us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:13.201170 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:13.202355 (+ 1185us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:13.202365 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:13.202594 (+ 229us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:13.203285 (+ 691us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:36:13.203314 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:36:13.204442 (+ 1128us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:36:13.207200 (+ 2758us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:36:13.207206 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:36:13.207210 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:36:13.207612 (+ 402us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:36:13.207991 (+ 379us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:36:13.207995 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:36:13.207999 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:36:13.208119 (+ 120us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:36:13.208794 (+ 675us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:36:13.208799 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:36:13.209035 (+ 236us) client_negotiation.cc:769] Sending connection context
0807 10:36:13.210129 (+ 1094us) client_negotiation.cc:240] Negotiation successful
0807 10:36:13.210504 (+ 375us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":498,"thread_start_us":341,"threads_started":1}
I20260807 10:36:13.221849 23060 rpc_server.cc:307] RPC server started. Bound to: 127.20.171.65:43331
I20260807 10:36:13.221902 23200 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.171.65:43331 every 8 connection(s)
I20260807 10:36:13.223116 23060 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786098956060137-21165-0/minicluster-data/ts-0/data/info.pb
I20260807 10:36:13.225040 23201 heartbeater.cc:347] Connected to a master server at 127.20.171.126:41919
I20260807 10:36:13.225265 23201 heartbeater.cc:464] Registering TS with master...
I20260807 10:36:13.225875 23201 heartbeater.cc:511] Master 127.20.171.126:41919 requested a full tablet report, sending...
I20260807 10:36:13.227877 22988 ts_manager.cc:194] Registered new tserver with Master: a3d1e4c904da4a68909c233e148b45c2 (127.20.171.65:43331)
I20260807 10:36:13.229004 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 23060
I20260807 10:36:13.229209 21165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786098956060137-21165-0/minicluster-data/ts-0/wal/instance
I20260807 10:36:13.229516 22988 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.171.65@KRBTEST.COM'} at 127.20.171.65:47475
I20260807 10:36:13.229882 21165 external_mini_cluster.cc:1428] Setting key 9be9ea98d26aa415a5d4287f5a840020
WARNING: no policy specified for kudu/127.20.171.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.171.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.171.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.66.keytab.
Entry for principal kudu/127.20.171.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.66.keytab.
I20260807 10:36:13.275832 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786098956060137-21165-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786098956060137-21165-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786098956060137-21165-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786098956060137-21165-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.171.66:0
--local_ip_for_outbound_sockets=127.20.171.66
--webserver_interface=127.20.171.66
--webserver_port=0
--tserver_master_addrs=127.20.171.126:41919
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.66.keytab
--principal=kudu/127.20.171.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.171.84:36847
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786098956060137-21165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786098956060137-21165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786098956060137-21165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:36:13.592658 23205 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:36:13.592903 23205 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:36:13.592999 23205 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:36:13.599766 23205 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:36:13.599856 23205 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:36:13.599939 23205 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260807 10:36:13.599990 23205 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 10:36:13.600052 23205 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.171.66
I20260807 10:36:13.609007 23205 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.171.84:36847
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786098956060137-21165-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786098956060137-21165-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.66.keytab
--principal=kudu/127.20.171.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.171.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786098956060137-21165-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.171.66
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.20.171.126:41919
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.171.66
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786098956060137-21165-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:36:13.610013 23205 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:36:13.611251 23205 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:36:13.624572 23211 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:36:13.624683 23212 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:36:13.624653 23214 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:36:13.625447 23205 server_base.cc:1034] running on GCE node
I20260807 10:36:13.625916 23205 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:36:13.626719 23205 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:36:13.627918 23205 hybrid_clock.cc:648] HybridClock initialized: now 1786098973627870 us; error 39 us; skew 500 ppm
I20260807 10:36:13.628262 23205 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:36:13 dist-test-slave-0b58 krb5kdc[22940](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786098973, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:36:13.632000 23205 init.cc:377] Logged in from keytab as kudu/127.20.171.66@KRBTEST.COM (short username kudu)
I20260807 10:36:13.633440 23205 webserver.cc:460] Webserver started at http://127.20.171.66:41467/ using document root <none> and password file <none>
I20260807 10:36:13.634083 23205 fs_manager.cc:359] Metadata directory not provided
I20260807 10:36:13.634225 23205 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:36:13.634517 23205 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:36:13.637310 23205 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786098956060137-21165-0/minicluster-data/ts-1/data/instance:
uuid: "54772e1ff58a436ba58a0ac5bfa97a59"
format_stamp: "Formatted at 2026-08-07 10:36:13 on dist-test-slave-0b58"
server_key: "c9f7d0dc87b809cc7798ec017336e215"
server_key_iv: "c61202d5313d61c0ac8651366d5e1154"
server_key_version: "encryptionkey@0"
I20260807 10:36:13.638036 23205 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786098956060137-21165-0/minicluster-data/ts-1/wal/instance:
uuid: "54772e1ff58a436ba58a0ac5bfa97a59"
format_stamp: "Formatted at 2026-08-07 10:36:13 on dist-test-slave-0b58"
server_key: "c9f7d0dc87b809cc7798ec017336e215"
server_key_iv: "c61202d5313d61c0ac8651366d5e1154"
server_key_version: "encryptionkey@0"
I20260807 10:36:13.643105 23205 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.003s
I20260807 10:36:13.646260 23222 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:36:13.647547 23205 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 10:36:13.647725 23205 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786098956060137-21165-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786098956060137-21165-0/minicluster-data/ts-1/wal
uuid: "54772e1ff58a436ba58a0ac5bfa97a59"
format_stamp: "Formatted at 2026-08-07 10:36:13 on dist-test-slave-0b58"
server_key: "c9f7d0dc87b809cc7798ec017336e215"
server_key_iv: "c61202d5313d61c0ac8651366d5e1154"
server_key_version: "encryptionkey@0"
I20260807 10:36:13.647912 23205 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786098956060137-21165-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786098956060137-21165-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786098956060137-21165-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:36:13.667367 23205 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:36:13.670857 23205 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:36:13.671129 23205 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:36:13.673622 23205 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:36:13.673794 23205 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:36:13.673931 23205 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:36:13.674036 23205 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 07 10:36:13 dist-test-slave-0b58 krb5kdc[22940](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786098973, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.66@KRBTEST.COM for kudu/127.20.171.126@KRBTEST.COM
I20260807 10:36:13.697350 23084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:13.673945 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.66:42503 (local address 127.20.171.126:41919)
0807 10:36:13.674132 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:13.674138 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:13.675574 (+ 1436us) server_negotiation.cc:407] Connection header received
0807 10:36:13.677712 (+ 2138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:13.677718 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:13.677804 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:13.677908 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:36:13.679977 (+ 2069us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:13.681355 (+ 1378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:13.683801 (+ 2446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:13.684584 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:13.684746 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:13.689799 (+ 5053us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:36:13.689807 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:36:13.689812 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:36:13.689848 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:36:13.693454 (+ 3606us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:13.694477 (+ 1023us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:13.694482 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:13.694486 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:13.694611 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:13.695176 (+ 565us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:13.695182 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:13.695186 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:13.695581 (+ 395us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:36:13.695749 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:13.696551 (+ 802us) server_negotiation.cc:299] Negotiation successful
0807 10:36:13.696875 (+ 324us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260807 10:36:13.697834 23232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:13.674515 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:41919 (local address 127.20.171.66:42503)
0807 10:36:13.675390 (+ 875us) negotiation.cc:107] Waiting for socket to connect
0807 10:36:13.675442 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0807 10:36:13.677415 (+ 1973us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:36:13.678162 (+ 747us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:36:13.678177 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:36:13.678924 (+ 747us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:36:13.679699 (+ 775us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:13.679720 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:13.681520 (+ 1800us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:13.681528 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:13.683661 (+ 2133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:13.683673 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:13.685123 (+ 1450us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:13.685134 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:13.685508 (+ 374us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:13.686313 (+ 805us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:36:13.686361 (+ 48us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:36:13.689584 (+ 3223us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:36:13.693664 (+ 4080us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:36:13.693674 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:36:13.693690 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:36:13.694272 (+ 582us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:36:13.694770 (+ 498us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:36:13.694777 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:36:13.694782 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:36:13.695063 (+ 281us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:36:13.695735 (+ 672us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:36:13.695742 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:36:13.696057 (+ 315us) client_negotiation.cc:769] Sending connection context
0807 10:36:13.696446 (+ 389us) client_negotiation.cc:240] Negotiation successful
0807 10:36:13.696842 (+ 396us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":615,"thread_start_us":369,"threads_started":1}
I20260807 10:36:13.717463 23302 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:13.703073 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:41919 (local address 127.20.171.66:37119)
0807 10:36:13.703682 (+ 609us) negotiation.cc:107] Waiting for socket to connect
0807 10:36:13.703707 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0807 10:36:13.703834 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:36:13.704119 (+ 285us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:36:13.704123 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:36:13.704627 (+ 504us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:36:13.704982 (+ 355us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:13.704991 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:13.706202 (+ 1211us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:13.706211 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:13.708502 (+ 2291us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:13.708520 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:13.709273 (+ 753us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:13.709282 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:13.709523 (+ 241us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:13.710149 (+ 626us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:36:13.710179 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:36:13.711432 (+ 1253us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:36:13.714578 (+ 3146us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:36:13.714586 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:36:13.714592 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:36:13.715291 (+ 699us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:36:13.715741 (+ 450us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:36:13.715747 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:36:13.715750 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:36:13.715875 (+ 125us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:36:13.716439 (+ 564us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:36:13.716444 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:36:13.716673 (+ 229us) client_negotiation.cc:769] Sending connection context
0807 10:36:13.716866 (+ 193us) client_negotiation.cc:240] Negotiation successful
0807 10:36:13.717144 (+ 278us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":479,"thread_start_us":345,"threads_started":1}
I20260807 10:36:13.717743 23084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:13.703072 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.66:37119 (local address 127.20.171.126:41919)
0807 10:36:13.703276 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:13.703284 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:13.703785 (+ 501us) server_negotiation.cc:407] Connection header received
0807 10:36:13.703946 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:13.703950 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:13.704012 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:13.704094 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:36:13.705121 (+ 1027us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:13.706012 (+ 891us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:13.708663 (+ 2651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:13.709062 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:13.709156 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:13.711623 (+ 2467us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:36:13.711627 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:36:13.711630 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:36:13.711655 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:36:13.714449 (+ 2794us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:13.715429 (+ 980us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:13.715436 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:13.715442 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:13.715610 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:13.715986 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:13.715990 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:13.715993 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:13.716328 (+ 335us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:36:13.716467 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:13.716989 (+ 522us) server_negotiation.cc:299] Negotiation successful
0807 10:36:13.717269 (+ 280us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260807 10:36:13.724972 23205 rpc_server.cc:307] RPC server started. Bound to: 127.20.171.66:38257
I20260807 10:36:13.725047 23345 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.171.66:38257 every 8 connection(s)
I20260807 10:36:13.726063 23205 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786098956060137-21165-0/minicluster-data/ts-1/data/info.pb
I20260807 10:36:13.727912 23346 heartbeater.cc:347] Connected to a master server at 127.20.171.126:41919
I20260807 10:36:13.728176 23346 heartbeater.cc:464] Registering TS with master...
I20260807 10:36:13.728762 23346 heartbeater.cc:511] Master 127.20.171.126:41919 requested a full tablet report, sending...
I20260807 10:36:13.729976 22988 ts_manager.cc:194] Registered new tserver with Master: 54772e1ff58a436ba58a0ac5bfa97a59 (127.20.171.66:38257)
I20260807 10:36:13.730795 22988 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.171.66@KRBTEST.COM'} at 127.20.171.66:42503
I20260807 10:36:13.734439 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 23205
I20260807 10:36:13.734628 21165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786098956060137-21165-0/minicluster-data/ts-1/wal/instance
I20260807 10:36:13.735085 21165 external_mini_cluster.cc:1428] Setting key e3ddfaf6ad9223e65db2c62b591cc83f
WARNING: no policy specified for kudu/127.20.171.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.171.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.171.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.67.keytab.
Entry for principal kudu/127.20.171.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.67.keytab.
I20260807 10:36:13.778563 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786098956060137-21165-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786098956060137-21165-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786098956060137-21165-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786098956060137-21165-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.171.67:0
--local_ip_for_outbound_sockets=127.20.171.67
--webserver_interface=127.20.171.67
--webserver_port=0
--tserver_master_addrs=127.20.171.126:41919
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.67.keytab
--principal=kudu/127.20.171.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.171.84:36847
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786098956060137-21165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786098956060137-21165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786098956060137-21165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:36:14.091455 23350 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:36:14.091686 23350 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:36:14.091778 23350 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:36:14.098659 23350 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:36:14.098781 23350 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:36:14.098922 23350 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260807 10:36:14.098997 23350 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 10:36:14.099116 23350 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.171.67
I20260807 10:36:14.108048 23350 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.171.84:36847
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786098956060137-21165-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786098956060137-21165-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.67.keytab
--principal=kudu/127.20.171.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.171.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786098956060137-21165-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.171.67
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.20.171.126:41919
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.171.67
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786098956060137-21165-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:36:14.109131 23350 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:36:14.110268 23350 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:36:14.122265 23355 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:36:14.122301 23358 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:36:14.122339 23356 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:36:14.123126 23350 server_base.cc:1034] running on GCE node
I20260807 10:36:14.123751 23350 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:36:14.124648 23350 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:36:14.125864 23350 hybrid_clock.cc:648] HybridClock initialized: now 1786098974125826 us; error 49 us; skew 500 ppm
I20260807 10:36:14.126142 23350 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:36:14 dist-test-slave-0b58 krb5kdc[22940](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786098974, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:36:14.129168 23350 init.cc:377] Logged in from keytab as kudu/127.20.171.67@KRBTEST.COM (short username kudu)
I20260807 10:36:14.130465 23350 webserver.cc:460] Webserver started at http://127.20.171.67:40015/ using document root <none> and password file <none>
I20260807 10:36:14.131073 23350 fs_manager.cc:359] Metadata directory not provided
I20260807 10:36:14.131213 23350 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:36:14.131510 23350 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:36:14.134299 23350 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786098956060137-21165-0/minicluster-data/ts-2/data/instance:
uuid: "efab605345b447e398d4ae5bbd44dd32"
format_stamp: "Formatted at 2026-08-07 10:36:14 on dist-test-slave-0b58"
server_key: "ec47b2e2454dffa8bc2e03b7b3ebac20"
server_key_iv: "ee60eaa5ef5aa494e1357bbcd997a34b"
server_key_version: "encryptionkey@0"
I20260807 10:36:14.134972 23350 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786098956060137-21165-0/minicluster-data/ts-2/wal/instance:
uuid: "efab605345b447e398d4ae5bbd44dd32"
format_stamp: "Formatted at 2026-08-07 10:36:14 on dist-test-slave-0b58"
server_key: "ec47b2e2454dffa8bc2e03b7b3ebac20"
server_key_iv: "ee60eaa5ef5aa494e1357bbcd997a34b"
server_key_version: "encryptionkey@0"
I20260807 10:36:14.139515 23350 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260807 10:36:14.142608 23365 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:36:14.143658 23350 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 10:36:14.143821 23350 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786098956060137-21165-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786098956060137-21165-0/minicluster-data/ts-2/wal
uuid: "efab605345b447e398d4ae5bbd44dd32"
format_stamp: "Formatted at 2026-08-07 10:36:14 on dist-test-slave-0b58"
server_key: "ec47b2e2454dffa8bc2e03b7b3ebac20"
server_key_iv: "ee60eaa5ef5aa494e1357bbcd997a34b"
server_key_version: "encryptionkey@0"
I20260807 10:36:14.143992 23350 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786098956060137-21165-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786098956060137-21165-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786098956060137-21165-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:36:14.178162 23350 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:36:14.181749 23350 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:36:14.182027 23350 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:36:14.184360 23350 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:36:14.184477 23350 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:36:14.184593 23350 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:36:14.184722 23350 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 07 10:36:14 dist-test-slave-0b58 krb5kdc[22940](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786098974, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.67@KRBTEST.COM for kudu/127.20.171.126@KRBTEST.COM
I20260807 10:36:14.206863 23084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:14.184881 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.67:41699 (local address 127.20.171.126:41919)
0807 10:36:14.185171 (+ 290us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:14.185179 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:14.186473 (+ 1294us) server_negotiation.cc:407] Connection header received
0807 10:36:14.188631 (+ 2158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:14.188637 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:14.188740 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:14.188837 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:36:14.190810 (+ 1973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:14.191908 (+ 1098us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:14.194588 (+ 2680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:14.195016 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:14.195146 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:14.199831 (+ 4685us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:36:14.199839 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:36:14.199844 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:36:14.199888 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:36:14.203510 (+ 3622us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:14.204364 (+ 854us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:14.204371 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:14.204374 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:14.204553 (+ 179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:14.205115 (+ 562us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:14.205120 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:14.205124 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:14.205411 (+ 287us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:36:14.205560 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:14.206261 (+ 701us) server_negotiation.cc:299] Negotiation successful
0807 10:36:14.206486 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260807 10:36:14.207666 23374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:14.185433 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:41919 (local address 127.20.171.67:41699)
0807 10:36:14.186301 (+ 868us) negotiation.cc:107] Waiting for socket to connect
0807 10:36:14.186343 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0807 10:36:14.188377 (+ 2034us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:36:14.189091 (+ 714us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:36:14.189105 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:36:14.189678 (+ 573us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:36:14.190611 (+ 933us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:14.190641 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:14.192100 (+ 1459us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:14.192104 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:14.194389 (+ 2285us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:14.194408 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:14.195282 (+ 874us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:14.195296 (+ 14us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:14.195569 (+ 273us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:14.196366 (+ 797us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:36:14.196423 (+ 57us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:36:14.199527 (+ 3104us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:36:14.203642 (+ 4115us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:36:14.203650 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:36:14.203663 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:36:14.204180 (+ 517us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:36:14.204692 (+ 512us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:36:14.204697 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:36:14.204701 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:36:14.204985 (+ 284us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:36:14.205533 (+ 548us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:36:14.205540 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:36:14.205828 (+ 288us) client_negotiation.cc:769] Sending connection context
0807 10:36:14.206053 (+ 225us) client_negotiation.cc:240] Negotiation successful
0807 10:36:14.206540 (+ 487us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":570,"thread_start_us":380,"threads_started":1}
I20260807 10:36:14.230652 23084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:14.213717 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.67:57269 (local address 127.20.171.126:41919)
0807 10:36:14.213923 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:14.213931 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:14.214454 (+ 523us) server_negotiation.cc:407] Connection header received
0807 10:36:14.214627 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:14.214633 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:14.214722 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:14.214836 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:36:14.216276 (+ 1440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:14.217419 (+ 1143us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:14.220146 (+ 2727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:14.220657 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:14.220762 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:14.223357 (+ 2595us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:36:14.223366 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:36:14.223373 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:36:14.223420 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:36:14.227178 (+ 3758us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:14.228308 (+ 1130us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:14.228316 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:14.228321 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:14.228506 (+ 185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:14.229011 (+ 505us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:14.229019 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:14.229025 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:14.229425 (+ 400us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:36:14.229587 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:14.230264 (+ 677us) server_negotiation.cc:299] Negotiation successful
0807 10:36:14.230423 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260807 10:36:14.231164 23442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:14.213733 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:41919 (local address 127.20.171.67:57269)
0807 10:36:14.214346 (+ 613us) negotiation.cc:107] Waiting for socket to connect
0807 10:36:14.214368 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0807 10:36:14.214512 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:36:14.214880 (+ 368us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:36:14.214885 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:36:14.215488 (+ 603us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:36:14.216109 (+ 621us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:14.216127 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:14.217630 (+ 1503us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:14.217638 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:14.219991 (+ 2353us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:14.220010 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:14.220863 (+ 853us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:14.220870 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:14.221052 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:14.221841 (+ 789us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:36:14.221871 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:36:14.223110 (+ 1239us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:36:14.227382 (+ 4272us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:36:14.227390 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:36:14.227396 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:36:14.228038 (+ 642us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:36:14.228670 (+ 632us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:36:14.228677 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:36:14.228682 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:36:14.228866 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:36:14.229682 (+ 816us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:36:14.229690 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:36:14.229926 (+ 236us) client_negotiation.cc:769] Sending connection context
0807 10:36:14.230098 (+ 172us) client_negotiation.cc:240] Negotiation successful
0807 10:36:14.230518 (+ 420us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":476,"thread_start_us":346,"threads_started":1}
I20260807 10:36:14.232685 23201 heartbeater.cc:503] Master 127.20.171.126:41919 was elected leader, sending a full tablet report...
I20260807 10:36:14.241772 23350 rpc_server.cc:307] RPC server started. Bound to: 127.20.171.67:35493
I20260807 10:36:14.241854 23486 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.171.67:35493 every 8 connection(s)
I20260807 10:36:14.242830 23350 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786098956060137-21165-0/minicluster-data/ts-2/data/info.pb
I20260807 10:36:14.244589 23487 heartbeater.cc:347] Connected to a master server at 127.20.171.126:41919
I20260807 10:36:14.244812 23487 heartbeater.cc:464] Registering TS with master...
I20260807 10:36:14.244822 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 23350
I20260807 10:36:14.244997 21165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786098956060137-21165-0/minicluster-data/ts-2/wal/instance
I20260807 10:36:14.245401 21165 external_mini_cluster.cc:1428] Setting key c66d98c86f67d5829604299d99c1860a
I20260807 10:36:14.245419 23487 heartbeater.cc:511] Master 127.20.171.126:41919 requested a full tablet report, sending...
I20260807 10:36:14.246861 22987 ts_manager.cc:194] Registered new tserver with Master: efab605345b447e398d4ae5bbd44dd32 (127.20.171.67:35493)
I20260807 10:36:14.247947 22987 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.171.67@KRBTEST.COM'} at 127.20.171.67:41699
I20260807 10:36:14.248473 21165 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 07 10:36:14 dist-test-slave-0b58 krb5kdc[22940](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786098974, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 07 10:36:14 dist-test-slave-0b58 krb5kdc[22940](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786098974, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.171.126@KRBTEST.COM
I20260807 10:36:14.298323 23084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:14.285111 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60872 (local address 127.20.171.126:41919)
0807 10:36:14.285368 (+ 257us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:14.285375 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:14.285637 (+ 262us) server_negotiation.cc:407] Connection header received
0807 10:36:14.285785 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:14.285789 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:14.285849 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:14.285929 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:36:14.287314 (+ 1385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:14.288043 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:14.289249 (+ 1206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:14.289665 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:14.289774 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:14.293459 (+ 3685us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:36:14.293463 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:36:14.293466 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:36:14.293494 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:36:14.295713 (+ 2219us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:14.296404 (+ 691us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:14.296411 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:14.296415 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:14.296541 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:14.296920 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:14.296930 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:14.296932 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:14.297199 (+ 267us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:36:14.297467 (+ 268us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:14.297773 (+ 306us) server_negotiation.cc:299] Negotiation successful
0807 10:36:14.297991 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
I20260807 10:36:14.302213 22987 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60872:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 10:36:14.308753 22987 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 10:36:14.332818 23501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:14.319651 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.67:35493 (local address 127.0.0.1:52484)
0807 10:36:14.321118 (+ 1467us) negotiation.cc:107] Waiting for socket to connect
0807 10:36:14.321166 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0807 10:36:14.321380 (+ 214us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:36:14.322635 (+ 1255us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:36:14.322645 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:36:14.322682 (+ 37us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:36:14.323120 (+ 438us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:14.323134 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:14.325676 (+ 2542us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:14.325683 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:14.328761 (+ 3078us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:14.328781 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:14.331566 (+ 2785us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:14.331575 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:14.331872 (+ 297us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:14.331940 (+ 68us) client_negotiation.cc:769] Sending connection context
0807 10:36:14.332087 (+ 147us) client_negotiation.cc:240] Negotiation successful
0807 10:36:14.332341 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1216,"thread_start_us":1013,"threads_started":1}
I20260807 10:36:14.333972 23502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:14.319876 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52484 (local address 127.20.171.67:35493)
0807 10:36:14.320702 (+ 826us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:14.320712 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:14.321597 (+ 885us) server_negotiation.cc:407] Connection header received
0807 10:36:14.321728 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:14.321740 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:14.322004 (+ 264us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:14.322230 (+ 226us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:36:14.323400 (+ 1170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:14.325478 (+ 2078us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:14.328995 (+ 3517us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:14.330912 (+ 1917us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:14.331068 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:14.331375 (+ 307us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:14.333341 (+ 1966us) server_negotiation.cc:299] Negotiation successful
0807 10:36:14.333546 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":642,"thread_start_us":453,"threads_started":1}
I20260807 10:36:14.338296 23415 tablet_service.cc:1467] Processing CreateTablet for tablet 5e8d2b96c6564646ad64f5263bbd89bc (DEFAULT_TABLE table=test-table [id=8156b58d80be42fdabc54f6b8a203bb2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:36:14.339804 23415 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5e8d2b96c6564646ad64f5263bbd89bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:36:14.340348 23501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:14.321559 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.66:38257 (local address 127.0.0.1:60488)
0807 10:36:14.333026 (+ 11467us) negotiation.cc:107] Waiting for socket to connect
0807 10:36:14.333041 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 10:36:14.333142 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:36:14.334243 (+ 1101us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:36:14.334250 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:36:14.334282 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:36:14.334485 (+ 203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:14.334498 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:14.336354 (+ 1856us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:14.336359 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:14.338059 (+ 1700us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:14.338073 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:14.339614 (+ 1541us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:14.339620 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:14.339794 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:14.339831 (+ 37us) client_negotiation.cc:769] Sending connection context
0807 10:36:14.339916 (+ 85us) client_negotiation.cc:240] Negotiation successful
0807 10:36:14.340029 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11373,"thread_start_us":13193,"threads_started":1}
I20260807 10:36:14.340606 23506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:14.322104 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60488 (local address 127.20.171.66:38257)
0807 10:36:14.333393 (+ 11289us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:14.333403 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:14.333434 (+ 31us) server_negotiation.cc:407] Connection header received
0807 10:36:14.333536 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:14.333545 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:14.333808 (+ 263us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:14.334006 (+ 198us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:36:14.334694 (+ 688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:14.336195 (+ 1501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:14.338216 (+ 2021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:14.339453 (+ 1237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:14.339585 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:14.339793 (+ 208us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:14.340008 (+ 215us) server_negotiation.cc:299] Negotiation successful
0807 10:36:14.340184 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11127,"thread_start_us":11004,"threads_started":1}
I20260807 10:36:14.342125 23503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:14.320600 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.65:43331 (local address 127.0.0.1:57140)
0807 10:36:14.331926 (+ 11326us) negotiation.cc:107] Waiting for socket to connect
0807 10:36:14.331946 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0807 10:36:14.332062 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:36:14.335272 (+ 3210us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:36:14.335276 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:36:14.335299 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:36:14.335691 (+ 392us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:14.335703 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:14.337366 (+ 1663us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:14.337372 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:14.339542 (+ 2170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:14.339556 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:14.341369 (+ 1813us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:14.341376 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:14.341563 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:14.341593 (+ 30us) client_negotiation.cc:769] Sending connection context
0807 10:36:14.341707 (+ 114us) client_negotiation.cc:240] Negotiation successful
0807 10:36:14.341830 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11182,"thread_start_us":11876,"threads_started":1}
I20260807 10:36:14.343782 23274 tablet_service.cc:1467] Processing CreateTablet for tablet 5e8d2b96c6564646ad64f5263bbd89bc (DEFAULT_TABLE table=test-table [id=8156b58d80be42fdabc54f6b8a203bb2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:36:14.344741 23274 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5e8d2b96c6564646ad64f5263bbd89bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:36:14.347368 23504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:14.321077 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57140 (local address 127.20.171.65:43331)
0807 10:36:14.334704 (+ 13627us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:14.334713 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:14.334740 (+ 27us) server_negotiation.cc:407] Connection header received
0807 10:36:14.334836 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:14.334842 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:14.335041 (+ 199us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:14.335866 (+ 825us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:36:14.336391 (+ 525us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:14.337246 (+ 855us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:14.339704 (+ 2458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:14.341169 (+ 1465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:14.341323 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:14.341532 (+ 209us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:14.346819 (+ 5287us) server_negotiation.cc:299] Negotiation successful
0807 10:36:14.346984 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13476,"thread_start_us":13357,"threads_started":1}
I20260807 10:36:14.350942 23129 tablet_service.cc:1467] Processing CreateTablet for tablet 5e8d2b96c6564646ad64f5263bbd89bc (DEFAULT_TABLE table=test-table [id=8156b58d80be42fdabc54f6b8a203bb2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:36:14.351882 23507 tablet_bootstrap.cc:492] T 5e8d2b96c6564646ad64f5263bbd89bc P efab605345b447e398d4ae5bbd44dd32: Bootstrap starting.
I20260807 10:36:14.352205 23129 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5e8d2b96c6564646ad64f5263bbd89bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:36:14.355538 23507 tablet_bootstrap.cc:654] T 5e8d2b96c6564646ad64f5263bbd89bc P efab605345b447e398d4ae5bbd44dd32: Neither blocks nor log segments found. Creating new log.
I20260807 10:36:14.356519 23507 log.cc:824] T 5e8d2b96c6564646ad64f5263bbd89bc P efab605345b447e398d4ae5bbd44dd32: Log is configured to *not* fsync() on all Append() calls
I20260807 10:36:14.358727 23507 tablet_bootstrap.cc:492] T 5e8d2b96c6564646ad64f5263bbd89bc P efab605345b447e398d4ae5bbd44dd32: No bootstrap required, opened a new log
I20260807 10:36:14.358954 23507 ts_tablet_manager.cc:1397] T 5e8d2b96c6564646ad64f5263bbd89bc P efab605345b447e398d4ae5bbd44dd32: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260807 10:36:14.361624 23509 tablet_bootstrap.cc:492] T 5e8d2b96c6564646ad64f5263bbd89bc P 54772e1ff58a436ba58a0ac5bfa97a59: Bootstrap starting.
I20260807 10:36:14.364923 23509 tablet_bootstrap.cc:654] T 5e8d2b96c6564646ad64f5263bbd89bc P 54772e1ff58a436ba58a0ac5bfa97a59: Neither blocks nor log segments found. Creating new log.
I20260807 10:36:14.365710 23510 tablet_bootstrap.cc:492] T 5e8d2b96c6564646ad64f5263bbd89bc P a3d1e4c904da4a68909c233e148b45c2: Bootstrap starting.
I20260807 10:36:14.366232 23509 log.cc:824] T 5e8d2b96c6564646ad64f5263bbd89bc P 54772e1ff58a436ba58a0ac5bfa97a59: Log is configured to *not* fsync() on all Append() calls
I20260807 10:36:14.368677 23510 tablet_bootstrap.cc:654] T 5e8d2b96c6564646ad64f5263bbd89bc P a3d1e4c904da4a68909c233e148b45c2: Neither blocks nor log segments found. Creating new log.
I20260807 10:36:14.369201 23509 tablet_bootstrap.cc:492] T 5e8d2b96c6564646ad64f5263bbd89bc P 54772e1ff58a436ba58a0ac5bfa97a59: No bootstrap required, opened a new log
I20260807 10:36:14.369037 23507 raft_consensus.cc:348] T 5e8d2b96c6564646ad64f5263bbd89bc P efab605345b447e398d4ae5bbd44dd32 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efab605345b447e398d4ae5bbd44dd32" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 35493 } } peers { permanent_uuid: "54772e1ff58a436ba58a0ac5bfa97a59" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 38257 } } peers { permanent_uuid: "a3d1e4c904da4a68909c233e148b45c2" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 43331 } }
I20260807 10:36:14.369493 23509 ts_tablet_manager.cc:1397] T 5e8d2b96c6564646ad64f5263bbd89bc P 54772e1ff58a436ba58a0ac5bfa97a59: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.005s
I20260807 10:36:14.369488 23507 raft_consensus.cc:374] T 5e8d2b96c6564646ad64f5263bbd89bc P efab605345b447e398d4ae5bbd44dd32 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:36:14.369604 23507 raft_consensus.cc:729] T 5e8d2b96c6564646ad64f5263bbd89bc P efab605345b447e398d4ae5bbd44dd32 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efab605345b447e398d4ae5bbd44dd32, State: Initialized, Role: FOLLOWER
I20260807 10:36:14.369817 23510 log.cc:824] T 5e8d2b96c6564646ad64f5263bbd89bc P a3d1e4c904da4a68909c233e148b45c2: Log is configured to *not* fsync() on all Append() calls
I20260807 10:36:14.370244 23507 consensus_queue.cc:260] T 5e8d2b96c6564646ad64f5263bbd89bc P efab605345b447e398d4ae5bbd44dd32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efab605345b447e398d4ae5bbd44dd32" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 35493 } } peers { permanent_uuid: "54772e1ff58a436ba58a0ac5bfa97a59" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 38257 } } peers { permanent_uuid: "a3d1e4c904da4a68909c233e148b45c2" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 43331 } }
I20260807 10:36:14.371914 23507 ts_tablet_manager.cc:1428] T 5e8d2b96c6564646ad64f5263bbd89bc P efab605345b447e398d4ae5bbd44dd32: Time spent starting tablet: real 0.013s user 0.009s sys 0.004s
I20260807 10:36:14.372244 23487 heartbeater.cc:503] Master 127.20.171.126:41919 was elected leader, sending a full tablet report...
I20260807 10:36:14.372525 23510 tablet_bootstrap.cc:492] T 5e8d2b96c6564646ad64f5263bbd89bc P a3d1e4c904da4a68909c233e148b45c2: No bootstrap required, opened a new log
I20260807 10:36:14.372766 23510 ts_tablet_manager.cc:1397] T 5e8d2b96c6564646ad64f5263bbd89bc P a3d1e4c904da4a68909c233e148b45c2: Time spent bootstrapping tablet: real 0.007s user 0.006s sys 0.000s
I20260807 10:36:14.378471 23509 raft_consensus.cc:348] T 5e8d2b96c6564646ad64f5263bbd89bc P 54772e1ff58a436ba58a0ac5bfa97a59 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efab605345b447e398d4ae5bbd44dd32" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 35493 } } peers { permanent_uuid: "54772e1ff58a436ba58a0ac5bfa97a59" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 38257 } } peers { permanent_uuid: "a3d1e4c904da4a68909c233e148b45c2" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 43331 } }
I20260807 10:36:14.378787 23509 raft_consensus.cc:374] T 5e8d2b96c6564646ad64f5263bbd89bc P 54772e1ff58a436ba58a0ac5bfa97a59 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:36:14.378880 23509 raft_consensus.cc:729] T 5e8d2b96c6564646ad64f5263bbd89bc P 54772e1ff58a436ba58a0ac5bfa97a59 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54772e1ff58a436ba58a0ac5bfa97a59, State: Initialized, Role: FOLLOWER
I20260807 10:36:14.379393 23509 consensus_queue.cc:260] T 5e8d2b96c6564646ad64f5263bbd89bc P 54772e1ff58a436ba58a0ac5bfa97a59 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efab605345b447e398d4ae5bbd44dd32" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 35493 } } peers { permanent_uuid: "54772e1ff58a436ba58a0ac5bfa97a59" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 38257 } } peers { permanent_uuid: "a3d1e4c904da4a68909c233e148b45c2" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 43331 } }
I20260807 10:36:14.379997 23510 raft_consensus.cc:348] T 5e8d2b96c6564646ad64f5263bbd89bc P a3d1e4c904da4a68909c233e148b45c2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efab605345b447e398d4ae5bbd44dd32" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 35493 } } peers { permanent_uuid: "54772e1ff58a436ba58a0ac5bfa97a59" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 38257 } } peers { permanent_uuid: "a3d1e4c904da4a68909c233e148b45c2" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 43331 } }
I20260807 10:36:14.380388 23346 heartbeater.cc:503] Master 127.20.171.126:41919 was elected leader, sending a full tablet report...
I20260807 10:36:14.380446 23510 raft_consensus.cc:374] T 5e8d2b96c6564646ad64f5263bbd89bc P a3d1e4c904da4a68909c233e148b45c2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:36:14.380533 23510 raft_consensus.cc:729] T 5e8d2b96c6564646ad64f5263bbd89bc P a3d1e4c904da4a68909c233e148b45c2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3d1e4c904da4a68909c233e148b45c2, State: Initialized, Role: FOLLOWER
I20260807 10:36:14.381045 23509 ts_tablet_manager.cc:1428] T 5e8d2b96c6564646ad64f5263bbd89bc P 54772e1ff58a436ba58a0ac5bfa97a59: Time spent starting tablet: real 0.011s user 0.007s sys 0.004s
I20260807 10:36:14.381067 23510 consensus_queue.cc:260] T 5e8d2b96c6564646ad64f5263bbd89bc P a3d1e4c904da4a68909c233e148b45c2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efab605345b447e398d4ae5bbd44dd32" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 35493 } } peers { permanent_uuid: "54772e1ff58a436ba58a0ac5bfa97a59" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 38257 } } peers { permanent_uuid: "a3d1e4c904da4a68909c233e148b45c2" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 43331 } }
I20260807 10:36:14.382653 23510 ts_tablet_manager.cc:1428] T 5e8d2b96c6564646ad64f5263bbd89bc P a3d1e4c904da4a68909c233e148b45c2: Time spent starting tablet: real 0.010s user 0.009s sys 0.000s
W20260807 10:36:14.475514 23202 tablet.cc:2369] T 5e8d2b96c6564646ad64f5263bbd89bc P a3d1e4c904da4a68909c233e148b45c2: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 10:36:14.478554 23347 tablet.cc:2369] T 5e8d2b96c6564646ad64f5263bbd89bc P 54772e1ff58a436ba58a0ac5bfa97a59: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 10:36:14.494277 23488 tablet.cc:2369] T 5e8d2b96c6564646ad64f5263bbd89bc P efab605345b447e398d4ae5bbd44dd32: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 10:36:14.496572 23515 raft_consensus.cc:482] T 5e8d2b96c6564646ad64f5263bbd89bc P a3d1e4c904da4a68909c233e148b45c2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 10:36:14.496829 23515 raft_consensus.cc:504] T 5e8d2b96c6564646ad64f5263bbd89bc P a3d1e4c904da4a68909c233e148b45c2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efab605345b447e398d4ae5bbd44dd32" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 35493 } } peers { permanent_uuid: "54772e1ff58a436ba58a0ac5bfa97a59" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 38257 } } peers { permanent_uuid: "a3d1e4c904da4a68909c233e148b45c2" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 43331 } }
I20260807 10:36:14.498399 23515 leader_election.cc:288] T 5e8d2b96c6564646ad64f5263bbd89bc P a3d1e4c904da4a68909c233e148b45c2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers efab605345b447e398d4ae5bbd44dd32 (127.20.171.67:35493), 54772e1ff58a436ba58a0ac5bfa97a59 (127.20.171.66:38257)
I20260807 10:36:14.505328 23502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:14.498744 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.65:53921 (local address 127.20.171.67:35493)
0807 10:36:14.498930 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:14.498934 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:14.499703 (+ 769us) server_negotiation.cc:407] Connection header received
0807 10:36:14.500079 (+ 376us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:14.500085 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:14.500171 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:14.500304 (+ 133us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:36:14.500997 (+ 693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:14.501705 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:14.503516 (+ 1811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:14.504386 (+ 870us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:14.504567 (+ 181us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:14.504642 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:14.504915 (+ 273us) server_negotiation.cc:299] Negotiation successful
0807 10:36:14.505054 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260807 10:36:14.505394 23516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:14.498763 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.67:35493 (local address 127.20.171.65:53921)
0807 10:36:14.499600 (+ 837us) negotiation.cc:107] Waiting for socket to connect
0807 10:36:14.499619 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 10:36:14.499872 (+ 253us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:36:14.500503 (+ 631us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:36:14.500506 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:36:14.500527 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:36:14.500861 (+ 334us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:14.500869 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:14.501829 (+ 960us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:14.501836 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:14.503365 (+ 1529us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:14.503378 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:14.504598 (+ 1220us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:14.504604 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:14.504760 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:14.504783 (+ 23us) client_negotiation.cc:769] Sending connection context
0807 10:36:14.504878 (+ 95us) client_negotiation.cc:240] Negotiation successful
0807 10:36:14.505031 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":626,"thread_start_us":406,"threads_started":1}
I20260807 10:36:14.505743 23506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:14.500023 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.65:52705 (local address 127.20.171.66:38257)
0807 10:36:14.500300 (+ 277us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:14.500307 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:14.500507 (+ 200us) server_negotiation.cc:407] Connection header received
0807 10:36:14.500735 (+ 228us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:14.500740 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:14.500807 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:14.500904 (+ 97us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:36:14.501439 (+ 535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:14.502124 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:14.503947 (+ 1823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:14.504803 (+ 856us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:14.504984 (+ 181us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:14.505077 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:14.505376 (+ 299us) server_negotiation.cc:299] Negotiation successful
0807 10:36:14.505500 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260807 10:36:14.505817 23517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:14.499720 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.66:38257 (local address 127.20.171.65:52705)
0807 10:36:14.500399 (+ 679us) negotiation.cc:107] Waiting for socket to connect
0807 10:36:14.500414 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 10:36:14.500588 (+ 174us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:36:14.500924 (+ 336us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:36:14.500928 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:36:14.500953 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:36:14.501276 (+ 323us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:14.501285 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:14.502312 (+ 1027us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:14.502318 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:14.503785 (+ 1467us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:14.503798 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:14.505033 (+ 1235us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:14.505039 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:14.505215 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:14.505238 (+ 23us) client_negotiation.cc:769] Sending connection context
0807 10:36:14.505347 (+ 109us) client_negotiation.cc:240] Negotiation successful
0807 10:36:14.505477 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":457,"thread_start_us":269,"threads_started":1}
I20260807 10:36:14.506531 23439 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e8d2b96c6564646ad64f5263bbd89bc" candidate_uuid: "a3d1e4c904da4a68909c233e148b45c2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efab605345b447e398d4ae5bbd44dd32" is_pre_election: true
I20260807 10:36:14.506888 23295 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e8d2b96c6564646ad64f5263bbd89bc" candidate_uuid: "a3d1e4c904da4a68909c233e148b45c2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54772e1ff58a436ba58a0ac5bfa97a59" is_pre_election: true
I20260807 10:36:14.507054 23439 raft_consensus.cc:2454] T 5e8d2b96c6564646ad64f5263bbd89bc P efab605345b447e398d4ae5bbd44dd32 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3d1e4c904da4a68909c233e148b45c2 in term 0.
I20260807 10:36:14.507364 23295 raft_consensus.cc:2454] T 5e8d2b96c6564646ad64f5263bbd89bc P 54772e1ff58a436ba58a0ac5bfa97a59 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3d1e4c904da4a68909c233e148b45c2 in term 0.
I20260807 10:36:14.507747 23079 leader_election.cc:302] T 5e8d2b96c6564646ad64f5263bbd89bc P a3d1e4c904da4a68909c233e148b45c2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a3d1e4c904da4a68909c233e148b45c2, efab605345b447e398d4ae5bbd44dd32; no voters:
I20260807 10:36:14.508152 23515 raft_consensus.cc:2781] T 5e8d2b96c6564646ad64f5263bbd89bc P a3d1e4c904da4a68909c233e148b45c2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 10:36:14.508355 23515 raft_consensus.cc:482] T 5e8d2b96c6564646ad64f5263bbd89bc P a3d1e4c904da4a68909c233e148b45c2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 10:36:14.508493 23515 raft_consensus.cc:3037] T 5e8d2b96c6564646ad64f5263bbd89bc P a3d1e4c904da4a68909c233e148b45c2 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:36:14.510895 23515 raft_consensus.cc:504] T 5e8d2b96c6564646ad64f5263bbd89bc P a3d1e4c904da4a68909c233e148b45c2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efab605345b447e398d4ae5bbd44dd32" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 35493 } } peers { permanent_uuid: "54772e1ff58a436ba58a0ac5bfa97a59" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 38257 } } peers { permanent_uuid: "a3d1e4c904da4a68909c233e148b45c2" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 43331 } }
I20260807 10:36:14.511480 23515 leader_election.cc:288] T 5e8d2b96c6564646ad64f5263bbd89bc P a3d1e4c904da4a68909c233e148b45c2 [CANDIDATE]: Term 1 election: Requested vote from peers efab605345b447e398d4ae5bbd44dd32 (127.20.171.67:35493), 54772e1ff58a436ba58a0ac5bfa97a59 (127.20.171.66:38257)
I20260807 10:36:14.511874 23439 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e8d2b96c6564646ad64f5263bbd89bc" candidate_uuid: "a3d1e4c904da4a68909c233e148b45c2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efab605345b447e398d4ae5bbd44dd32"
I20260807 10:36:14.511947 23295 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e8d2b96c6564646ad64f5263bbd89bc" candidate_uuid: "a3d1e4c904da4a68909c233e148b45c2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54772e1ff58a436ba58a0ac5bfa97a59"
I20260807 10:36:14.512061 23439 raft_consensus.cc:3037] T 5e8d2b96c6564646ad64f5263bbd89bc P efab605345b447e398d4ae5bbd44dd32 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:36:14.512187 23295 raft_consensus.cc:3037] T 5e8d2b96c6564646ad64f5263bbd89bc P 54772e1ff58a436ba58a0ac5bfa97a59 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:36:14.514302 23295 raft_consensus.cc:2454] T 5e8d2b96c6564646ad64f5263bbd89bc P 54772e1ff58a436ba58a0ac5bfa97a59 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3d1e4c904da4a68909c233e148b45c2 in term 1.
I20260807 10:36:14.514405 23439 raft_consensus.cc:2454] T 5e8d2b96c6564646ad64f5263bbd89bc P efab605345b447e398d4ae5bbd44dd32 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3d1e4c904da4a68909c233e148b45c2 in term 1.
I20260807 10:36:14.514686 23079 leader_election.cc:302] T 5e8d2b96c6564646ad64f5263bbd89bc P a3d1e4c904da4a68909c233e148b45c2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54772e1ff58a436ba58a0ac5bfa97a59, a3d1e4c904da4a68909c233e148b45c2; no voters:
I20260807 10:36:14.514984 23515 raft_consensus.cc:2781] T 5e8d2b96c6564646ad64f5263bbd89bc P a3d1e4c904da4a68909c233e148b45c2 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:36:14.515416 23515 raft_consensus.cc:686] T 5e8d2b96c6564646ad64f5263bbd89bc P a3d1e4c904da4a68909c233e148b45c2 [term 1 LEADER]: Becoming Leader. State: Replica: a3d1e4c904da4a68909c233e148b45c2, State: Running, Role: LEADER
I20260807 10:36:14.515863 23515 consensus_queue.cc:237] T 5e8d2b96c6564646ad64f5263bbd89bc P a3d1e4c904da4a68909c233e148b45c2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efab605345b447e398d4ae5bbd44dd32" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 35493 } } peers { permanent_uuid: "54772e1ff58a436ba58a0ac5bfa97a59" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 38257 } } peers { permanent_uuid: "a3d1e4c904da4a68909c233e148b45c2" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 43331 } }
I20260807 10:36:14.520354 22988 catalog_manager.cc:5495] T 5e8d2b96c6564646ad64f5263bbd89bc P a3d1e4c904da4a68909c233e148b45c2 reported cstate change: term changed from 0 to 1, leader changed from <none> to a3d1e4c904da4a68909c233e148b45c2 (127.20.171.65). New cstate: current_term: 1 leader_uuid: "a3d1e4c904da4a68909c233e148b45c2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efab605345b447e398d4ae5bbd44dd32" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 35493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54772e1ff58a436ba58a0ac5bfa97a59" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 38257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a3d1e4c904da4a68909c233e148b45c2" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 43331 } health_report { overall_health: HEALTHY } } }
Aug 07 10:36:14 dist-test-slave-0b58 krb5kdc[22940](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786098972, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.126@KRBTEST.COM for kudu/127.20.171.126@KRBTEST.COM
I20260807 10:36:14.608194 23084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:14.594723 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60888 (local address 127.20.171.126:41919)
0807 10:36:14.594937 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:14.594943 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:14.595520 (+ 577us) server_negotiation.cc:407] Connection header received
0807 10:36:14.595655 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:14.595658 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:14.595732 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:14.595810 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:36:14.596987 (+ 1177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:14.597691 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:14.598966 (+ 1275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:14.599401 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:14.599554 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:14.602867 (+ 3313us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:36:14.602872 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:36:14.602875 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:36:14.602901 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:36:14.605477 (+ 2576us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:14.606145 (+ 668us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:14.606150 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:14.606153 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:14.606306 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:14.606683 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:14.606690 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:14.606694 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:14.606957 (+ 263us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:36:14.607124 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:14.607545 (+ 421us) server_negotiation.cc:299] Negotiation successful
0807 10:36:14.607865 (+ 320us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":132,"server-negotiator.queue_time_us":58}
I20260807 10:36:14.608196 23525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:14.594820 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:41919 (local address 127.0.0.1:60888)
0807 10:36:14.595420 (+ 600us) negotiation.cc:107] Waiting for socket to connect
0807 10:36:14.595436 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 10:36:14.595559 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:36:14.595851 (+ 292us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:36:14.595854 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:36:14.596576 (+ 722us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:36:14.596861 (+ 285us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:14.596870 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:14.597812 (+ 942us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:14.597816 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:14.598770 (+ 954us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:14.598801 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:14.599599 (+ 798us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:14.599605 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:14.599790 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:14.600522 (+ 732us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:36:14.600566 (+ 44us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:36:14.602696 (+ 2130us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:36:14.605605 (+ 2909us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:36:14.605617 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:36:14.605624 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:36:14.606015 (+ 391us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:36:14.606409 (+ 394us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:36:14.606415 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:36:14.606419 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:36:14.606574 (+ 155us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:36:14.607116 (+ 542us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:36:14.607123 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:36:14.607289 (+ 166us) client_negotiation.cc:769] Sending connection context
0807 10:36:14.607460 (+ 171us) client_negotiation.cc:240] Negotiation successful
0807 10:36:14.607739 (+ 279us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":477,"thread_start_us":350,"threads_started":1}
I20260807 10:36:14.613684 22988 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.20.171.126@KRBTEST.COM'} at 127.0.0.1:60888:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260807 10:36:14.614795 22988 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 10:36:14.621928 23129 tablet_service.cc:1467] Processing CreateTablet for tablet cec25a826e194f58a0696737b18c9dde (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=c1f5afacaa9349e3b4b9e4c3bcf3410b]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 10:36:14.622058 23274 tablet_service.cc:1467] Processing CreateTablet for tablet cec25a826e194f58a0696737b18c9dde (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=c1f5afacaa9349e3b4b9e4c3bcf3410b]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 10:36:14.622390 23415 tablet_service.cc:1467] Processing CreateTablet for tablet cec25a826e194f58a0696737b18c9dde (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=c1f5afacaa9349e3b4b9e4c3bcf3410b]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 10:36:14.622851 23129 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cec25a826e194f58a0696737b18c9dde. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:36:14.623059 23274 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cec25a826e194f58a0696737b18c9dde. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:36:14.623169 23415 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cec25a826e194f58a0696737b18c9dde. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:36:14.628825 23510 tablet_bootstrap.cc:492] T cec25a826e194f58a0696737b18c9dde P a3d1e4c904da4a68909c233e148b45c2: Bootstrap starting.
I20260807 10:36:14.630241 23507 tablet_bootstrap.cc:492] T cec25a826e194f58a0696737b18c9dde P efab605345b447e398d4ae5bbd44dd32: Bootstrap starting.
I20260807 10:36:14.630278 23509 tablet_bootstrap.cc:492] T cec25a826e194f58a0696737b18c9dde P 54772e1ff58a436ba58a0ac5bfa97a59: Bootstrap starting.
I20260807 10:36:14.630313 23510 tablet_bootstrap.cc:654] T cec25a826e194f58a0696737b18c9dde P a3d1e4c904da4a68909c233e148b45c2: Neither blocks nor log segments found. Creating new log.
I20260807 10:36:14.632054 23507 tablet_bootstrap.cc:654] T cec25a826e194f58a0696737b18c9dde P efab605345b447e398d4ae5bbd44dd32: Neither blocks nor log segments found. Creating new log.
I20260807 10:36:14.632050 23509 tablet_bootstrap.cc:654] T cec25a826e194f58a0696737b18c9dde P 54772e1ff58a436ba58a0ac5bfa97a59: Neither blocks nor log segments found. Creating new log.
I20260807 10:36:14.632828 23510 tablet_bootstrap.cc:492] T cec25a826e194f58a0696737b18c9dde P a3d1e4c904da4a68909c233e148b45c2: No bootstrap required, opened a new log
I20260807 10:36:14.632979 23510 ts_tablet_manager.cc:1397] T cec25a826e194f58a0696737b18c9dde P a3d1e4c904da4a68909c233e148b45c2: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260807 10:36:14.633595 23510 raft_consensus.cc:348] T cec25a826e194f58a0696737b18c9dde P a3d1e4c904da4a68909c233e148b45c2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3d1e4c904da4a68909c233e148b45c2" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 43331 } } peers { permanent_uuid: "54772e1ff58a436ba58a0ac5bfa97a59" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 38257 } } peers { permanent_uuid: "efab605345b447e398d4ae5bbd44dd32" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 35493 } }
I20260807 10:36:14.633805 23510 raft_consensus.cc:374] T cec25a826e194f58a0696737b18c9dde P a3d1e4c904da4a68909c233e148b45c2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:36:14.633901 23510 raft_consensus.cc:729] T cec25a826e194f58a0696737b18c9dde P a3d1e4c904da4a68909c233e148b45c2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3d1e4c904da4a68909c233e148b45c2, State: Initialized, Role: FOLLOWER
I20260807 10:36:14.634141 23510 consensus_queue.cc:260] T cec25a826e194f58a0696737b18c9dde P a3d1e4c904da4a68909c233e148b45c2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3d1e4c904da4a68909c233e148b45c2" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 43331 } } peers { permanent_uuid: "54772e1ff58a436ba58a0ac5bfa97a59" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 38257 } } peers { permanent_uuid: "efab605345b447e398d4ae5bbd44dd32" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 35493 } }
I20260807 10:36:14.634728 23510 ts_tablet_manager.cc:1428] T cec25a826e194f58a0696737b18c9dde P a3d1e4c904da4a68909c233e148b45c2: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260807 10:36:14.634579 23515 tablet_replica.cc:439] T cec25a826e194f58a0696737b18c9dde P a3d1e4c904da4a68909c233e148b45c2: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3d1e4c904da4a68909c233e148b45c2" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 43331 } } peers { permanent_uuid: "54772e1ff58a436ba58a0ac5bfa97a59" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 38257 } } peers { permanent_uuid: "efab605345b447e398d4ae5bbd44dd32" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 35493 } } }
I20260807 10:36:14.634892 23515 tablet_replica.cc:442] T cec25a826e194f58a0696737b18c9dde P a3d1e4c904da4a68909c233e148b45c2: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 10:36:14.641816 23507 tablet_bootstrap.cc:492] T cec25a826e194f58a0696737b18c9dde P efab605345b447e398d4ae5bbd44dd32: No bootstrap required, opened a new log
I20260807 10:36:14.641816 23509 tablet_bootstrap.cc:492] T cec25a826e194f58a0696737b18c9dde P 54772e1ff58a436ba58a0ac5bfa97a59: No bootstrap required, opened a new log
I20260807 10:36:14.641979 23507 ts_tablet_manager.cc:1397] T cec25a826e194f58a0696737b18c9dde P efab605345b447e398d4ae5bbd44dd32: Time spent bootstrapping tablet: real 0.012s user 0.003s sys 0.007s
I20260807 10:36:14.642307 23509 ts_tablet_manager.cc:1397] T cec25a826e194f58a0696737b18c9dde P 54772e1ff58a436ba58a0ac5bfa97a59: Time spent bootstrapping tablet: real 0.012s user 0.005s sys 0.006s
I20260807 10:36:14.643030 23507 raft_consensus.cc:348] T cec25a826e194f58a0696737b18c9dde P efab605345b447e398d4ae5bbd44dd32 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3d1e4c904da4a68909c233e148b45c2" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 43331 } } peers { permanent_uuid: "54772e1ff58a436ba58a0ac5bfa97a59" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 38257 } } peers { permanent_uuid: "efab605345b447e398d4ae5bbd44dd32" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 35493 } }
I20260807 10:36:14.643049 23509 raft_consensus.cc:348] T cec25a826e194f58a0696737b18c9dde P 54772e1ff58a436ba58a0ac5bfa97a59 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3d1e4c904da4a68909c233e148b45c2" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 43331 } } peers { permanent_uuid: "54772e1ff58a436ba58a0ac5bfa97a59" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 38257 } } peers { permanent_uuid: "efab605345b447e398d4ae5bbd44dd32" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 35493 } }
I20260807 10:36:14.643317 23507 raft_consensus.cc:374] T cec25a826e194f58a0696737b18c9dde P efab605345b447e398d4ae5bbd44dd32 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:36:14.643337 23509 raft_consensus.cc:374] T cec25a826e194f58a0696737b18c9dde P 54772e1ff58a436ba58a0ac5bfa97a59 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:36:14.643441 23507 raft_consensus.cc:729] T cec25a826e194f58a0696737b18c9dde P efab605345b447e398d4ae5bbd44dd32 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efab605345b447e398d4ae5bbd44dd32, State: Initialized, Role: FOLLOWER
I20260807 10:36:14.643448 23509 raft_consensus.cc:729] T cec25a826e194f58a0696737b18c9dde P 54772e1ff58a436ba58a0ac5bfa97a59 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54772e1ff58a436ba58a0ac5bfa97a59, State: Initialized, Role: FOLLOWER
I20260807 10:36:14.643695 23507 consensus_queue.cc:260] T cec25a826e194f58a0696737b18c9dde P efab605345b447e398d4ae5bbd44dd32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3d1e4c904da4a68909c233e148b45c2" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 43331 } } peers { permanent_uuid: "54772e1ff58a436ba58a0ac5bfa97a59" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 38257 } } peers { permanent_uuid: "efab605345b447e398d4ae5bbd44dd32" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 35493 } }
I20260807 10:36:14.643678 23509 consensus_queue.cc:260] T cec25a826e194f58a0696737b18c9dde P 54772e1ff58a436ba58a0ac5bfa97a59 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3d1e4c904da4a68909c233e148b45c2" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 43331 } } peers { permanent_uuid: "54772e1ff58a436ba58a0ac5bfa97a59" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 38257 } } peers { permanent_uuid: "efab605345b447e398d4ae5bbd44dd32" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 35493 } }
I20260807 10:36:14.644289 23509 ts_tablet_manager.cc:1428] T cec25a826e194f58a0696737b18c9dde P 54772e1ff58a436ba58a0ac5bfa97a59: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260807 10:36:14.644358 23507 ts_tablet_manager.cc:1428] T cec25a826e194f58a0696737b18c9dde P efab605345b447e398d4ae5bbd44dd32: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260807 10:36:14.644210 23513 tablet_replica.cc:439] T cec25a826e194f58a0696737b18c9dde P efab605345b447e398d4ae5bbd44dd32: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3d1e4c904da4a68909c233e148b45c2" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 43331 } } peers { permanent_uuid: "54772e1ff58a436ba58a0ac5bfa97a59" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 38257 } } peers { permanent_uuid: "efab605345b447e398d4ae5bbd44dd32" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 35493 } } }
I20260807 10:36:14.644622 23513 tablet_replica.cc:442] T cec25a826e194f58a0696737b18c9dde P efab605345b447e398d4ae5bbd44dd32: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 10:36:14.644791 23514 tablet_replica.cc:439] T cec25a826e194f58a0696737b18c9dde P 54772e1ff58a436ba58a0ac5bfa97a59: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3d1e4c904da4a68909c233e148b45c2" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 43331 } } peers { permanent_uuid: "54772e1ff58a436ba58a0ac5bfa97a59" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 38257 } } peers { permanent_uuid: "efab605345b447e398d4ae5bbd44dd32" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 35493 } } }
I20260807 10:36:14.645220 23514 tablet_replica.cc:442] T cec25a826e194f58a0696737b18c9dde P 54772e1ff58a436ba58a0ac5bfa97a59: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 10:36:14.683485 23513 raft_consensus.cc:482] T cec25a826e194f58a0696737b18c9dde P efab605345b447e398d4ae5bbd44dd32 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 10:36:14.683720 23513 raft_consensus.cc:504] T cec25a826e194f58a0696737b18c9dde P efab605345b447e398d4ae5bbd44dd32 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3d1e4c904da4a68909c233e148b45c2" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 43331 } } peers { permanent_uuid: "54772e1ff58a436ba58a0ac5bfa97a59" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 38257 } } peers { permanent_uuid: "efab605345b447e398d4ae5bbd44dd32" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 35493 } }
I20260807 10:36:14.685240 23513 leader_election.cc:288] T cec25a826e194f58a0696737b18c9dde P efab605345b447e398d4ae5bbd44dd32 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3d1e4c904da4a68909c233e148b45c2 (127.20.171.65:43331), 54772e1ff58a436ba58a0ac5bfa97a59 (127.20.171.66:38257)
I20260807 10:36:14.691895 23504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:14.685640 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.67:54231 (local address 127.20.171.65:43331)
0807 10:36:14.686209 (+ 569us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:14.686217 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:14.686239 (+ 22us) server_negotiation.cc:407] Connection header received
0807 10:36:14.686316 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:14.686320 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:14.686420 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:14.686518 (+ 98us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:36:14.687048 (+ 530us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:14.688073 (+ 1025us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:14.689991 (+ 1918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:14.691066 (+ 1075us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:14.691184 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:14.691243 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:14.691604 (+ 361us) server_negotiation.cc:299] Negotiation successful
0807 10:36:14.691691 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":377}
I20260807 10:36:14.692077 23374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:14.685469 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.65:43331 (local address 127.20.171.67:54231)
0807 10:36:14.685780 (+ 311us) negotiation.cc:107] Waiting for socket to connect
0807 10:36:14.685800 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0807 10:36:14.685920 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:36:14.686559 (+ 639us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:36:14.686564 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:36:14.686594 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:36:14.686880 (+ 286us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:14.686894 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:14.688230 (+ 1336us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:14.688237 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:14.689828 (+ 1591us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:14.689841 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:14.691227 (+ 1386us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:14.691232 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:14.691441 (+ 209us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:14.691478 (+ 37us) client_negotiation.cc:769] Sending connection context
0807 10:36:14.691577 (+ 99us) client_negotiation.cc:240] Negotiation successful
0807 10:36:14.691715 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":173,"mutex_wait_us":27,"spinlock_wait_cycles":64384}
I20260807 10:36:14.692930 23529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:14.685653 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.66:38257 (local address 127.20.171.67:53041)
0807 10:36:14.686502 (+ 849us) negotiation.cc:107] Waiting for socket to connect
0807 10:36:14.686518 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 10:36:14.686743 (+ 225us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:36:14.687165 (+ 422us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:36:14.687171 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:36:14.687199 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:36:14.687595 (+ 396us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:14.687608 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:14.688950 (+ 1342us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:14.688954 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:14.690576 (+ 1622us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:14.690591 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:14.692013 (+ 1422us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:14.692019 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:14.692262 (+ 243us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:14.692334 (+ 72us) client_negotiation.cc:769] Sending connection context
0807 10:36:14.692425 (+ 91us) client_negotiation.cc:240] Negotiation successful
0807 10:36:14.692551 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":722,"mutex_wait_us":1,"spinlock_wait_cycles":896,"thread_start_us":549,"threads_started":1}
I20260807 10:36:14.692941 23506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:14.685869 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.67:53041 (local address 127.20.171.66:38257)
0807 10:36:14.686054 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:14.686061 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:14.686592 (+ 531us) server_negotiation.cc:407] Connection header received
0807 10:36:14.686911 (+ 319us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:14.686916 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:14.687028 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:14.687107 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:36:14.687763 (+ 656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:14.688803 (+ 1040us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:14.690739 (+ 1936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:14.691778 (+ 1039us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:14.691927 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:14.691995 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:14.692522 (+ 527us) server_negotiation.cc:299] Negotiation successful
0807 10:36:14.692667 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260807 10:36:14.693048 23156 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cec25a826e194f58a0696737b18c9dde" candidate_uuid: "efab605345b447e398d4ae5bbd44dd32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3d1e4c904da4a68909c233e148b45c2" is_pre_election: true
I20260807 10:36:14.693553 23156 raft_consensus.cc:2454] T cec25a826e194f58a0696737b18c9dde P a3d1e4c904da4a68909c233e148b45c2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efab605345b447e398d4ae5bbd44dd32 in term 0.
I20260807 10:36:14.693799 23295 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cec25a826e194f58a0696737b18c9dde" candidate_uuid: "efab605345b447e398d4ae5bbd44dd32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54772e1ff58a436ba58a0ac5bfa97a59" is_pre_election: true
I20260807 10:36:14.694087 23295 raft_consensus.cc:2454] T cec25a826e194f58a0696737b18c9dde P 54772e1ff58a436ba58a0ac5bfa97a59 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efab605345b447e398d4ae5bbd44dd32 in term 0.
I20260807 10:36:14.694279 23366 leader_election.cc:302] T cec25a826e194f58a0696737b18c9dde P efab605345b447e398d4ae5bbd44dd32 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a3d1e4c904da4a68909c233e148b45c2, efab605345b447e398d4ae5bbd44dd32; no voters:
I20260807 10:36:14.694682 23513 raft_consensus.cc:2781] T cec25a826e194f58a0696737b18c9dde P efab605345b447e398d4ae5bbd44dd32 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 10:36:14.694811 23513 raft_consensus.cc:482] T cec25a826e194f58a0696737b18c9dde P efab605345b447e398d4ae5bbd44dd32 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 10:36:14.694931 23513 raft_consensus.cc:3037] T cec25a826e194f58a0696737b18c9dde P efab605345b447e398d4ae5bbd44dd32 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:36:14.697157 23513 raft_consensus.cc:504] T cec25a826e194f58a0696737b18c9dde P efab605345b447e398d4ae5bbd44dd32 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3d1e4c904da4a68909c233e148b45c2" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 43331 } } peers { permanent_uuid: "54772e1ff58a436ba58a0ac5bfa97a59" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 38257 } } peers { permanent_uuid: "efab605345b447e398d4ae5bbd44dd32" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 35493 } }
I20260807 10:36:14.697719 23513 leader_election.cc:288] T cec25a826e194f58a0696737b18c9dde P efab605345b447e398d4ae5bbd44dd32 [CANDIDATE]: Term 1 election: Requested vote from peers a3d1e4c904da4a68909c233e148b45c2 (127.20.171.65:43331), 54772e1ff58a436ba58a0ac5bfa97a59 (127.20.171.66:38257)
I20260807 10:36:14.698099 23156 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cec25a826e194f58a0696737b18c9dde" candidate_uuid: "efab605345b447e398d4ae5bbd44dd32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3d1e4c904da4a68909c233e148b45c2"
I20260807 10:36:14.698175 23295 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cec25a826e194f58a0696737b18c9dde" candidate_uuid: "efab605345b447e398d4ae5bbd44dd32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54772e1ff58a436ba58a0ac5bfa97a59"
I20260807 10:36:14.698300 23156 raft_consensus.cc:3037] T cec25a826e194f58a0696737b18c9dde P a3d1e4c904da4a68909c233e148b45c2 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:36:14.698432 23295 raft_consensus.cc:3037] T cec25a826e194f58a0696737b18c9dde P 54772e1ff58a436ba58a0ac5bfa97a59 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:36:14.700665 23295 raft_consensus.cc:2454] T cec25a826e194f58a0696737b18c9dde P 54772e1ff58a436ba58a0ac5bfa97a59 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efab605345b447e398d4ae5bbd44dd32 in term 1.
I20260807 10:36:14.700717 23156 raft_consensus.cc:2454] T cec25a826e194f58a0696737b18c9dde P a3d1e4c904da4a68909c233e148b45c2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efab605345b447e398d4ae5bbd44dd32 in term 1.
I20260807 10:36:14.701083 23368 leader_election.cc:302] T cec25a826e194f58a0696737b18c9dde P efab605345b447e398d4ae5bbd44dd32 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54772e1ff58a436ba58a0ac5bfa97a59, efab605345b447e398d4ae5bbd44dd32; no voters:
I20260807 10:36:14.701392 23513 raft_consensus.cc:2781] T cec25a826e194f58a0696737b18c9dde P efab605345b447e398d4ae5bbd44dd32 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:36:14.701963 23513 raft_consensus.cc:686] T cec25a826e194f58a0696737b18c9dde P efab605345b447e398d4ae5bbd44dd32 [term 1 LEADER]: Becoming Leader. State: Replica: efab605345b447e398d4ae5bbd44dd32, State: Running, Role: LEADER
I20260807 10:36:14.702699 23513 consensus_queue.cc:237] T cec25a826e194f58a0696737b18c9dde P efab605345b447e398d4ae5bbd44dd32 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3d1e4c904da4a68909c233e148b45c2" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 43331 } } peers { permanent_uuid: "54772e1ff58a436ba58a0ac5bfa97a59" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 38257 } } peers { permanent_uuid: "efab605345b447e398d4ae5bbd44dd32" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 35493 } }
I20260807 10:36:14.705519 23530 tablet_replica.cc:439] T cec25a826e194f58a0696737b18c9dde P efab605345b447e398d4ae5bbd44dd32: TxnStatusTablet state changed. Reason: New leader efab605345b447e398d4ae5bbd44dd32. Latest consensus state: current_term: 1 leader_uuid: "efab605345b447e398d4ae5bbd44dd32" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3d1e4c904da4a68909c233e148b45c2" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 43331 } } peers { permanent_uuid: "54772e1ff58a436ba58a0ac5bfa97a59" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 38257 } } peers { permanent_uuid: "efab605345b447e398d4ae5bbd44dd32" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 35493 } } }
I20260807 10:36:14.705854 23530 tablet_replica.cc:442] T cec25a826e194f58a0696737b18c9dde P efab605345b447e398d4ae5bbd44dd32: This TxnStatusTablet replica's current role is: LEADER
I20260807 10:36:14.706663 23532 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260807 10:36:14.706931 23532 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260807 10:36:14.707484 22988 catalog_manager.cc:5495] T cec25a826e194f58a0696737b18c9dde P efab605345b447e398d4ae5bbd44dd32 reported cstate change: term changed from 0 to 1, leader changed from <none> to efab605345b447e398d4ae5bbd44dd32 (127.20.171.67). New cstate: current_term: 1 leader_uuid: "efab605345b447e398d4ae5bbd44dd32" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3d1e4c904da4a68909c233e148b45c2" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 43331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54772e1ff58a436ba58a0ac5bfa97a59" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 38257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efab605345b447e398d4ae5bbd44dd32" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 35493 } health_report { overall_health: HEALTHY } } }
I20260807 10:36:14.737586 23502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:14.730310 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52486 (local address 127.20.171.67:35493)
0807 10:36:14.730514 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:14.730520 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:14.730654 (+ 134us) server_negotiation.cc:407] Connection header received
0807 10:36:14.730888 (+ 234us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:14.730896 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:14.731012 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:14.731169 (+ 157us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 10:36:14.731794 (+ 625us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:14.732971 (+ 1177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:14.734898 (+ 1927us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:14.735623 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:14.735740 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:14.736304 (+ 564us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 10:36:14.736905 (+ 601us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 10:36:14.737083 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:14.737201 (+ 118us) server_negotiation.cc:299] Negotiation successful
0807 10:36:14.737284 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260807 10:36:14.737656 23525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:14.730296 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.67:35493 (local address 127.0.0.1:52486)
0807 10:36:14.730564 (+ 268us) negotiation.cc:107] Waiting for socket to connect
0807 10:36:14.730581 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 10:36:14.730700 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:36:14.731366 (+ 666us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:36:14.731371 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:36:14.731386 (+ 15us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 10:36:14.731597 (+ 211us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:14.731612 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:14.733147 (+ 1535us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:14.733153 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:14.734746 (+ 1593us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:14.734762 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:14.735781 (+ 1019us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:14.735787 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:14.736005 (+ 218us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:14.736074 (+ 69us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 10:36:14.737044 (+ 970us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 10:36:14.737069 (+ 25us) client_negotiation.cc:769] Sending connection context
0807 10:36:14.737163 (+ 94us) client_negotiation.cc:240] Negotiation successful
0807 10:36:14.737333 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":52}
I20260807 10:36:14.745544 23295 raft_consensus.cc:1261] T cec25a826e194f58a0696737b18c9dde P 54772e1ff58a436ba58a0ac5bfa97a59 [term 1 FOLLOWER]: Refusing update from remote peer efab605345b447e398d4ae5bbd44dd32: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 10:36:14.745661 23156 raft_consensus.cc:1261] T cec25a826e194f58a0696737b18c9dde P a3d1e4c904da4a68909c233e148b45c2 [term 1 FOLLOWER]: Refusing update from remote peer efab605345b447e398d4ae5bbd44dd32: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 10:36:14.746542 23513 consensus_queue.cc:1035] T cec25a826e194f58a0696737b18c9dde P efab605345b447e398d4ae5bbd44dd32 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54772e1ff58a436ba58a0ac5bfa97a59" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 38257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 10:36:14.746953 23530 consensus_queue.cc:1035] T cec25a826e194f58a0696737b18c9dde P efab605345b447e398d4ae5bbd44dd32 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3d1e4c904da4a68909c233e148b45c2" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 43331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 10:36:14.758106 23515 tablet_replica.cc:439] T cec25a826e194f58a0696737b18c9dde P a3d1e4c904da4a68909c233e148b45c2: TxnStatusTablet state changed. Reason: New leader efab605345b447e398d4ae5bbd44dd32. Latest consensus state: current_term: 1 leader_uuid: "efab605345b447e398d4ae5bbd44dd32" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3d1e4c904da4a68909c233e148b45c2" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 43331 } } peers { permanent_uuid: "54772e1ff58a436ba58a0ac5bfa97a59" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 38257 } } peers { permanent_uuid: "efab605345b447e398d4ae5bbd44dd32" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 35493 } } }
I20260807 10:36:14.758556 23515 tablet_replica.cc:442] T cec25a826e194f58a0696737b18c9dde P a3d1e4c904da4a68909c233e148b45c2: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 10:36:14.761214 23515 tablet_replica.cc:439] T cec25a826e194f58a0696737b18c9dde P a3d1e4c904da4a68909c233e148b45c2: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "efab605345b447e398d4ae5bbd44dd32" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3d1e4c904da4a68909c233e148b45c2" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 43331 } } peers { permanent_uuid: "54772e1ff58a436ba58a0ac5bfa97a59" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 38257 } } peers { permanent_uuid: "efab605345b447e398d4ae5bbd44dd32" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 35493 } } }
I20260807 10:36:14.761499 23515 tablet_replica.cc:442] T cec25a826e194f58a0696737b18c9dde P a3d1e4c904da4a68909c233e148b45c2: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 10:36:14.763264 23530 tablet_replica.cc:439] T cec25a826e194f58a0696737b18c9dde P efab605345b447e398d4ae5bbd44dd32: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "efab605345b447e398d4ae5bbd44dd32" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3d1e4c904da4a68909c233e148b45c2" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 43331 } } peers { permanent_uuid: "54772e1ff58a436ba58a0ac5bfa97a59" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 38257 } } peers { permanent_uuid: "efab605345b447e398d4ae5bbd44dd32" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 35493 } } }
I20260807 10:36:14.763537 23530 tablet_replica.cc:442] T cec25a826e194f58a0696737b18c9dde P efab605345b447e398d4ae5bbd44dd32: This TxnStatusTablet replica's current role is: LEADER
I20260807 10:36:14.763417 23514 tablet_replica.cc:439] T cec25a826e194f58a0696737b18c9dde P 54772e1ff58a436ba58a0ac5bfa97a59: TxnStatusTablet state changed. Reason: New leader efab605345b447e398d4ae5bbd44dd32. Latest consensus state: current_term: 1 leader_uuid: "efab605345b447e398d4ae5bbd44dd32" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3d1e4c904da4a68909c233e148b45c2" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 43331 } } peers { permanent_uuid: "54772e1ff58a436ba58a0ac5bfa97a59" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 38257 } } peers { permanent_uuid: "efab605345b447e398d4ae5bbd44dd32" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 35493 } } }
I20260807 10:36:14.763713 23514 tablet_replica.cc:442] T cec25a826e194f58a0696737b18c9dde P 54772e1ff58a436ba58a0ac5bfa97a59: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 10:36:14.763785 23530 tablet_replica.cc:439] T cec25a826e194f58a0696737b18c9dde P efab605345b447e398d4ae5bbd44dd32: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "efab605345b447e398d4ae5bbd44dd32" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3d1e4c904da4a68909c233e148b45c2" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 43331 } } peers { permanent_uuid: "54772e1ff58a436ba58a0ac5bfa97a59" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 38257 } } peers { permanent_uuid: "efab605345b447e398d4ae5bbd44dd32" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 35493 } } }
I20260807 10:36:14.764321 23530 tablet_replica.cc:442] T cec25a826e194f58a0696737b18c9dde P efab605345b447e398d4ae5bbd44dd32: This TxnStatusTablet replica's current role is: LEADER
I20260807 10:36:14.766530 23536 mvcc.cc:205] Tried to move back new op lower bound from 7315861400548708352 to 7315861400385880064. Current Snapshot: MvccSnapshot[applied={T|T < 7315861400548708352}]
I20260807 10:36:14.766723 23535 mvcc.cc:205] Tried to move back new op lower bound from 7315861400548708352 to 7315861400385880064. Current Snapshot: MvccSnapshot[applied={T|T < 7315861400548708352 or (T in {7315861400548708352})}]
I20260807 10:36:14.774596 23514 tablet_replica.cc:439] T cec25a826e194f58a0696737b18c9dde P 54772e1ff58a436ba58a0ac5bfa97a59: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "efab605345b447e398d4ae5bbd44dd32" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3d1e4c904da4a68909c233e148b45c2" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 43331 } } peers { permanent_uuid: "54772e1ff58a436ba58a0ac5bfa97a59" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 38257 } } peers { permanent_uuid: "efab605345b447e398d4ae5bbd44dd32" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 35493 } } }
I20260807 10:36:14.774857 23514 tablet_replica.cc:442] T cec25a826e194f58a0696737b18c9dde P 54772e1ff58a436ba58a0ac5bfa97a59: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 10:36:14.780550 23504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:14.774485 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57154 (local address 127.20.171.65:43331)
0807 10:36:14.774653 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:14.774660 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:14.775200 (+ 540us) server_negotiation.cc:407] Connection header received
0807 10:36:14.775375 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:14.775378 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:14.775481 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:14.775618 (+ 137us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 10:36:14.776188 (+ 570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:14.777211 (+ 1023us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:14.778475 (+ 1264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:14.778876 (+ 401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:14.779014 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:14.779432 (+ 418us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 10:36:14.779899 (+ 467us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 10:36:14.780056 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:14.780134 (+ 78us) server_negotiation.cc:299] Negotiation successful
0807 10:36:14.780242 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260807 10:36:14.802250 23502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:14.790914 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.65:58739 (local address 127.20.171.67:35493)
0807 10:36:14.791155 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:14.791164 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:14.796893 (+ 5729us) server_negotiation.cc:407] Connection header received
0807 10:36:14.797041 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:14.797047 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:14.797148 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:14.797248 (+ 100us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 10:36:14.797712 (+ 464us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:14.798878 (+ 1166us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:14.800391 (+ 1513us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:14.800926 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:14.801074 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:14.801524 (+ 450us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 10:36:14.801621 (+ 97us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 10:36:14.801718 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:14.801841 (+ 123us) server_negotiation.cc:299] Negotiation successful
0807 10:36:14.801922 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260807 10:36:14.802342 23547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:14.790903 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.67:35493 (local address 127.20.171.65:58739)
0807 10:36:14.796790 (+ 5887us) negotiation.cc:107] Waiting for socket to connect
0807 10:36:14.796809 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 10:36:14.796922 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:36:14.797275 (+ 353us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:36:14.797278 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:36:14.797287 (+ 9us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 10:36:14.797555 (+ 268us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:14.797562 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:14.799038 (+ 1476us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:14.799042 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:14.800193 (+ 1151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:14.800210 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:14.801119 (+ 909us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:14.801128 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:14.801261 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:14.801312 (+ 51us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 10:36:14.801714 (+ 402us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 10:36:14.801727 (+ 13us) client_negotiation.cc:769] Sending connection context
0807 10:36:14.801819 (+ 92us) client_negotiation.cc:240] Negotiation successful
0807 10:36:14.801947 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5726,"thread_start_us":5560,"threads_started":1}
I20260807 10:36:14.811949 23295 raft_consensus.cc:1261] T 5e8d2b96c6564646ad64f5263bbd89bc P 54772e1ff58a436ba58a0ac5bfa97a59 [term 1 FOLLOWER]: Refusing update from remote peer a3d1e4c904da4a68909c233e148b45c2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 10:36:14.812306 23439 raft_consensus.cc:1261] T 5e8d2b96c6564646ad64f5263bbd89bc P efab605345b447e398d4ae5bbd44dd32 [term 1 FOLLOWER]: Refusing update from remote peer a3d1e4c904da4a68909c233e148b45c2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 10:36:14.812590 23518 consensus_queue.cc:1035] T 5e8d2b96c6564646ad64f5263bbd89bc P a3d1e4c904da4a68909c233e148b45c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54772e1ff58a436ba58a0ac5bfa97a59" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 38257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 10:36:14.813001 23515 consensus_queue.cc:1035] T 5e8d2b96c6564646ad64f5263bbd89bc P a3d1e4c904da4a68909c233e148b45c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efab605345b447e398d4ae5bbd44dd32" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 35493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 10:36:14.849537 23504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:14.843103 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.67:60727 (local address 127.20.171.65:43331)
0807 10:36:14.843271 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:14.843275 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:14.843796 (+ 521us) server_negotiation.cc:407] Connection header received
0807 10:36:14.844019 (+ 223us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:14.844024 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:14.844097 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:14.844196 (+ 99us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 10:36:14.844769 (+ 573us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:14.845710 (+ 941us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:14.847673 (+ 1963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:14.848223 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:14.848380 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:14.848869 (+ 489us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 10:36:14.848971 (+ 102us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 10:36:14.849060 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:14.849174 (+ 114us) server_negotiation.cc:299] Negotiation successful
0807 10:36:14.849248 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260807 10:36:14.849874 23551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:14.843008 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.65:43331 (local address 127.20.171.67:60727)
0807 10:36:14.843694 (+ 686us) negotiation.cc:107] Waiting for socket to connect
0807 10:36:14.843714 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0807 10:36:14.843892 (+ 178us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:36:14.844225 (+ 333us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:36:14.844230 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:36:14.844247 (+ 17us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 10:36:14.844594 (+ 347us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:14.844603 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:14.845830 (+ 1227us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:14.845835 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:14.847459 (+ 1624us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:14.847476 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:14.848440 (+ 964us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:14.848447 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:14.848619 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:14.848695 (+ 76us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 10:36:14.849062 (+ 367us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 10:36:14.849076 (+ 14us) client_negotiation.cc:769] Sending connection context
0807 10:36:14.849154 (+ 78us) client_negotiation.cc:240] Negotiation successful
0807 10:36:14.849287 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":517,"thread_start_us":380,"threads_started":1}
I20260807 10:36:14.890714 22988 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60872:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 10:36:14.891013 22988 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60872:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 10:36:14.895104 22988 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 95c5073aefc9420fa0091dba7c7479a1: Sending DeleteTablet for 3 replicas of tablet 5e8d2b96c6564646ad64f5263bbd89bc
I20260807 10:36:14.896574 23415 tablet_service.cc:1514] Processing DeleteTablet for tablet 5e8d2b96c6564646ad64f5263bbd89bc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:36:14 UTC) from {username='kudu', principal='kudu/127.20.171.126@KRBTEST.COM'} at 127.0.0.1:52484
I20260807 10:36:14.897276 23129 tablet_service.cc:1514] Processing DeleteTablet for tablet 5e8d2b96c6564646ad64f5263bbd89bc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:36:14 UTC) from {username='kudu', principal='kudu/127.20.171.126@KRBTEST.COM'} at 127.0.0.1:57140
I20260807 10:36:14.897518 23555 tablet_replica.cc:330] T 5e8d2b96c6564646ad64f5263bbd89bc P efab605345b447e398d4ae5bbd44dd32: stopping tablet replica
I20260807 10:36:14.897923 23555 raft_consensus.cc:2229] T 5e8d2b96c6564646ad64f5263bbd89bc P efab605345b447e398d4ae5bbd44dd32 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 10:36:14.898111 23274 tablet_service.cc:1514] Processing DeleteTablet for tablet 5e8d2b96c6564646ad64f5263bbd89bc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:36:14 UTC) from {username='kudu', principal='kudu/127.20.171.126@KRBTEST.COM'} at 127.0.0.1:60488
I20260807 10:36:14.898332 23555 raft_consensus.cc:2258] T 5e8d2b96c6564646ad64f5263bbd89bc P efab605345b447e398d4ae5bbd44dd32 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:36:14.900012 22988 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60872:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 10:36:14.900373 23555 ts_tablet_manager.cc:1905] T 5e8d2b96c6564646ad64f5263bbd89bc P efab605345b447e398d4ae5bbd44dd32: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260807 10:36:14.900719 22988 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 10:36:14.908015 23555 ts_tablet_manager.cc:1918] T 5e8d2b96c6564646ad64f5263bbd89bc P efab605345b447e398d4ae5bbd44dd32: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 10:36:14.908294 23555 log.cc:1196] T 5e8d2b96c6564646ad64f5263bbd89bc P efab605345b447e398d4ae5bbd44dd32: Deleting WAL directory at /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786098956060137-21165-0/minicluster-data/ts-2/wal/wals/5e8d2b96c6564646ad64f5263bbd89bc
I20260807 10:36:14.908989 23555 ts_tablet_manager.cc:1939] T 5e8d2b96c6564646ad64f5263bbd89bc P efab605345b447e398d4ae5bbd44dd32: Deleting consensus metadata
I20260807 10:36:14.911640 23128 tablet_service.cc:1467] Processing CreateTablet for tablet 2c0dcc4029e74305bbe3ee420db2dcc0 (DEFAULT_TABLE table=test-table [id=780c44ce180a46cd83e8e218233b34f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:36:14.912390 23128 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2c0dcc4029e74305bbe3ee420db2dcc0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:36:14.917369 22972 catalog_manager.cc:4841] TS efab605345b447e398d4ae5bbd44dd32 (127.20.171.67:35493): tablet 5e8d2b96c6564646ad64f5263bbd89bc (table test-table [id=8156b58d80be42fdabc54f6b8a203bb2]) successfully deleted
I20260807 10:36:14.917912 23273 tablet_service.cc:1467] Processing CreateTablet for tablet 2c0dcc4029e74305bbe3ee420db2dcc0 (DEFAULT_TABLE table=test-table [id=780c44ce180a46cd83e8e218233b34f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:36:14.918411 23273 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2c0dcc4029e74305bbe3ee420db2dcc0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:36:14.922593 23510 tablet_bootstrap.cc:492] T 2c0dcc4029e74305bbe3ee420db2dcc0 P a3d1e4c904da4a68909c233e148b45c2: Bootstrap starting.
I20260807 10:36:14.924573 23510 tablet_bootstrap.cc:654] T 2c0dcc4029e74305bbe3ee420db2dcc0 P a3d1e4c904da4a68909c233e148b45c2: Neither blocks nor log segments found. Creating new log.
I20260807 10:36:14.925298 23415 tablet_service.cc:1467] Processing CreateTablet for tablet 2c0dcc4029e74305bbe3ee420db2dcc0 (DEFAULT_TABLE table=test-table [id=780c44ce180a46cd83e8e218233b34f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:36:14.925840 23415 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2c0dcc4029e74305bbe3ee420db2dcc0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:36:14.932724 23557 tablet_replica.cc:330] T 5e8d2b96c6564646ad64f5263bbd89bc P 54772e1ff58a436ba58a0ac5bfa97a59: stopping tablet replica
I20260807 10:36:14.933727 23556 tablet_replica.cc:330] T 5e8d2b96c6564646ad64f5263bbd89bc P a3d1e4c904da4a68909c233e148b45c2: stopping tablet replica
I20260807 10:36:14.934427 23557 raft_consensus.cc:2229] T 5e8d2b96c6564646ad64f5263bbd89bc P 54772e1ff58a436ba58a0ac5bfa97a59 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 10:36:14.935441 23556 raft_consensus.cc:2229] T 5e8d2b96c6564646ad64f5263bbd89bc P a3d1e4c904da4a68909c233e148b45c2 [term 1 LEADER]: Raft consensus shutting down.
I20260807 10:36:14.936148 23557 raft_consensus.cc:2258] T 5e8d2b96c6564646ad64f5263bbd89bc P 54772e1ff58a436ba58a0ac5bfa97a59 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:36:14.936460 23509 tablet_bootstrap.cc:492] T 2c0dcc4029e74305bbe3ee420db2dcc0 P 54772e1ff58a436ba58a0ac5bfa97a59: Bootstrap starting.
I20260807 10:36:14.938867 23509 tablet_bootstrap.cc:654] T 2c0dcc4029e74305bbe3ee420db2dcc0 P 54772e1ff58a436ba58a0ac5bfa97a59: Neither blocks nor log segments found. Creating new log.
I20260807 10:36:14.939307 23507 tablet_bootstrap.cc:492] T 2c0dcc4029e74305bbe3ee420db2dcc0 P efab605345b447e398d4ae5bbd44dd32: Bootstrap starting.
I20260807 10:36:14.941669 23507 tablet_bootstrap.cc:654] T 2c0dcc4029e74305bbe3ee420db2dcc0 P efab605345b447e398d4ae5bbd44dd32: Neither blocks nor log segments found. Creating new log.
I20260807 10:36:14.952404 23507 tablet_bootstrap.cc:492] T 2c0dcc4029e74305bbe3ee420db2dcc0 P efab605345b447e398d4ae5bbd44dd32: No bootstrap required, opened a new log
I20260807 10:36:14.952739 23507 ts_tablet_manager.cc:1397] T 2c0dcc4029e74305bbe3ee420db2dcc0 P efab605345b447e398d4ae5bbd44dd32: Time spent bootstrapping tablet: real 0.013s user 0.006s sys 0.004s
I20260807 10:36:14.954347 23510 tablet_bootstrap.cc:492] T 2c0dcc4029e74305bbe3ee420db2dcc0 P a3d1e4c904da4a68909c233e148b45c2: No bootstrap required, opened a new log
I20260807 10:36:14.953792 23507 raft_consensus.cc:348] T 2c0dcc4029e74305bbe3ee420db2dcc0 P efab605345b447e398d4ae5bbd44dd32 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3d1e4c904da4a68909c233e148b45c2" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 43331 } } peers { permanent_uuid: "54772e1ff58a436ba58a0ac5bfa97a59" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 38257 } } peers { permanent_uuid: "efab605345b447e398d4ae5bbd44dd32" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 35493 } }
I20260807 10:36:14.955313 23507 raft_consensus.cc:374] T 2c0dcc4029e74305bbe3ee420db2dcc0 P efab605345b447e398d4ae5bbd44dd32 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:36:14.955463 23507 raft_consensus.cc:729] T 2c0dcc4029e74305bbe3ee420db2dcc0 P efab605345b447e398d4ae5bbd44dd32 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efab605345b447e398d4ae5bbd44dd32, State: Initialized, Role: FOLLOWER
I20260807 10:36:14.955731 23557 ts_tablet_manager.cc:1905] T 5e8d2b96c6564646ad64f5263bbd89bc P 54772e1ff58a436ba58a0ac5bfa97a59: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 10:36:14.955942 23507 consensus_queue.cc:260] T 2c0dcc4029e74305bbe3ee420db2dcc0 P efab605345b447e398d4ae5bbd44dd32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3d1e4c904da4a68909c233e148b45c2" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 43331 } } peers { permanent_uuid: "54772e1ff58a436ba58a0ac5bfa97a59" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 38257 } } peers { permanent_uuid: "efab605345b447e398d4ae5bbd44dd32" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 35493 } }
I20260807 10:36:14.957382 23507 ts_tablet_manager.cc:1428] T 2c0dcc4029e74305bbe3ee420db2dcc0 P efab605345b447e398d4ae5bbd44dd32: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260807 10:36:14.959014 23509 tablet_bootstrap.cc:492] T 2c0dcc4029e74305bbe3ee420db2dcc0 P 54772e1ff58a436ba58a0ac5bfa97a59: No bootstrap required, opened a new log
I20260807 10:36:14.959198 23509 ts_tablet_manager.cc:1397] T 2c0dcc4029e74305bbe3ee420db2dcc0 P 54772e1ff58a436ba58a0ac5bfa97a59: Time spent bootstrapping tablet: real 0.023s user 0.002s sys 0.007s
I20260807 10:36:14.960034 23509 raft_consensus.cc:348] T 2c0dcc4029e74305bbe3ee420db2dcc0 P 54772e1ff58a436ba58a0ac5bfa97a59 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3d1e4c904da4a68909c233e148b45c2" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 43331 } } peers { permanent_uuid: "54772e1ff58a436ba58a0ac5bfa97a59" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 38257 } } peers { permanent_uuid: "efab605345b447e398d4ae5bbd44dd32" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 35493 } }
I20260807 10:36:14.960340 23509 raft_consensus.cc:374] T 2c0dcc4029e74305bbe3ee420db2dcc0 P 54772e1ff58a436ba58a0ac5bfa97a59 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:36:14.960435 23509 raft_consensus.cc:729] T 2c0dcc4029e74305bbe3ee420db2dcc0 P 54772e1ff58a436ba58a0ac5bfa97a59 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54772e1ff58a436ba58a0ac5bfa97a59, State: Initialized, Role: FOLLOWER
I20260807 10:36:14.960747 23509 consensus_queue.cc:260] T 2c0dcc4029e74305bbe3ee420db2dcc0 P 54772e1ff58a436ba58a0ac5bfa97a59 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3d1e4c904da4a68909c233e148b45c2" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 43331 } } peers { permanent_uuid: "54772e1ff58a436ba58a0ac5bfa97a59" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 38257 } } peers { permanent_uuid: "efab605345b447e398d4ae5bbd44dd32" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 35493 } }
I20260807 10:36:14.963025 23509 ts_tablet_manager.cc:1428] T 2c0dcc4029e74305bbe3ee420db2dcc0 P 54772e1ff58a436ba58a0ac5bfa97a59: Time spent starting tablet: real 0.004s user 0.000s sys 0.003s
I20260807 10:36:14.963404 23510 ts_tablet_manager.cc:1397] T 2c0dcc4029e74305bbe3ee420db2dcc0 P a3d1e4c904da4a68909c233e148b45c2: Time spent bootstrapping tablet: real 0.041s user 0.001s sys 0.013s
I20260807 10:36:14.958276 23556 raft_consensus.cc:2258] T 5e8d2b96c6564646ad64f5263bbd89bc P a3d1e4c904da4a68909c233e148b45c2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:36:14.965889 23556 ts_tablet_manager.cc:1905] T 5e8d2b96c6564646ad64f5263bbd89bc P a3d1e4c904da4a68909c233e148b45c2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 10:36:14.969489 23510 raft_consensus.cc:348] T 2c0dcc4029e74305bbe3ee420db2dcc0 P a3d1e4c904da4a68909c233e148b45c2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3d1e4c904da4a68909c233e148b45c2" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 43331 } } peers { permanent_uuid: "54772e1ff58a436ba58a0ac5bfa97a59" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 38257 } } peers { permanent_uuid: "efab605345b447e398d4ae5bbd44dd32" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 35493 } }
I20260807 10:36:14.970968 23510 raft_consensus.cc:374] T 2c0dcc4029e74305bbe3ee420db2dcc0 P a3d1e4c904da4a68909c233e148b45c2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:36:14.971124 23510 raft_consensus.cc:729] T 2c0dcc4029e74305bbe3ee420db2dcc0 P a3d1e4c904da4a68909c233e148b45c2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3d1e4c904da4a68909c233e148b45c2, State: Initialized, Role: FOLLOWER
I20260807 10:36:14.971490 23510 consensus_queue.cc:260] T 2c0dcc4029e74305bbe3ee420db2dcc0 P a3d1e4c904da4a68909c233e148b45c2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3d1e4c904da4a68909c233e148b45c2" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 43331 } } peers { permanent_uuid: "54772e1ff58a436ba58a0ac5bfa97a59" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 38257 } } peers { permanent_uuid: "efab605345b447e398d4ae5bbd44dd32" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 35493 } }
I20260807 10:36:14.972240 23510 ts_tablet_manager.cc:1428] T 2c0dcc4029e74305bbe3ee420db2dcc0 P a3d1e4c904da4a68909c233e148b45c2: Time spent starting tablet: real 0.009s user 0.001s sys 0.001s
I20260807 10:36:14.975215 23556 ts_tablet_manager.cc:1918] T 5e8d2b96c6564646ad64f5263bbd89bc P a3d1e4c904da4a68909c233e148b45c2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 10:36:14.975553 23556 log.cc:1196] T 5e8d2b96c6564646ad64f5263bbd89bc P a3d1e4c904da4a68909c233e148b45c2: Deleting WAL directory at /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786098956060137-21165-0/minicluster-data/ts-0/wal/wals/5e8d2b96c6564646ad64f5263bbd89bc
I20260807 10:36:14.978545 23557 ts_tablet_manager.cc:1918] T 5e8d2b96c6564646ad64f5263bbd89bc P 54772e1ff58a436ba58a0ac5bfa97a59: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 10:36:14.978715 23556 ts_tablet_manager.cc:1939] T 5e8d2b96c6564646ad64f5263bbd89bc P a3d1e4c904da4a68909c233e148b45c2: Deleting consensus metadata
I20260807 10:36:14.978786 23557 log.cc:1196] T 5e8d2b96c6564646ad64f5263bbd89bc P 54772e1ff58a436ba58a0ac5bfa97a59: Deleting WAL directory at /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786098956060137-21165-0/minicluster-data/ts-1/wal/wals/5e8d2b96c6564646ad64f5263bbd89bc
I20260807 10:36:14.979326 23557 ts_tablet_manager.cc:1939] T 5e8d2b96c6564646ad64f5263bbd89bc P 54772e1ff58a436ba58a0ac5bfa97a59: Deleting consensus metadata
I20260807 10:36:14.980660 22970 catalog_manager.cc:4841] TS a3d1e4c904da4a68909c233e148b45c2 (127.20.171.65:43331): tablet 5e8d2b96c6564646ad64f5263bbd89bc (table test-table [id=8156b58d80be42fdabc54f6b8a203bb2]) successfully deleted
I20260807 10:36:14.981839 22972 catalog_manager.cc:4841] TS 54772e1ff58a436ba58a0ac5bfa97a59 (127.20.171.66:38257): tablet 5e8d2b96c6564646ad64f5263bbd89bc (table test-table [id=8156b58d80be42fdabc54f6b8a203bb2]) successfully deleted
I20260807 10:36:15.258944 23513 raft_consensus.cc:482] T 2c0dcc4029e74305bbe3ee420db2dcc0 P efab605345b447e398d4ae5bbd44dd32 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 10:36:15.259188 23513 raft_consensus.cc:504] T 2c0dcc4029e74305bbe3ee420db2dcc0 P efab605345b447e398d4ae5bbd44dd32 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3d1e4c904da4a68909c233e148b45c2" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 43331 } } peers { permanent_uuid: "54772e1ff58a436ba58a0ac5bfa97a59" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 38257 } } peers { permanent_uuid: "efab605345b447e398d4ae5bbd44dd32" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 35493 } }
I20260807 10:36:15.260003 23513 leader_election.cc:288] T 2c0dcc4029e74305bbe3ee420db2dcc0 P efab605345b447e398d4ae5bbd44dd32 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3d1e4c904da4a68909c233e148b45c2 (127.20.171.65:43331), 54772e1ff58a436ba58a0ac5bfa97a59 (127.20.171.66:38257)
I20260807 10:36:15.260704 23156 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c0dcc4029e74305bbe3ee420db2dcc0" candidate_uuid: "efab605345b447e398d4ae5bbd44dd32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3d1e4c904da4a68909c233e148b45c2" is_pre_election: true
I20260807 10:36:15.260960 23294 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c0dcc4029e74305bbe3ee420db2dcc0" candidate_uuid: "efab605345b447e398d4ae5bbd44dd32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54772e1ff58a436ba58a0ac5bfa97a59" is_pre_election: true
I20260807 10:36:15.261101 23156 raft_consensus.cc:2454] T 2c0dcc4029e74305bbe3ee420db2dcc0 P a3d1e4c904da4a68909c233e148b45c2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efab605345b447e398d4ae5bbd44dd32 in term 0.
I20260807 10:36:15.261250 23294 raft_consensus.cc:2454] T 2c0dcc4029e74305bbe3ee420db2dcc0 P 54772e1ff58a436ba58a0ac5bfa97a59 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efab605345b447e398d4ae5bbd44dd32 in term 0.
I20260807 10:36:15.261751 23368 leader_election.cc:302] T 2c0dcc4029e74305bbe3ee420db2dcc0 P efab605345b447e398d4ae5bbd44dd32 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 54772e1ff58a436ba58a0ac5bfa97a59, a3d1e4c904da4a68909c233e148b45c2, efab605345b447e398d4ae5bbd44dd32; no voters:
I20260807 10:36:15.262122 23513 raft_consensus.cc:2781] T 2c0dcc4029e74305bbe3ee420db2dcc0 P efab605345b447e398d4ae5bbd44dd32 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 10:36:15.262383 23513 raft_consensus.cc:482] T 2c0dcc4029e74305bbe3ee420db2dcc0 P efab605345b447e398d4ae5bbd44dd32 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 10:36:15.262522 23513 raft_consensus.cc:3037] T 2c0dcc4029e74305bbe3ee420db2dcc0 P efab605345b447e398d4ae5bbd44dd32 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:36:15.265729 23513 raft_consensus.cc:504] T 2c0dcc4029e74305bbe3ee420db2dcc0 P efab605345b447e398d4ae5bbd44dd32 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3d1e4c904da4a68909c233e148b45c2" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 43331 } } peers { permanent_uuid: "54772e1ff58a436ba58a0ac5bfa97a59" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 38257 } } peers { permanent_uuid: "efab605345b447e398d4ae5bbd44dd32" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 35493 } }
I20260807 10:36:15.266638 23513 leader_election.cc:288] T 2c0dcc4029e74305bbe3ee420db2dcc0 P efab605345b447e398d4ae5bbd44dd32 [CANDIDATE]: Term 1 election: Requested vote from peers a3d1e4c904da4a68909c233e148b45c2 (127.20.171.65:43331), 54772e1ff58a436ba58a0ac5bfa97a59 (127.20.171.66:38257)
I20260807 10:36:15.267095 23294 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c0dcc4029e74305bbe3ee420db2dcc0" candidate_uuid: "efab605345b447e398d4ae5bbd44dd32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54772e1ff58a436ba58a0ac5bfa97a59"
I20260807 10:36:15.267216 23156 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c0dcc4029e74305bbe3ee420db2dcc0" candidate_uuid: "efab605345b447e398d4ae5bbd44dd32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3d1e4c904da4a68909c233e148b45c2"
I20260807 10:36:15.267359 23294 raft_consensus.cc:3037] T 2c0dcc4029e74305bbe3ee420db2dcc0 P 54772e1ff58a436ba58a0ac5bfa97a59 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:36:15.267534 23156 raft_consensus.cc:3037] T 2c0dcc4029e74305bbe3ee420db2dcc0 P a3d1e4c904da4a68909c233e148b45c2 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:36:15.271664 23294 raft_consensus.cc:2454] T 2c0dcc4029e74305bbe3ee420db2dcc0 P 54772e1ff58a436ba58a0ac5bfa97a59 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efab605345b447e398d4ae5bbd44dd32 in term 1.
I20260807 10:36:15.272099 23156 raft_consensus.cc:2454] T 2c0dcc4029e74305bbe3ee420db2dcc0 P a3d1e4c904da4a68909c233e148b45c2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efab605345b447e398d4ae5bbd44dd32 in term 1.
I20260807 10:36:15.272269 23368 leader_election.cc:302] T 2c0dcc4029e74305bbe3ee420db2dcc0 P efab605345b447e398d4ae5bbd44dd32 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54772e1ff58a436ba58a0ac5bfa97a59, efab605345b447e398d4ae5bbd44dd32; no voters:
I20260807 10:36:15.272903 23513 raft_consensus.cc:2781] T 2c0dcc4029e74305bbe3ee420db2dcc0 P efab605345b447e398d4ae5bbd44dd32 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:36:15.273123 23513 raft_consensus.cc:686] T 2c0dcc4029e74305bbe3ee420db2dcc0 P efab605345b447e398d4ae5bbd44dd32 [term 1 LEADER]: Becoming Leader. State: Replica: efab605345b447e398d4ae5bbd44dd32, State: Running, Role: LEADER
I20260807 10:36:15.273478 23513 consensus_queue.cc:237] T 2c0dcc4029e74305bbe3ee420db2dcc0 P efab605345b447e398d4ae5bbd44dd32 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3d1e4c904da4a68909c233e148b45c2" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 43331 } } peers { permanent_uuid: "54772e1ff58a436ba58a0ac5bfa97a59" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 38257 } } peers { permanent_uuid: "efab605345b447e398d4ae5bbd44dd32" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 35493 } }
I20260807 10:36:15.276608 22988 catalog_manager.cc:5495] T 2c0dcc4029e74305bbe3ee420db2dcc0 P efab605345b447e398d4ae5bbd44dd32 reported cstate change: term changed from 0 to 1, leader changed from <none> to efab605345b447e398d4ae5bbd44dd32 (127.20.171.67). New cstate: current_term: 1 leader_uuid: "efab605345b447e398d4ae5bbd44dd32" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3d1e4c904da4a68909c233e148b45c2" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 43331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54772e1ff58a436ba58a0ac5bfa97a59" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 38257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efab605345b447e398d4ae5bbd44dd32" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 35493 } health_report { overall_health: HEALTHY } } }
I20260807 10:36:15.319130 23563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:15.311431 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52496 (local address 127.20.171.67:35493)
0807 10:36:15.312086 (+ 655us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:15.312091 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:15.313132 (+ 1041us) server_negotiation.cc:407] Connection header received
0807 10:36:15.313316 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:15.313319 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:15.313381 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:15.313463 (+ 82us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 10:36:15.314112 (+ 649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:15.314789 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:15.317129 (+ 2340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:15.317604 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:15.317732 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:15.318252 (+ 520us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 10:36:15.318350 (+ 98us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 10:36:15.318417 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:15.318636 (+ 219us) server_negotiation.cc:299] Negotiation successful
0807 10:36:15.318730 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":443,"thread_start_us":339,"threads_started":1}
I20260807 10:36:15.332677 23563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:15.327655 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.67:55583 (local address 127.20.171.67:35493)
0807 10:36:15.327835 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:15.327840 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:15.327989 (+ 149us) server_negotiation.cc:407] Connection header received
0807 10:36:15.328164 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:15.328169 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:15.328236 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:15.328354 (+ 118us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 10:36:15.328723 (+ 369us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:15.329520 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:15.330824 (+ 1304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:15.331212 (+ 388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:15.331367 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:15.331842 (+ 475us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 10:36:15.331963 (+ 121us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 10:36:15.332070 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:15.332227 (+ 157us) server_negotiation.cc:299] Negotiation successful
0807 10:36:15.332316 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":37,"server-negotiator.queue_time_us":46}
I20260807 10:36:15.332683 23551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:15.327732 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.67:35493 (local address 127.20.171.67:55583)
0807 10:36:15.327907 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0807 10:36:15.327922 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 10:36:15.328054 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:36:15.328375 (+ 321us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:36:15.328378 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:36:15.328390 (+ 12us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 10:36:15.328589 (+ 199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:15.328598 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:15.329660 (+ 1062us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:15.329665 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:15.330648 (+ 983us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:15.330660 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:15.331377 (+ 717us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:15.331382 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:15.331621 (+ 239us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:15.331686 (+ 65us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 10:36:15.332093 (+ 407us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 10:36:15.332103 (+ 10us) client_negotiation.cc:769] Sending connection context
0807 10:36:15.332174 (+ 71us) client_negotiation.cc:240] Negotiation successful
0807 10:36:15.332335 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":55,"mutex_wait_us":41}
I20260807 10:36:15.341807 23294 raft_consensus.cc:1261] T 2c0dcc4029e74305bbe3ee420db2dcc0 P 54772e1ff58a436ba58a0ac5bfa97a59 [term 1 FOLLOWER]: Refusing update from remote peer efab605345b447e398d4ae5bbd44dd32: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 10:36:15.342350 23513 consensus_queue.cc:1035] T 2c0dcc4029e74305bbe3ee420db2dcc0 P efab605345b447e398d4ae5bbd44dd32 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54772e1ff58a436ba58a0ac5bfa97a59" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 38257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 10:36:15.342514 23156 raft_consensus.cc:1261] T 2c0dcc4029e74305bbe3ee420db2dcc0 P a3d1e4c904da4a68909c233e148b45c2 [term 1 FOLLOWER]: Refusing update from remote peer efab605345b447e398d4ae5bbd44dd32: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 10:36:15.343267 23513 consensus_queue.cc:1035] T 2c0dcc4029e74305bbe3ee420db2dcc0 P efab605345b447e398d4ae5bbd44dd32 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3d1e4c904da4a68909c233e148b45c2" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 43331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 10:36:15.354861 23537 mvcc.cc:205] Tried to move back new op lower bound from 7315861402994749440 to 7315861402723033088. Current Snapshot: MvccSnapshot[applied={T|T < 7315861402994749440}]
W20260807 10:36:15.368532 23535 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260807 10:36:16.988142 22988 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60872:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 10:36:16.988492 22988 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60872:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 10:36:16.994544 22988 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 95c5073aefc9420fa0091dba7c7479a1: Sending DeleteTablet for 3 replicas of tablet 2c0dcc4029e74305bbe3ee420db2dcc0
I20260807 10:36:16.995424 23129 tablet_service.cc:1514] Processing DeleteTablet for tablet 2c0dcc4029e74305bbe3ee420db2dcc0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:36:16 UTC) from {username='kudu', principal='kudu/127.20.171.126@KRBTEST.COM'} at 127.0.0.1:57140
I20260807 10:36:16.995611 23273 tablet_service.cc:1514] Processing DeleteTablet for tablet 2c0dcc4029e74305bbe3ee420db2dcc0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:36:16 UTC) from {username='kudu', principal='kudu/127.20.171.126@KRBTEST.COM'} at 127.0.0.1:60488
I20260807 10:36:16.995652 23414 tablet_service.cc:1514] Processing DeleteTablet for tablet 2c0dcc4029e74305bbe3ee420db2dcc0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:36:16 UTC) from {username='kudu', principal='kudu/127.20.171.126@KRBTEST.COM'} at 127.0.0.1:52484
I20260807 10:36:17.010993 23591 tablet_replica.cc:330] T 2c0dcc4029e74305bbe3ee420db2dcc0 P a3d1e4c904da4a68909c233e148b45c2: stopping tablet replica
I20260807 10:36:17.011462 23591 raft_consensus.cc:2229] T 2c0dcc4029e74305bbe3ee420db2dcc0 P a3d1e4c904da4a68909c233e148b45c2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 10:36:17.011691 23592 tablet_replica.cc:330] T 2c0dcc4029e74305bbe3ee420db2dcc0 P 54772e1ff58a436ba58a0ac5bfa97a59: stopping tablet replica
I20260807 10:36:17.011902 23591 raft_consensus.cc:2258] T 2c0dcc4029e74305bbe3ee420db2dcc0 P a3d1e4c904da4a68909c233e148b45c2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:36:17.012069 23592 raft_consensus.cc:2229] T 2c0dcc4029e74305bbe3ee420db2dcc0 P 54772e1ff58a436ba58a0ac5bfa97a59 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 10:36:17.012567 23593 tablet_replica.cc:330] T 2c0dcc4029e74305bbe3ee420db2dcc0 P efab605345b447e398d4ae5bbd44dd32: stopping tablet replica
I20260807 10:36:17.012650 23592 raft_consensus.cc:2258] T 2c0dcc4029e74305bbe3ee420db2dcc0 P 54772e1ff58a436ba58a0ac5bfa97a59 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:36:17.012935 23593 raft_consensus.cc:2229] T 2c0dcc4029e74305bbe3ee420db2dcc0 P efab605345b447e398d4ae5bbd44dd32 [term 1 LEADER]: Raft consensus shutting down.
I20260807 10:36:17.013414 23591 ts_tablet_manager.cc:1905] T 2c0dcc4029e74305bbe3ee420db2dcc0 P a3d1e4c904da4a68909c233e148b45c2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 10:36:17.013684 23593 raft_consensus.cc:2258] T 2c0dcc4029e74305bbe3ee420db2dcc0 P efab605345b447e398d4ae5bbd44dd32 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:36:17.014554 23592 ts_tablet_manager.cc:1905] T 2c0dcc4029e74305bbe3ee420db2dcc0 P 54772e1ff58a436ba58a0ac5bfa97a59: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 10:36:17.014624 23593 ts_tablet_manager.cc:1905] T 2c0dcc4029e74305bbe3ee420db2dcc0 P efab605345b447e398d4ae5bbd44dd32: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 10:36:17.021592 23591 ts_tablet_manager.cc:1918] T 2c0dcc4029e74305bbe3ee420db2dcc0 P a3d1e4c904da4a68909c233e148b45c2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260807 10:36:17.021875 23591 log.cc:1196] T 2c0dcc4029e74305bbe3ee420db2dcc0 P a3d1e4c904da4a68909c233e148b45c2: Deleting WAL directory at /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786098956060137-21165-0/minicluster-data/ts-0/wal/wals/2c0dcc4029e74305bbe3ee420db2dcc0
I20260807 10:36:17.022656 23591 ts_tablet_manager.cc:1939] T 2c0dcc4029e74305bbe3ee420db2dcc0 P a3d1e4c904da4a68909c233e148b45c2: Deleting consensus metadata
I20260807 10:36:17.022681 23593 ts_tablet_manager.cc:1918] T 2c0dcc4029e74305bbe3ee420db2dcc0 P efab605345b447e398d4ae5bbd44dd32: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260807 10:36:17.022928 23593 log.cc:1196] T 2c0dcc4029e74305bbe3ee420db2dcc0 P efab605345b447e398d4ae5bbd44dd32: Deleting WAL directory at /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786098956060137-21165-0/minicluster-data/ts-2/wal/wals/2c0dcc4029e74305bbe3ee420db2dcc0
I20260807 10:36:17.023411 23592 ts_tablet_manager.cc:1918] T 2c0dcc4029e74305bbe3ee420db2dcc0 P 54772e1ff58a436ba58a0ac5bfa97a59: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260807 10:36:17.023670 23592 log.cc:1196] T 2c0dcc4029e74305bbe3ee420db2dcc0 P 54772e1ff58a436ba58a0ac5bfa97a59: Deleting WAL directory at /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786098956060137-21165-0/minicluster-data/ts-1/wal/wals/2c0dcc4029e74305bbe3ee420db2dcc0
I20260807 10:36:17.023993 23593 ts_tablet_manager.cc:1939] T 2c0dcc4029e74305bbe3ee420db2dcc0 P efab605345b447e398d4ae5bbd44dd32: Deleting consensus metadata
I20260807 10:36:17.024159 22970 catalog_manager.cc:4841] TS a3d1e4c904da4a68909c233e148b45c2 (127.20.171.65:43331): tablet 2c0dcc4029e74305bbe3ee420db2dcc0 (table test-table [id=780c44ce180a46cd83e8e218233b34f6]) successfully deleted
I20260807 10:36:17.024530 23592 ts_tablet_manager.cc:1939] T 2c0dcc4029e74305bbe3ee420db2dcc0 P 54772e1ff58a436ba58a0ac5bfa97a59: Deleting consensus metadata
I20260807 10:36:17.025247 22972 catalog_manager.cc:4841] TS efab605345b447e398d4ae5bbd44dd32 (127.20.171.67:35493): tablet 2c0dcc4029e74305bbe3ee420db2dcc0 (table test-table [id=780c44ce180a46cd83e8e218233b34f6]) successfully deleted
I20260807 10:36:17.025571 22972 catalog_manager.cc:4841] TS 54772e1ff58a436ba58a0ac5bfa97a59 (127.20.171.66:38257): tablet 2c0dcc4029e74305bbe3ee420db2dcc0 (table test-table [id=780c44ce180a46cd83e8e218233b34f6]) successfully deleted
Aug 07 10:36:17 dist-test-slave-0b58 krb5kdc[22940](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786098977, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 07 10:36:17 dist-test-slave-0b58 krb5kdc[22940](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786098977, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.20.171.126@KRBTEST.COM
I20260807 10:36:17.068382 23601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:17.051446 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60892 (local address 127.20.171.126:41919)
0807 10:36:17.052191 (+ 745us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:17.052198 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:17.052366 (+ 168us) server_negotiation.cc:407] Connection header received
0807 10:36:17.052556 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:17.052560 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:17.052622 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:17.052722 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:36:17.054601 (+ 1879us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:17.055309 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:17.057000 (+ 1691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:17.057477 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:17.057596 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:17.062536 (+ 4940us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:36:17.062541 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:36:17.062545 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:36:17.062576 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:36:17.065828 (+ 3252us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:17.066542 (+ 714us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:17.066546 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:17.066548 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:17.066698 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:17.067053 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:17.067056 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:17.067058 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:17.067392 (+ 334us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:36:17.067583 (+ 191us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:17.067811 (+ 228us) server_negotiation.cc:299] Negotiation successful
0807 10:36:17.068015 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":608,"thread_start_us":456,"threads_started":1}
I20260807 10:36:17.072675 22988 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:60892:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 10:36:17.073381 22988 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 10:36:17.080140 23129 tablet_service.cc:1467] Processing CreateTablet for tablet 5ca23d937b254632a102d5e93a7754dc (DEFAULT_TABLE table=test-table [id=97b22b7b7a494175a76002147c2c0b03]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:36:17.080377 23273 tablet_service.cc:1467] Processing CreateTablet for tablet 5ca23d937b254632a102d5e93a7754dc (DEFAULT_TABLE table=test-table [id=97b22b7b7a494175a76002147c2c0b03]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:36:17.080751 23129 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5ca23d937b254632a102d5e93a7754dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:36:17.080650 23414 tablet_service.cc:1467] Processing CreateTablet for tablet 5ca23d937b254632a102d5e93a7754dc (DEFAULT_TABLE table=test-table [id=97b22b7b7a494175a76002147c2c0b03]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:36:17.081030 23273 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5ca23d937b254632a102d5e93a7754dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:36:17.081231 23414 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5ca23d937b254632a102d5e93a7754dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:36:17.087502 23603 tablet_bootstrap.cc:492] T 5ca23d937b254632a102d5e93a7754dc P a3d1e4c904da4a68909c233e148b45c2: Bootstrap starting.
I20260807 10:36:17.089128 23605 tablet_bootstrap.cc:492] T 5ca23d937b254632a102d5e93a7754dc P 54772e1ff58a436ba58a0ac5bfa97a59: Bootstrap starting.
I20260807 10:36:17.089865 23604 tablet_bootstrap.cc:492] T 5ca23d937b254632a102d5e93a7754dc P efab605345b447e398d4ae5bbd44dd32: Bootstrap starting.
I20260807 10:36:17.091367 23603 tablet_bootstrap.cc:654] T 5ca23d937b254632a102d5e93a7754dc P a3d1e4c904da4a68909c233e148b45c2: Neither blocks nor log segments found. Creating new log.
I20260807 10:36:17.092013 23605 tablet_bootstrap.cc:654] T 5ca23d937b254632a102d5e93a7754dc P 54772e1ff58a436ba58a0ac5bfa97a59: Neither blocks nor log segments found. Creating new log.
I20260807 10:36:17.092319 23604 tablet_bootstrap.cc:654] T 5ca23d937b254632a102d5e93a7754dc P efab605345b447e398d4ae5bbd44dd32: Neither blocks nor log segments found. Creating new log.
I20260807 10:36:17.095274 23604 tablet_bootstrap.cc:492] T 5ca23d937b254632a102d5e93a7754dc P efab605345b447e398d4ae5bbd44dd32: No bootstrap required, opened a new log
I20260807 10:36:17.095525 23604 ts_tablet_manager.cc:1397] T 5ca23d937b254632a102d5e93a7754dc P efab605345b447e398d4ae5bbd44dd32: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.002s
I20260807 10:36:17.095535 23603 tablet_bootstrap.cc:492] T 5ca23d937b254632a102d5e93a7754dc P a3d1e4c904da4a68909c233e148b45c2: No bootstrap required, opened a new log
I20260807 10:36:17.095567 23605 tablet_bootstrap.cc:492] T 5ca23d937b254632a102d5e93a7754dc P 54772e1ff58a436ba58a0ac5bfa97a59: No bootstrap required, opened a new log
I20260807 10:36:17.095724 23605 ts_tablet_manager.cc:1397] T 5ca23d937b254632a102d5e93a7754dc P 54772e1ff58a436ba58a0ac5bfa97a59: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.005s
I20260807 10:36:17.095724 23603 ts_tablet_manager.cc:1397] T 5ca23d937b254632a102d5e93a7754dc P a3d1e4c904da4a68909c233e148b45c2: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.003s
I20260807 10:36:17.096585 23604 raft_consensus.cc:348] T 5ca23d937b254632a102d5e93a7754dc P efab605345b447e398d4ae5bbd44dd32 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3d1e4c904da4a68909c233e148b45c2" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 43331 } } peers { permanent_uuid: "54772e1ff58a436ba58a0ac5bfa97a59" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 38257 } } peers { permanent_uuid: "efab605345b447e398d4ae5bbd44dd32" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 35493 } }
I20260807 10:36:17.096854 23604 raft_consensus.cc:374] T 5ca23d937b254632a102d5e93a7754dc P efab605345b447e398d4ae5bbd44dd32 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:36:17.097003 23604 raft_consensus.cc:729] T 5ca23d937b254632a102d5e93a7754dc P efab605345b447e398d4ae5bbd44dd32 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efab605345b447e398d4ae5bbd44dd32, State: Initialized, Role: FOLLOWER
I20260807 10:36:17.096985 23603 raft_consensus.cc:348] T 5ca23d937b254632a102d5e93a7754dc P a3d1e4c904da4a68909c233e148b45c2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3d1e4c904da4a68909c233e148b45c2" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 43331 } } peers { permanent_uuid: "54772e1ff58a436ba58a0ac5bfa97a59" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 38257 } } peers { permanent_uuid: "efab605345b447e398d4ae5bbd44dd32" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 35493 } }
I20260807 10:36:17.097033 23605 raft_consensus.cc:348] T 5ca23d937b254632a102d5e93a7754dc P 54772e1ff58a436ba58a0ac5bfa97a59 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3d1e4c904da4a68909c233e148b45c2" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 43331 } } peers { permanent_uuid: "54772e1ff58a436ba58a0ac5bfa97a59" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 38257 } } peers { permanent_uuid: "efab605345b447e398d4ae5bbd44dd32" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 35493 } }
I20260807 10:36:17.097276 23605 raft_consensus.cc:374] T 5ca23d937b254632a102d5e93a7754dc P 54772e1ff58a436ba58a0ac5bfa97a59 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:36:17.097282 23603 raft_consensus.cc:374] T 5ca23d937b254632a102d5e93a7754dc P a3d1e4c904da4a68909c233e148b45c2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:36:17.097393 23603 raft_consensus.cc:729] T 5ca23d937b254632a102d5e93a7754dc P a3d1e4c904da4a68909c233e148b45c2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3d1e4c904da4a68909c233e148b45c2, State: Initialized, Role: FOLLOWER
I20260807 10:36:17.097407 23605 raft_consensus.cc:729] T 5ca23d937b254632a102d5e93a7754dc P 54772e1ff58a436ba58a0ac5bfa97a59 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54772e1ff58a436ba58a0ac5bfa97a59, State: Initialized, Role: FOLLOWER
I20260807 10:36:17.097321 23604 consensus_queue.cc:260] T 5ca23d937b254632a102d5e93a7754dc P efab605345b447e398d4ae5bbd44dd32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3d1e4c904da4a68909c233e148b45c2" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 43331 } } peers { permanent_uuid: "54772e1ff58a436ba58a0ac5bfa97a59" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 38257 } } peers { permanent_uuid: "efab605345b447e398d4ae5bbd44dd32" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 35493 } }
I20260807 10:36:17.097846 23605 consensus_queue.cc:260] T 5ca23d937b254632a102d5e93a7754dc P 54772e1ff58a436ba58a0ac5bfa97a59 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3d1e4c904da4a68909c233e148b45c2" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 43331 } } peers { permanent_uuid: "54772e1ff58a436ba58a0ac5bfa97a59" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 38257 } } peers { permanent_uuid: "efab605345b447e398d4ae5bbd44dd32" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 35493 } }
I20260807 10:36:17.098212 23604 ts_tablet_manager.cc:1428] T 5ca23d937b254632a102d5e93a7754dc P efab605345b447e398d4ae5bbd44dd32: Time spent starting tablet: real 0.002s user 0.001s sys 0.002s
I20260807 10:36:17.097709 23603 consensus_queue.cc:260] T 5ca23d937b254632a102d5e93a7754dc P a3d1e4c904da4a68909c233e148b45c2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3d1e4c904da4a68909c233e148b45c2" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 43331 } } peers { permanent_uuid: "54772e1ff58a436ba58a0ac5bfa97a59" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 38257 } } peers { permanent_uuid: "efab605345b447e398d4ae5bbd44dd32" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 35493 } }
I20260807 10:36:17.099263 23605 ts_tablet_manager.cc:1428] T 5ca23d937b254632a102d5e93a7754dc P 54772e1ff58a436ba58a0ac5bfa97a59: Time spent starting tablet: real 0.003s user 0.000s sys 0.004s
I20260807 10:36:17.102699 23603 ts_tablet_manager.cc:1428] T 5ca23d937b254632a102d5e93a7754dc P a3d1e4c904da4a68909c233e148b45c2: Time spent starting tablet: real 0.007s user 0.000s sys 0.005s
I20260807 10:36:17.199553 23572 raft_consensus.cc:482] T 5ca23d937b254632a102d5e93a7754dc P efab605345b447e398d4ae5bbd44dd32 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 10:36:17.199769 23572 raft_consensus.cc:504] T 5ca23d937b254632a102d5e93a7754dc P efab605345b447e398d4ae5bbd44dd32 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3d1e4c904da4a68909c233e148b45c2" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 43331 } } peers { permanent_uuid: "54772e1ff58a436ba58a0ac5bfa97a59" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 38257 } } peers { permanent_uuid: "efab605345b447e398d4ae5bbd44dd32" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 35493 } }
I20260807 10:36:17.200456 23609 raft_consensus.cc:482] T 5ca23d937b254632a102d5e93a7754dc P 54772e1ff58a436ba58a0ac5bfa97a59 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 10:36:17.200785 23572 leader_election.cc:288] T 5ca23d937b254632a102d5e93a7754dc P efab605345b447e398d4ae5bbd44dd32 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3d1e4c904da4a68909c233e148b45c2 (127.20.171.65:43331), 54772e1ff58a436ba58a0ac5bfa97a59 (127.20.171.66:38257)
I20260807 10:36:17.200937 23609 raft_consensus.cc:504] T 5ca23d937b254632a102d5e93a7754dc P 54772e1ff58a436ba58a0ac5bfa97a59 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3d1e4c904da4a68909c233e148b45c2" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 43331 } } peers { permanent_uuid: "54772e1ff58a436ba58a0ac5bfa97a59" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 38257 } } peers { permanent_uuid: "efab605345b447e398d4ae5bbd44dd32" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 35493 } }
I20260807 10:36:17.201419 23294 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5ca23d937b254632a102d5e93a7754dc" candidate_uuid: "efab605345b447e398d4ae5bbd44dd32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54772e1ff58a436ba58a0ac5bfa97a59" is_pre_election: true
I20260807 10:36:17.201481 23154 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5ca23d937b254632a102d5e93a7754dc" candidate_uuid: "efab605345b447e398d4ae5bbd44dd32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3d1e4c904da4a68909c233e148b45c2" is_pre_election: true
I20260807 10:36:17.201843 23154 raft_consensus.cc:2454] T 5ca23d937b254632a102d5e93a7754dc P a3d1e4c904da4a68909c233e148b45c2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efab605345b447e398d4ae5bbd44dd32 in term 0.
I20260807 10:36:17.201862 23294 raft_consensus.cc:2454] T 5ca23d937b254632a102d5e93a7754dc P 54772e1ff58a436ba58a0ac5bfa97a59 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efab605345b447e398d4ae5bbd44dd32 in term 0.
I20260807 10:36:17.202410 23368 leader_election.cc:302] T 5ca23d937b254632a102d5e93a7754dc P efab605345b447e398d4ae5bbd44dd32 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 54772e1ff58a436ba58a0ac5bfa97a59, a3d1e4c904da4a68909c233e148b45c2, efab605345b447e398d4ae5bbd44dd32; no voters:
I20260807 10:36:17.202811 23572 raft_consensus.cc:2781] T 5ca23d937b254632a102d5e93a7754dc P efab605345b447e398d4ae5bbd44dd32 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 10:36:17.202998 23572 raft_consensus.cc:482] T 5ca23d937b254632a102d5e93a7754dc P efab605345b447e398d4ae5bbd44dd32 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 10:36:17.203154 23572 raft_consensus.cc:3037] T 5ca23d937b254632a102d5e93a7754dc P efab605345b447e398d4ae5bbd44dd32 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:36:17.203778 23609 leader_election.cc:288] T 5ca23d937b254632a102d5e93a7754dc P 54772e1ff58a436ba58a0ac5bfa97a59 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3d1e4c904da4a68909c233e148b45c2 (127.20.171.65:43331), efab605345b447e398d4ae5bbd44dd32 (127.20.171.67:35493)
I20260807 10:36:17.207913 23572 raft_consensus.cc:504] T 5ca23d937b254632a102d5e93a7754dc P efab605345b447e398d4ae5bbd44dd32 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3d1e4c904da4a68909c233e148b45c2" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 43331 } } peers { permanent_uuid: "54772e1ff58a436ba58a0ac5bfa97a59" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 38257 } } peers { permanent_uuid: "efab605345b447e398d4ae5bbd44dd32" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 35493 } }
I20260807 10:36:17.208652 23572 leader_election.cc:288] T 5ca23d937b254632a102d5e93a7754dc P efab605345b447e398d4ae5bbd44dd32 [CANDIDATE]: Term 1 election: Requested vote from peers a3d1e4c904da4a68909c233e148b45c2 (127.20.171.65:43331), 54772e1ff58a436ba58a0ac5bfa97a59 (127.20.171.66:38257)
I20260807 10:36:17.209467 23294 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5ca23d937b254632a102d5e93a7754dc" candidate_uuid: "efab605345b447e398d4ae5bbd44dd32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54772e1ff58a436ba58a0ac5bfa97a59"
I20260807 10:36:17.209827 23294 raft_consensus.cc:3037] T 5ca23d937b254632a102d5e93a7754dc P 54772e1ff58a436ba58a0ac5bfa97a59 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:36:17.210101 23154 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5ca23d937b254632a102d5e93a7754dc" candidate_uuid: "efab605345b447e398d4ae5bbd44dd32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3d1e4c904da4a68909c233e148b45c2"
I20260807 10:36:17.210331 23154 raft_consensus.cc:3037] T 5ca23d937b254632a102d5e93a7754dc P a3d1e4c904da4a68909c233e148b45c2 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:36:17.214219 23154 raft_consensus.cc:2454] T 5ca23d937b254632a102d5e93a7754dc P a3d1e4c904da4a68909c233e148b45c2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efab605345b447e398d4ae5bbd44dd32 in term 1.
I20260807 10:36:17.214344 23294 raft_consensus.cc:2454] T 5ca23d937b254632a102d5e93a7754dc P 54772e1ff58a436ba58a0ac5bfa97a59 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efab605345b447e398d4ae5bbd44dd32 in term 1.
I20260807 10:36:17.214721 23366 leader_election.cc:302] T 5ca23d937b254632a102d5e93a7754dc P efab605345b447e398d4ae5bbd44dd32 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a3d1e4c904da4a68909c233e148b45c2, efab605345b447e398d4ae5bbd44dd32; no voters:
I20260807 10:36:17.215046 23572 raft_consensus.cc:2781] T 5ca23d937b254632a102d5e93a7754dc P efab605345b447e398d4ae5bbd44dd32 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:36:17.215251 23572 raft_consensus.cc:686] T 5ca23d937b254632a102d5e93a7754dc P efab605345b447e398d4ae5bbd44dd32 [term 1 LEADER]: Becoming Leader. State: Replica: efab605345b447e398d4ae5bbd44dd32, State: Running, Role: LEADER
I20260807 10:36:17.215664 23572 consensus_queue.cc:237] T 5ca23d937b254632a102d5e93a7754dc P efab605345b447e398d4ae5bbd44dd32 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3d1e4c904da4a68909c233e148b45c2" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 43331 } } peers { permanent_uuid: "54772e1ff58a436ba58a0ac5bfa97a59" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 38257 } } peers { permanent_uuid: "efab605345b447e398d4ae5bbd44dd32" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 35493 } }
I20260807 10:36:17.216952 23611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:17.203854 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.65:43331 (local address 127.20.171.66:46085)
0807 10:36:17.205173 (+ 1319us) negotiation.cc:107] Waiting for socket to connect
0807 10:36:17.205191 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 10:36:17.205395 (+ 204us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:36:17.207267 (+ 1872us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:36:17.207275 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:36:17.207317 (+ 42us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:36:17.208080 (+ 763us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:17.208096 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:17.210267 (+ 2171us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:17.210272 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:17.213696 (+ 3424us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:17.213711 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:17.216037 (+ 2326us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:17.216042 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:17.216199 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:17.216247 (+ 48us) client_negotiation.cc:769] Sending connection context
0807 10:36:17.216355 (+ 108us) client_negotiation.cc:240] Negotiation successful
0807 10:36:17.216490 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1154,"thread_start_us":952,"threads_started":1}
I20260807 10:36:17.218063 23612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:17.204348 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.66:46085 (local address 127.20.171.65:43331)
0807 10:36:17.206390 (+ 2042us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:17.206399 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:17.206438 (+ 39us) server_negotiation.cc:407] Connection header received
0807 10:36:17.206526 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:17.206534 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:17.206633 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:17.206769 (+ 136us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:36:17.208396 (+ 1627us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:17.210087 (+ 1691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:17.213894 (+ 3807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:17.215487 (+ 1593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:17.215805 (+ 318us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:17.215888 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:17.217211 (+ 1323us) server_negotiation.cc:299] Negotiation successful
0807 10:36:17.217410 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1813,"thread_start_us":1526,"threads_started":1}
I20260807 10:36:17.218786 23156 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5ca23d937b254632a102d5e93a7754dc" candidate_uuid: "54772e1ff58a436ba58a0ac5bfa97a59" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3d1e4c904da4a68909c233e148b45c2" is_pre_election: true
I20260807 10:36:17.219260 23156 raft_consensus.cc:2379] T 5ca23d937b254632a102d5e93a7754dc P a3d1e4c904da4a68909c233e148b45c2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 54772e1ff58a436ba58a0ac5bfa97a59 in current term 1: Already voted for candidate efab605345b447e398d4ae5bbd44dd32 in this term.
I20260807 10:36:17.219434 23613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:17.204855 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.67:35493 (local address 127.20.171.66:41877)
0807 10:36:17.206876 (+ 2021us) negotiation.cc:107] Waiting for socket to connect
0807 10:36:17.206896 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0807 10:36:17.207022 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:36:17.210426 (+ 3404us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:36:17.210430 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:36:17.210454 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:36:17.211657 (+ 1203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:17.211678 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:17.213839 (+ 2161us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:17.213844 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:17.215894 (+ 2050us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:17.215906 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:17.218053 (+ 2147us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:17.218061 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:17.218390 (+ 329us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:17.218425 (+ 35us) client_negotiation.cc:769] Sending connection context
0807 10:36:17.218554 (+ 129us) client_negotiation.cc:240] Negotiation successful
0807 10:36:17.218755 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1811,"thread_start_us":3899,"threads_started":1}
I20260807 10:36:17.220017 22988 catalog_manager.cc:5495] T 5ca23d937b254632a102d5e93a7754dc P efab605345b447e398d4ae5bbd44dd32 reported cstate change: term changed from 0 to 1, leader changed from <none> to efab605345b447e398d4ae5bbd44dd32 (127.20.171.67). New cstate: current_term: 1 leader_uuid: "efab605345b447e398d4ae5bbd44dd32" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3d1e4c904da4a68909c233e148b45c2" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 43331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54772e1ff58a436ba58a0ac5bfa97a59" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 38257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efab605345b447e398d4ae5bbd44dd32" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 35493 } health_report { overall_health: HEALTHY } } }
I20260807 10:36:17.220443 23614 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:17.204729 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.66:41877 (local address 127.20.171.67:35493)
0807 10:36:17.209932 (+ 5203us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:17.209938 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:17.209968 (+ 30us) server_negotiation.cc:407] Connection header received
0807 10:36:17.210025 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:17.210029 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:17.210114 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:17.210212 (+ 98us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:36:17.212195 (+ 1983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:17.213674 (+ 1479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:17.216102 (+ 2428us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:17.217297 (+ 1195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:17.217595 (+ 298us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:17.217716 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:17.219658 (+ 1942us) server_negotiation.cc:299] Negotiation successful
0807 10:36:17.219831 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5046,"thread_start_us":4789,"threads_started":1}
I20260807 10:36:17.221184 23439 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5ca23d937b254632a102d5e93a7754dc" candidate_uuid: "54772e1ff58a436ba58a0ac5bfa97a59" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efab605345b447e398d4ae5bbd44dd32" is_pre_election: true
I20260807 10:36:17.222245 23225 leader_election.cc:302] T 5ca23d937b254632a102d5e93a7754dc P 54772e1ff58a436ba58a0ac5bfa97a59 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54772e1ff58a436ba58a0ac5bfa97a59; no voters: a3d1e4c904da4a68909c233e148b45c2, efab605345b447e398d4ae5bbd44dd32
I20260807 10:36:17.223026 23609 raft_consensus.cc:2726] T 5ca23d937b254632a102d5e93a7754dc P 54772e1ff58a436ba58a0ac5bfa97a59 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 10:36:17.256312 23614 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:17.250602 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52502 (local address 127.20.171.67:35493)
0807 10:36:17.250791 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:17.250798 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:17.251034 (+ 236us) server_negotiation.cc:407] Connection header received
0807 10:36:17.251287 (+ 253us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:17.251293 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:17.251375 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:17.251478 (+ 103us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 10:36:17.251864 (+ 386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:17.252898 (+ 1034us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:17.254543 (+ 1645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:17.254969 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:17.255101 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:17.255527 (+ 426us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 10:36:17.255630 (+ 103us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 10:36:17.255739 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:17.255899 (+ 160us) server_negotiation.cc:299] Negotiation successful
0807 10:36:17.255975 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260807 10:36:17.274441 23156 raft_consensus.cc:1261] T 5ca23d937b254632a102d5e93a7754dc P a3d1e4c904da4a68909c233e148b45c2 [term 1 FOLLOWER]: Refusing update from remote peer efab605345b447e398d4ae5bbd44dd32: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 10:36:17.274576 23294 raft_consensus.cc:1261] T 5ca23d937b254632a102d5e93a7754dc P 54772e1ff58a436ba58a0ac5bfa97a59 [term 1 FOLLOWER]: Refusing update from remote peer efab605345b447e398d4ae5bbd44dd32: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 10:36:17.275233 23584 consensus_queue.cc:1035] T 5ca23d937b254632a102d5e93a7754dc P efab605345b447e398d4ae5bbd44dd32 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3d1e4c904da4a68909c233e148b45c2" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 43331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 10:36:17.275730 23572 consensus_queue.cc:1035] T 5ca23d937b254632a102d5e93a7754dc P efab605345b447e398d4ae5bbd44dd32 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54772e1ff58a436ba58a0ac5bfa97a59" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 38257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 10:36:17.323870 22988 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:60892:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 10:36:17.324152 22988 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:60892:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 10:36:17.327265 22988 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 95c5073aefc9420fa0091dba7c7479a1: Sending DeleteTablet for 3 replicas of tablet 5ca23d937b254632a102d5e93a7754dc
I20260807 10:36:17.328372 23129 tablet_service.cc:1514] Processing DeleteTablet for tablet 5ca23d937b254632a102d5e93a7754dc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:36:17 UTC) from {username='kudu', principal='kudu/127.20.171.126@KRBTEST.COM'} at 127.0.0.1:57140
I20260807 10:36:17.328487 23273 tablet_service.cc:1514] Processing DeleteTablet for tablet 5ca23d937b254632a102d5e93a7754dc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:36:17 UTC) from {username='kudu', principal='kudu/127.20.171.126@KRBTEST.COM'} at 127.0.0.1:60488
I20260807 10:36:17.328679 23415 tablet_service.cc:1514] Processing DeleteTablet for tablet 5ca23d937b254632a102d5e93a7754dc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:36:17 UTC) from {username='kudu', principal='kudu/127.20.171.126@KRBTEST.COM'} at 127.0.0.1:52484
I20260807 10:36:17.328748 23591 tablet_replica.cc:330] T 5ca23d937b254632a102d5e93a7754dc P a3d1e4c904da4a68909c233e148b45c2: stopping tablet replica
I20260807 10:36:17.328892 23592 tablet_replica.cc:330] T 5ca23d937b254632a102d5e93a7754dc P 54772e1ff58a436ba58a0ac5bfa97a59: stopping tablet replica
I20260807 10:36:17.328989 23593 tablet_replica.cc:330] T 5ca23d937b254632a102d5e93a7754dc P efab605345b447e398d4ae5bbd44dd32: stopping tablet replica
I20260807 10:36:17.329061 23591 raft_consensus.cc:2229] T 5ca23d937b254632a102d5e93a7754dc P a3d1e4c904da4a68909c233e148b45c2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 10:36:17.329118 23592 raft_consensus.cc:2229] T 5ca23d937b254632a102d5e93a7754dc P 54772e1ff58a436ba58a0ac5bfa97a59 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 10:36:17.329207 23593 raft_consensus.cc:2229] T 5ca23d937b254632a102d5e93a7754dc P efab605345b447e398d4ae5bbd44dd32 [term 1 LEADER]: Raft consensus shutting down.
I20260807 10:36:17.329276 23591 raft_consensus.cc:2258] T 5ca23d937b254632a102d5e93a7754dc P a3d1e4c904da4a68909c233e148b45c2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:36:17.329299 23592 raft_consensus.cc:2258] T 5ca23d937b254632a102d5e93a7754dc P 54772e1ff58a436ba58a0ac5bfa97a59 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:36:17.329432 23593 raft_consensus.cc:2258] T 5ca23d937b254632a102d5e93a7754dc P efab605345b447e398d4ae5bbd44dd32 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:36:17.330415 23593 ts_tablet_manager.cc:1905] T 5ca23d937b254632a102d5e93a7754dc P efab605345b447e398d4ae5bbd44dd32: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 10:36:17.330502 23591 ts_tablet_manager.cc:1905] T 5ca23d937b254632a102d5e93a7754dc P a3d1e4c904da4a68909c233e148b45c2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 10:36:17.330559 23592 ts_tablet_manager.cc:1905] T 5ca23d937b254632a102d5e93a7754dc P 54772e1ff58a436ba58a0ac5bfa97a59: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 10:36:17.330411 22988 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:60892:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 10:36:17.331197 22988 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 10:36:17.337366 23591 ts_tablet_manager.cc:1918] T 5ca23d937b254632a102d5e93a7754dc P a3d1e4c904da4a68909c233e148b45c2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 10:36:17.337581 23591 log.cc:1196] T 5ca23d937b254632a102d5e93a7754dc P a3d1e4c904da4a68909c233e148b45c2: Deleting WAL directory at /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786098956060137-21165-0/minicluster-data/ts-0/wal/wals/5ca23d937b254632a102d5e93a7754dc
I20260807 10:36:17.338085 23591 ts_tablet_manager.cc:1939] T 5ca23d937b254632a102d5e93a7754dc P a3d1e4c904da4a68909c233e148b45c2: Deleting consensus metadata
I20260807 10:36:17.338435 23592 ts_tablet_manager.cc:1918] T 5ca23d937b254632a102d5e93a7754dc P 54772e1ff58a436ba58a0ac5bfa97a59: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 10:36:17.338646 23592 log.cc:1196] T 5ca23d937b254632a102d5e93a7754dc P 54772e1ff58a436ba58a0ac5bfa97a59: Deleting WAL directory at /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786098956060137-21165-0/minicluster-data/ts-1/wal/wals/5ca23d937b254632a102d5e93a7754dc
I20260807 10:36:17.339133 23592 ts_tablet_manager.cc:1939] T 5ca23d937b254632a102d5e93a7754dc P 54772e1ff58a436ba58a0ac5bfa97a59: Deleting consensus metadata
I20260807 10:36:17.339227 22970 catalog_manager.cc:4841] TS a3d1e4c904da4a68909c233e148b45c2 (127.20.171.65:43331): tablet 5ca23d937b254632a102d5e93a7754dc (table test-table [id=97b22b7b7a494175a76002147c2c0b03]) successfully deleted
I20260807 10:36:17.340222 23593 ts_tablet_manager.cc:1918] T 5ca23d937b254632a102d5e93a7754dc P efab605345b447e398d4ae5bbd44dd32: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 10:36:17.340221 22972 catalog_manager.cc:4841] TS 54772e1ff58a436ba58a0ac5bfa97a59 (127.20.171.66:38257): tablet 5ca23d937b254632a102d5e93a7754dc (table test-table [id=97b22b7b7a494175a76002147c2c0b03]) successfully deleted
I20260807 10:36:17.340610 23593 log.cc:1196] T 5ca23d937b254632a102d5e93a7754dc P efab605345b447e398d4ae5bbd44dd32: Deleting WAL directory at /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786098956060137-21165-0/minicluster-data/ts-2/wal/wals/5ca23d937b254632a102d5e93a7754dc
I20260807 10:36:17.341238 23593 ts_tablet_manager.cc:1939] T 5ca23d937b254632a102d5e93a7754dc P efab605345b447e398d4ae5bbd44dd32: Deleting consensus metadata
I20260807 10:36:17.342945 22972 catalog_manager.cc:4841] TS efab605345b447e398d4ae5bbd44dd32 (127.20.171.67:35493): tablet 5ca23d937b254632a102d5e93a7754dc (table test-table [id=97b22b7b7a494175a76002147c2c0b03]) successfully deleted
I20260807 10:36:17.344293 23129 tablet_service.cc:1467] Processing CreateTablet for tablet dd002377e2814ae9812d3597b4421045 (DEFAULT_TABLE table=test-table [id=ef96717d88bd4c9798e4240e890fd03e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:36:17.344693 23129 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dd002377e2814ae9812d3597b4421045. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:36:17.345191 23273 tablet_service.cc:1467] Processing CreateTablet for tablet dd002377e2814ae9812d3597b4421045 (DEFAULT_TABLE table=test-table [id=ef96717d88bd4c9798e4240e890fd03e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:36:17.345310 23415 tablet_service.cc:1467] Processing CreateTablet for tablet dd002377e2814ae9812d3597b4421045 (DEFAULT_TABLE table=test-table [id=ef96717d88bd4c9798e4240e890fd03e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:36:17.345692 23273 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dd002377e2814ae9812d3597b4421045. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:36:17.345762 23415 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dd002377e2814ae9812d3597b4421045. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:36:17.353369 23605 tablet_bootstrap.cc:492] T dd002377e2814ae9812d3597b4421045 P 54772e1ff58a436ba58a0ac5bfa97a59: Bootstrap starting.
I20260807 10:36:17.354669 23604 tablet_bootstrap.cc:492] T dd002377e2814ae9812d3597b4421045 P efab605345b447e398d4ae5bbd44dd32: Bootstrap starting.
I20260807 10:36:17.356132 23605 tablet_bootstrap.cc:654] T dd002377e2814ae9812d3597b4421045 P 54772e1ff58a436ba58a0ac5bfa97a59: Neither blocks nor log segments found. Creating new log.
I20260807 10:36:17.356554 23603 tablet_bootstrap.cc:492] T dd002377e2814ae9812d3597b4421045 P a3d1e4c904da4a68909c233e148b45c2: Bootstrap starting.
I20260807 10:36:17.357383 23604 tablet_bootstrap.cc:654] T dd002377e2814ae9812d3597b4421045 P efab605345b447e398d4ae5bbd44dd32: Neither blocks nor log segments found. Creating new log.
I20260807 10:36:17.358685 23603 tablet_bootstrap.cc:654] T dd002377e2814ae9812d3597b4421045 P a3d1e4c904da4a68909c233e148b45c2: Neither blocks nor log segments found. Creating new log.
I20260807 10:36:17.359895 23605 tablet_bootstrap.cc:492] T dd002377e2814ae9812d3597b4421045 P 54772e1ff58a436ba58a0ac5bfa97a59: No bootstrap required, opened a new log
I20260807 10:36:17.360172 23605 ts_tablet_manager.cc:1397] T dd002377e2814ae9812d3597b4421045 P 54772e1ff58a436ba58a0ac5bfa97a59: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.001s
I20260807 10:36:17.361254 23605 raft_consensus.cc:348] T dd002377e2814ae9812d3597b4421045 P 54772e1ff58a436ba58a0ac5bfa97a59 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3d1e4c904da4a68909c233e148b45c2" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 43331 } } peers { permanent_uuid: "54772e1ff58a436ba58a0ac5bfa97a59" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 38257 } } peers { permanent_uuid: "efab605345b447e398d4ae5bbd44dd32" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 35493 } }
I20260807 10:36:17.361552 23603 tablet_bootstrap.cc:492] T dd002377e2814ae9812d3597b4421045 P a3d1e4c904da4a68909c233e148b45c2: No bootstrap required, opened a new log
I20260807 10:36:17.361572 23605 raft_consensus.cc:374] T dd002377e2814ae9812d3597b4421045 P 54772e1ff58a436ba58a0ac5bfa97a59 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:36:17.361737 23605 raft_consensus.cc:729] T dd002377e2814ae9812d3597b4421045 P 54772e1ff58a436ba58a0ac5bfa97a59 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54772e1ff58a436ba58a0ac5bfa97a59, State: Initialized, Role: FOLLOWER
I20260807 10:36:17.361769 23603 ts_tablet_manager.cc:1397] T dd002377e2814ae9812d3597b4421045 P a3d1e4c904da4a68909c233e148b45c2: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.003s
I20260807 10:36:17.362051 23605 consensus_queue.cc:260] T dd002377e2814ae9812d3597b4421045 P 54772e1ff58a436ba58a0ac5bfa97a59 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3d1e4c904da4a68909c233e148b45c2" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 43331 } } peers { permanent_uuid: "54772e1ff58a436ba58a0ac5bfa97a59" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 38257 } } peers { permanent_uuid: "efab605345b447e398d4ae5bbd44dd32" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 35493 } }
I20260807 10:36:17.362735 23605 ts_tablet_manager.cc:1428] T dd002377e2814ae9812d3597b4421045 P 54772e1ff58a436ba58a0ac5bfa97a59: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260807 10:36:17.362741 23603 raft_consensus.cc:348] T dd002377e2814ae9812d3597b4421045 P a3d1e4c904da4a68909c233e148b45c2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3d1e4c904da4a68909c233e148b45c2" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 43331 } } peers { permanent_uuid: "54772e1ff58a436ba58a0ac5bfa97a59" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 38257 } } peers { permanent_uuid: "efab605345b447e398d4ae5bbd44dd32" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 35493 } }
I20260807 10:36:17.363305 23603 raft_consensus.cc:374] T dd002377e2814ae9812d3597b4421045 P a3d1e4c904da4a68909c233e148b45c2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:36:17.363505 23603 raft_consensus.cc:729] T dd002377e2814ae9812d3597b4421045 P a3d1e4c904da4a68909c233e148b45c2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3d1e4c904da4a68909c233e148b45c2, State: Initialized, Role: FOLLOWER
I20260807 10:36:17.363873 23603 consensus_queue.cc:260] T dd002377e2814ae9812d3597b4421045 P a3d1e4c904da4a68909c233e148b45c2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3d1e4c904da4a68909c233e148b45c2" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 43331 } } peers { permanent_uuid: "54772e1ff58a436ba58a0ac5bfa97a59" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 38257 } } peers { permanent_uuid: "efab605345b447e398d4ae5bbd44dd32" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 35493 } }
I20260807 10:36:17.364446 23603 ts_tablet_manager.cc:1428] T dd002377e2814ae9812d3597b4421045 P a3d1e4c904da4a68909c233e148b45c2: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260807 10:36:17.364887 23604 tablet_bootstrap.cc:492] T dd002377e2814ae9812d3597b4421045 P efab605345b447e398d4ae5bbd44dd32: No bootstrap required, opened a new log
I20260807 10:36:17.365130 23604 ts_tablet_manager.cc:1397] T dd002377e2814ae9812d3597b4421045 P efab605345b447e398d4ae5bbd44dd32: Time spent bootstrapping tablet: real 0.011s user 0.001s sys 0.005s
I20260807 10:36:17.366698 23604 raft_consensus.cc:348] T dd002377e2814ae9812d3597b4421045 P efab605345b447e398d4ae5bbd44dd32 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3d1e4c904da4a68909c233e148b45c2" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 43331 } } peers { permanent_uuid: "54772e1ff58a436ba58a0ac5bfa97a59" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 38257 } } peers { permanent_uuid: "efab605345b447e398d4ae5bbd44dd32" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 35493 } }
I20260807 10:36:17.367177 23604 raft_consensus.cc:374] T dd002377e2814ae9812d3597b4421045 P efab605345b447e398d4ae5bbd44dd32 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:36:17.367322 23604 raft_consensus.cc:729] T dd002377e2814ae9812d3597b4421045 P efab605345b447e398d4ae5bbd44dd32 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efab605345b447e398d4ae5bbd44dd32, State: Initialized, Role: FOLLOWER
I20260807 10:36:17.367898 23604 consensus_queue.cc:260] T dd002377e2814ae9812d3597b4421045 P efab605345b447e398d4ae5bbd44dd32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3d1e4c904da4a68909c233e148b45c2" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 43331 } } peers { permanent_uuid: "54772e1ff58a436ba58a0ac5bfa97a59" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 38257 } } peers { permanent_uuid: "efab605345b447e398d4ae5bbd44dd32" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 35493 } }
I20260807 10:36:17.369184 23604 ts_tablet_manager.cc:1428] T dd002377e2814ae9812d3597b4421045 P efab605345b447e398d4ae5bbd44dd32: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260807 10:36:17.391004 23572 raft_consensus.cc:482] T dd002377e2814ae9812d3597b4421045 P efab605345b447e398d4ae5bbd44dd32 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 10:36:17.391265 23572 raft_consensus.cc:504] T dd002377e2814ae9812d3597b4421045 P efab605345b447e398d4ae5bbd44dd32 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3d1e4c904da4a68909c233e148b45c2" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 43331 } } peers { permanent_uuid: "54772e1ff58a436ba58a0ac5bfa97a59" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 38257 } } peers { permanent_uuid: "efab605345b447e398d4ae5bbd44dd32" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 35493 } }
I20260807 10:36:17.392081 23572 leader_election.cc:288] T dd002377e2814ae9812d3597b4421045 P efab605345b447e398d4ae5bbd44dd32 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3d1e4c904da4a68909c233e148b45c2 (127.20.171.65:43331), 54772e1ff58a436ba58a0ac5bfa97a59 (127.20.171.66:38257)
I20260807 10:36:17.392752 23295 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dd002377e2814ae9812d3597b4421045" candidate_uuid: "efab605345b447e398d4ae5bbd44dd32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54772e1ff58a436ba58a0ac5bfa97a59" is_pre_election: true
I20260807 10:36:17.392721 23154 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dd002377e2814ae9812d3597b4421045" candidate_uuid: "efab605345b447e398d4ae5bbd44dd32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3d1e4c904da4a68909c233e148b45c2" is_pre_election: true
I20260807 10:36:17.393018 23295 raft_consensus.cc:2454] T dd002377e2814ae9812d3597b4421045 P 54772e1ff58a436ba58a0ac5bfa97a59 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efab605345b447e398d4ae5bbd44dd32 in term 0.
I20260807 10:36:17.393074 23154 raft_consensus.cc:2454] T dd002377e2814ae9812d3597b4421045 P a3d1e4c904da4a68909c233e148b45c2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efab605345b447e398d4ae5bbd44dd32 in term 0.
I20260807 10:36:17.393497 23368 leader_election.cc:302] T dd002377e2814ae9812d3597b4421045 P efab605345b447e398d4ae5bbd44dd32 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54772e1ff58a436ba58a0ac5bfa97a59, efab605345b447e398d4ae5bbd44dd32; no voters:
I20260807 10:36:17.393817 23572 raft_consensus.cc:2781] T dd002377e2814ae9812d3597b4421045 P efab605345b447e398d4ae5bbd44dd32 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 10:36:17.394013 23572 raft_consensus.cc:482] T dd002377e2814ae9812d3597b4421045 P efab605345b447e398d4ae5bbd44dd32 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 10:36:17.394204 23572 raft_consensus.cc:3037] T dd002377e2814ae9812d3597b4421045 P efab605345b447e398d4ae5bbd44dd32 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:36:17.396761 23572 raft_consensus.cc:504] T dd002377e2814ae9812d3597b4421045 P efab605345b447e398d4ae5bbd44dd32 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3d1e4c904da4a68909c233e148b45c2" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 43331 } } peers { permanent_uuid: "54772e1ff58a436ba58a0ac5bfa97a59" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 38257 } } peers { permanent_uuid: "efab605345b447e398d4ae5bbd44dd32" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 35493 } }
I20260807 10:36:17.397400 23572 leader_election.cc:288] T dd002377e2814ae9812d3597b4421045 P efab605345b447e398d4ae5bbd44dd32 [CANDIDATE]: Term 1 election: Requested vote from peers a3d1e4c904da4a68909c233e148b45c2 (127.20.171.65:43331), 54772e1ff58a436ba58a0ac5bfa97a59 (127.20.171.66:38257)
I20260807 10:36:17.397950 23154 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dd002377e2814ae9812d3597b4421045" candidate_uuid: "efab605345b447e398d4ae5bbd44dd32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3d1e4c904da4a68909c233e148b45c2"
I20260807 10:36:17.398053 23295 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dd002377e2814ae9812d3597b4421045" candidate_uuid: "efab605345b447e398d4ae5bbd44dd32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54772e1ff58a436ba58a0ac5bfa97a59"
I20260807 10:36:17.398551 23154 raft_consensus.cc:3037] T dd002377e2814ae9812d3597b4421045 P a3d1e4c904da4a68909c233e148b45c2 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:36:17.398551 23295 raft_consensus.cc:3037] T dd002377e2814ae9812d3597b4421045 P 54772e1ff58a436ba58a0ac5bfa97a59 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:36:17.402964 23295 raft_consensus.cc:2454] T dd002377e2814ae9812d3597b4421045 P 54772e1ff58a436ba58a0ac5bfa97a59 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efab605345b447e398d4ae5bbd44dd32 in term 1.
I20260807 10:36:17.403251 23154 raft_consensus.cc:2454] T dd002377e2814ae9812d3597b4421045 P a3d1e4c904da4a68909c233e148b45c2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efab605345b447e398d4ae5bbd44dd32 in term 1.
I20260807 10:36:17.403563 23368 leader_election.cc:302] T dd002377e2814ae9812d3597b4421045 P efab605345b447e398d4ae5bbd44dd32 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54772e1ff58a436ba58a0ac5bfa97a59, efab605345b447e398d4ae5bbd44dd32; no voters:
I20260807 10:36:17.404036 23572 raft_consensus.cc:2781] T dd002377e2814ae9812d3597b4421045 P efab605345b447e398d4ae5bbd44dd32 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:36:17.404278 23572 raft_consensus.cc:686] T dd002377e2814ae9812d3597b4421045 P efab605345b447e398d4ae5bbd44dd32 [term 1 LEADER]: Becoming Leader. State: Replica: efab605345b447e398d4ae5bbd44dd32, State: Running, Role: LEADER
I20260807 10:36:17.404675 23572 consensus_queue.cc:237] T dd002377e2814ae9812d3597b4421045 P efab605345b447e398d4ae5bbd44dd32 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3d1e4c904da4a68909c233e148b45c2" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 43331 } } peers { permanent_uuid: "54772e1ff58a436ba58a0ac5bfa97a59" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 38257 } } peers { permanent_uuid: "efab605345b447e398d4ae5bbd44dd32" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 35493 } }
I20260807 10:36:17.407930 22987 catalog_manager.cc:5495] T dd002377e2814ae9812d3597b4421045 P efab605345b447e398d4ae5bbd44dd32 reported cstate change: term changed from 0 to 1, leader changed from <none> to efab605345b447e398d4ae5bbd44dd32 (127.20.171.67). New cstate: current_term: 1 leader_uuid: "efab605345b447e398d4ae5bbd44dd32" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3d1e4c904da4a68909c233e148b45c2" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 43331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54772e1ff58a436ba58a0ac5bfa97a59" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 38257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efab605345b447e398d4ae5bbd44dd32" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 35493 } health_report { overall_health: HEALTHY } } }
I20260807 10:36:17.443077 23295 raft_consensus.cc:1261] T dd002377e2814ae9812d3597b4421045 P 54772e1ff58a436ba58a0ac5bfa97a59 [term 1 FOLLOWER]: Refusing update from remote peer efab605345b447e398d4ae5bbd44dd32: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 10:36:17.443296 23154 raft_consensus.cc:1261] T dd002377e2814ae9812d3597b4421045 P a3d1e4c904da4a68909c233e148b45c2 [term 1 FOLLOWER]: Refusing update from remote peer efab605345b447e398d4ae5bbd44dd32: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 10:36:17.443588 23572 consensus_queue.cc:1035] T dd002377e2814ae9812d3597b4421045 P efab605345b447e398d4ae5bbd44dd32 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54772e1ff58a436ba58a0ac5bfa97a59" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 38257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 10:36:17.443934 23584 consensus_queue.cc:1035] T dd002377e2814ae9812d3597b4421045 P efab605345b447e398d4ae5bbd44dd32 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3d1e4c904da4a68909c233e148b45c2" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 43331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260807 10:36:17.466670 23570 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260807 10:36:19.058422 22986 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:60892:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 10:36:19.058781 22986 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:60892:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 10:36:19.064400 22986 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 95c5073aefc9420fa0091dba7c7479a1: Sending DeleteTablet for 3 replicas of tablet dd002377e2814ae9812d3597b4421045
I20260807 10:36:19.065313 23129 tablet_service.cc:1514] Processing DeleteTablet for tablet dd002377e2814ae9812d3597b4421045 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:36:19 UTC) from {username='kudu', principal='kudu/127.20.171.126@KRBTEST.COM'} at 127.0.0.1:57140
I20260807 10:36:19.065495 23415 tablet_service.cc:1514] Processing DeleteTablet for tablet dd002377e2814ae9812d3597b4421045 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:36:19 UTC) from {username='kudu', principal='kudu/127.20.171.126@KRBTEST.COM'} at 127.0.0.1:52484
I20260807 10:36:19.065487 23273 tablet_service.cc:1514] Processing DeleteTablet for tablet dd002377e2814ae9812d3597b4421045 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:36:19 UTC) from {username='kudu', principal='kudu/127.20.171.126@KRBTEST.COM'} at 127.0.0.1:60488
I20260807 10:36:19.066062 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 23060
I20260807 10:36:19.078297 23646 tablet_replica.cc:330] T dd002377e2814ae9812d3597b4421045 P a3d1e4c904da4a68909c233e148b45c2: stopping tablet replica
I20260807 10:36:19.078748 23646 raft_consensus.cc:2229] T dd002377e2814ae9812d3597b4421045 P a3d1e4c904da4a68909c233e148b45c2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 10:36:19.079417 23646 raft_consensus.cc:2258] T dd002377e2814ae9812d3597b4421045 P a3d1e4c904da4a68909c233e148b45c2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:36:19.080813 23646 ts_tablet_manager.cc:1905] T dd002377e2814ae9812d3597b4421045 P a3d1e4c904da4a68909c233e148b45c2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 10:36:19.081466 23648 tablet_replica.cc:330] T dd002377e2814ae9812d3597b4421045 P efab605345b447e398d4ae5bbd44dd32: stopping tablet replica
I20260807 10:36:19.081944 23648 raft_consensus.cc:2229] T dd002377e2814ae9812d3597b4421045 P efab605345b447e398d4ae5bbd44dd32 [term 1 LEADER]: Raft consensus shutting down.
I20260807 10:36:19.082545 23648 raft_consensus.cc:2258] T dd002377e2814ae9812d3597b4421045 P efab605345b447e398d4ae5bbd44dd32 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:36:19.083281 23647 tablet_replica.cc:330] T dd002377e2814ae9812d3597b4421045 P 54772e1ff58a436ba58a0ac5bfa97a59: stopping tablet replica
I20260807 10:36:19.083561 23647 raft_consensus.cc:2229] T dd002377e2814ae9812d3597b4421045 P 54772e1ff58a436ba58a0ac5bfa97a59 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 10:36:19.083905 23647 raft_consensus.cc:2258] T dd002377e2814ae9812d3597b4421045 P 54772e1ff58a436ba58a0ac5bfa97a59 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:36:19.084887 23648 ts_tablet_manager.cc:1905] T dd002377e2814ae9812d3597b4421045 P efab605345b447e398d4ae5bbd44dd32: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 10:36:19.089870 23646 ts_tablet_manager.cc:1918] T dd002377e2814ae9812d3597b4421045 P a3d1e4c904da4a68909c233e148b45c2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260807 10:36:19.090165 23646 log.cc:1196] T dd002377e2814ae9812d3597b4421045 P a3d1e4c904da4a68909c233e148b45c2: Deleting WAL directory at /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786098956060137-21165-0/minicluster-data/ts-0/wal/wals/dd002377e2814ae9812d3597b4421045
I20260807 10:36:19.090950 23646 ts_tablet_manager.cc:1939] T dd002377e2814ae9812d3597b4421045 P a3d1e4c904da4a68909c233e148b45c2: Deleting consensus metadata
I20260807 10:36:19.092288 22970 catalog_manager.cc:4841] TS a3d1e4c904da4a68909c233e148b45c2 (127.20.171.65:43331): tablet dd002377e2814ae9812d3597b4421045 (table test-table [id=ef96717d88bd4c9798e4240e890fd03e]) successfully deleted
I20260807 10:36:19.092747 23647 ts_tablet_manager.cc:1905] T dd002377e2814ae9812d3597b4421045 P 54772e1ff58a436ba58a0ac5bfa97a59: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 10:36:19.093752 23648 ts_tablet_manager.cc:1918] T dd002377e2814ae9812d3597b4421045 P efab605345b447e398d4ae5bbd44dd32: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260807 10:36:19.094030 23648 log.cc:1196] T dd002377e2814ae9812d3597b4421045 P efab605345b447e398d4ae5bbd44dd32: Deleting WAL directory at /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786098956060137-21165-0/minicluster-data/ts-2/wal/wals/dd002377e2814ae9812d3597b4421045
I20260807 10:36:19.094816 23648 ts_tablet_manager.cc:1939] T dd002377e2814ae9812d3597b4421045 P efab605345b447e398d4ae5bbd44dd32: Deleting consensus metadata
I20260807 10:36:19.096189 22972 catalog_manager.cc:4841] TS efab605345b447e398d4ae5bbd44dd32 (127.20.171.67:35493): tablet dd002377e2814ae9812d3597b4421045 (table test-table [id=ef96717d88bd4c9798e4240e890fd03e]) successfully deleted
Aug 07 10:36:19 dist-test-slave-0b58 krb5kdc[22940](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786098977, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.20.171.65@KRBTEST.COM
I20260807 10:36:19.101649 23647 ts_tablet_manager.cc:1918] T dd002377e2814ae9812d3597b4421045 P 54772e1ff58a436ba58a0ac5bfa97a59: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260807 10:36:19.101866 23647 log.cc:1196] T dd002377e2814ae9812d3597b4421045 P 54772e1ff58a436ba58a0ac5bfa97a59: Deleting WAL directory at /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786098956060137-21165-0/minicluster-data/ts-1/wal/wals/dd002377e2814ae9812d3597b4421045
I20260807 10:36:19.102391 23647 ts_tablet_manager.cc:1939] T dd002377e2814ae9812d3597b4421045 P 54772e1ff58a436ba58a0ac5bfa97a59: Deleting consensus metadata
I20260807 10:36:19.103395 22972 catalog_manager.cc:4841] TS 54772e1ff58a436ba58a0ac5bfa97a59 (127.20.171.66:38257): tablet dd002377e2814ae9812d3597b4421045 (table test-table [id=ef96717d88bd4c9798e4240e890fd03e]) successfully deleted
I20260807 10:36:19.108731 23649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:19.068600 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57166 (local address 127.20.171.65:43331)
0807 10:36:19.077111 (+ 8511us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:19.077119 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:19.078243 (+ 1124us) server_negotiation.cc:407] Connection header received
0807 10:36:19.078331 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:19.078338 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:19.078439 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:19.078556 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:36:19.085942 (+ 7386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:19.088318 (+ 2376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:19.090900 (+ 2582us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:19.091887 (+ 987us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:19.092037 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:19.101901 (+ 9864us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:36:19.101921 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:36:19.101967 (+ 46us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:36:19.102015 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:36:19.105991 (+ 3976us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:19.106641 (+ 650us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:19.106648 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:19.106650 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:19.106801 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:19.107144 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:19.107147 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:19.107149 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:19.107536 (+ 387us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:36:19.107814 (+ 278us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:19.108048 (+ 234us) server_negotiation.cc:299] Negotiation successful
0807 10:36:19.108233 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":8195,"thread_start_us":7941,"threads_started":1}
W20260807 10:36:19.109485 23196 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:57166
W20260807 10:36:19.110296 21165 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 23060: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260807 10:36:19.110651 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 23060
I20260807 10:36:19.138685 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 23205
Aug 07 10:36:19 dist-test-slave-0b58 krb5kdc[22940](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786098977, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.20.171.66@KRBTEST.COM
I20260807 10:36:19.154116 23651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:19.139356 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60500 (local address 127.20.171.66:38257)
0807 10:36:19.139869 (+ 513us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:19.139873 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:19.139887 (+ 14us) server_negotiation.cc:407] Connection header received
0807 10:36:19.139937 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:19.139940 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:19.139994 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:19.140117 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:36:19.141446 (+ 1329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:19.142174 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:19.143424 (+ 1250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:19.143808 (+ 384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:19.143944 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:19.148037 (+ 4093us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:36:19.148049 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:36:19.148063 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:36:19.148096 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:36:19.151474 (+ 3378us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:19.152096 (+ 622us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:19.152103 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:19.152105 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:19.152241 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:19.152662 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:19.152665 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:19.152667 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:19.153060 (+ 393us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:36:19.153303 (+ 243us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:19.153586 (+ 283us) server_negotiation.cc:299] Negotiation successful
0807 10:36:19.153753 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":406,"thread_start_us":271,"threads_started":1}
W20260807 10:36:19.154886 23341 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:60500
W20260807 10:36:19.155611 21165 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 23205: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260807 10:36:19.155766 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 23205
I20260807 10:36:19.177992 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 23350
Aug 07 10:36:19 dist-test-slave-0b58 krb5kdc[22940](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786098977, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.20.171.67@KRBTEST.COM
I20260807 10:36:19.192240 23652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:19.178746 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52514 (local address 127.20.171.67:35493)
0807 10:36:19.179285 (+ 539us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:19.179290 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:19.179306 (+ 16us) server_negotiation.cc:407] Connection header received
0807 10:36:19.179359 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:19.179362 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:19.179416 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:19.179499 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:36:19.180829 (+ 1330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:19.181560 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:19.182692 (+ 1132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:19.183056 (+ 364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:19.183136 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:19.187125 (+ 3989us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:36:19.187140 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:36:19.187156 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:36:19.187193 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:36:19.189921 (+ 2728us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:19.190508 (+ 587us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:19.190515 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:19.190516 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:19.190657 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:19.190980 (+ 323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:19.190983 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:19.190985 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:19.191340 (+ 355us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:36:19.191557 (+ 217us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:19.191826 (+ 269us) server_negotiation.cc:299] Negotiation successful
0807 10:36:19.191989 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":436,"thread_start_us":296,"threads_started":1}
W20260807 10:36:19.192998 23482 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:52514
W20260807 10:36:19.193640 21165 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 23350: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260807 10:36:19.193806 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 23350
I20260807 10:36:19.224121 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 22954
I20260807 10:36:19.225394 23029 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:36:19.355144 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 22954
2026-08-07T10:36:19Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (8470 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786098956060137-21165-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 10:36:19 dist-test-slave-0b58 krb5kdc[23656](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 10:36:19 dist-test-slave-0b58 krb5kdc[23656](info): set up 2 sockets
Aug 07 10:36:19 dist-test-slave-0b58 krb5kdc[23656](info): commencing operation
krb5kdc: starting...
W20260807 10:36:20.426964 21165 mini_kdc.cc:121] Time spent starting KDC: real 1.023s user 0.000s sys 0.024s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786098956060137-21165-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786098956060137-21165-0/krb5kdc/test-user.keytab.
Aug 07 10:36:20 dist-test-slave-0b58 krb5kdc[23656](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786098980, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T10:36:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T10:36:20Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.171.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.171.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.171.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.126.keytab.
Entry for principal kudu/127.20.171.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.126.keytab.
I20260807 10:36:20.644532 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786098956060137-21165-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786098956060137-21165-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786098956060137-21165-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.171.126:35617
--webserver_interface=127.20.171.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.126.keytab
--principal=kudu/127.20.171.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.171.84:38657
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.171.126:35617
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786098956060137-21165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786098956060137-21165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786098956060137-21165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:36:20.971171 23669 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:36:20.971449 23669 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:36:20.971632 23669 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:36:20.978895 23669 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 10:36:20.978998 23669 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:36:20.979118 23669 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:36:20.979224 23669 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 10:36:20.979316 23669 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 10:36:20.989101 23669 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.171.84:38657
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786098956060137-21165-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786098956060137-21165-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.171.126:35617
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.126.keytab
--principal=kudu/127.20.171.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.171.126:35617
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.171.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786098956060137-21165-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:36:20.990535 23669 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:36:20.992005 23669 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:36:21.004407 23674 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:36:21.004338 23675 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:36:21.004369 23677 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:36:21.005354 23669 server_base.cc:1034] running on GCE node
I20260807 10:36:21.006150 23669 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:36:21.007601 23669 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:36:21.008852 23669 hybrid_clock.cc:648] HybridClock initialized: now 1786098981008817 us; error 52 us; skew 500 ppm
I20260807 10:36:21.009192 23669 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:36:21 dist-test-slave-0b58 krb5kdc[23656](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786098981, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:36:21.012344 23669 init.cc:377] Logged in from keytab as kudu/127.20.171.126@KRBTEST.COM (short username kudu)
I20260807 10:36:21.013733 23669 webserver.cc:460] Webserver started at http://127.20.171.126:38269/ using document root <none> and password file <none>
I20260807 10:36:21.014341 23669 fs_manager.cc:359] Metadata directory not provided
I20260807 10:36:21.014434 23669 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:36:21.014689 23669 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:36:21.017640 23669 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786098956060137-21165-0/minicluster-data/master-0/data/instance:
uuid: "0bf82662b0d24598a72721915e53506f"
format_stamp: "Formatted at 2026-08-07 10:36:21 on dist-test-slave-0b58"
server_key: "3cc34d101e1b101c1aad7449f215147d"
server_key_iv: "7b3400166062eb3e0defb33f775b6697"
server_key_version: "encryptionkey@0"
I20260807 10:36:21.018354 23669 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786098956060137-21165-0/minicluster-data/master-0/wal/instance:
uuid: "0bf82662b0d24598a72721915e53506f"
format_stamp: "Formatted at 2026-08-07 10:36:21 on dist-test-slave-0b58"
server_key: "3cc34d101e1b101c1aad7449f215147d"
server_key_iv: "7b3400166062eb3e0defb33f775b6697"
server_key_version: "encryptionkey@0"
I20260807 10:36:21.023329 23669 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260807 10:36:21.026566 23684 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:36:21.027942 23669 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260807 10:36:21.028108 23669 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786098956060137-21165-0/minicluster-data/master-0/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786098956060137-21165-0/minicluster-data/master-0/wal
uuid: "0bf82662b0d24598a72721915e53506f"
format_stamp: "Formatted at 2026-08-07 10:36:21 on dist-test-slave-0b58"
server_key: "3cc34d101e1b101c1aad7449f215147d"
server_key_iv: "7b3400166062eb3e0defb33f775b6697"
server_key_version: "encryptionkey@0"
I20260807 10:36:21.028371 23669 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786098956060137-21165-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786098956060137-21165-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786098956060137-21165-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:36:21.055433 23669 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:36:21.059540 23669 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:36:21.059867 23669 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:36:21.078933 23669 rpc_server.cc:307] RPC server started. Bound to: 127.20.171.126:35617
I20260807 10:36:21.078956 23736 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.171.126:35617 every 8 connection(s)
I20260807 10:36:21.080281 23669 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
I20260807 10:36:21.083809 23737 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:36:21.088994 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 23669
I20260807 10:36:21.089223 21165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786098956060137-21165-0/minicluster-data/master-0/wal/instance
I20260807 10:36:21.089977 21165 external_mini_cluster.cc:1428] Setting key 16e9673a34313a3630875e63d83f3e57
I20260807 10:36:21.095135 23737 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0bf82662b0d24598a72721915e53506f: Bootstrap starting.
I20260807 10:36:21.098146 23737 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0bf82662b0d24598a72721915e53506f: Neither blocks nor log segments found. Creating new log.
I20260807 10:36:21.099465 23737 log.cc:824] T 00000000000000000000000000000000 P 0bf82662b0d24598a72721915e53506f: Log is configured to *not* fsync() on all Append() calls
I20260807 10:36:21.102938 23737 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0bf82662b0d24598a72721915e53506f: No bootstrap required, opened a new log
Aug 07 10:36:21 dist-test-slave-0b58 krb5kdc[23656](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786098980, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.171.126@KRBTEST.COM
I20260807 10:36:21.110994 23737 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0bf82662b0d24598a72721915e53506f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0bf82662b0d24598a72721915e53506f" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 35617 } }
I20260807 10:36:21.111418 23737 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0bf82662b0d24598a72721915e53506f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:36:21.111550 23737 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0bf82662b0d24598a72721915e53506f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0bf82662b0d24598a72721915e53506f, State: Initialized, Role: FOLLOWER
I20260807 10:36:21.112304 23737 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0bf82662b0d24598a72721915e53506f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0bf82662b0d24598a72721915e53506f" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 35617 } }
I20260807 10:36:21.112591 23737 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0bf82662b0d24598a72721915e53506f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 10:36:21.112735 23737 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0bf82662b0d24598a72721915e53506f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 10:36:21.112918 23737 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0bf82662b0d24598a72721915e53506f [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:36:21.113799 23740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:21.092116 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39388 (local address 127.20.171.126:35617)
0807 10:36:21.092934 (+ 818us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:21.092947 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:21.092986 (+ 39us) server_negotiation.cc:407] Connection header received
0807 10:36:21.094644 (+ 1658us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:21.094664 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:21.095030 (+ 366us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:21.095418 (+ 388us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:36:21.096933 (+ 1515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:21.098199 (+ 1266us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:21.100048 (+ 1849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:21.101169 (+ 1121us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:21.101312 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:21.105932 (+ 4620us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:36:21.105939 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:36:21.105952 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:36:21.105984 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:36:21.109318 (+ 3334us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:21.110009 (+ 691us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:21.110016 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:21.110021 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:21.110194 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:21.110592 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:21.110597 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:21.110600 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:21.111133 (+ 533us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:36:21.111476 (+ 343us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:21.111927 (+ 451us) server_negotiation.cc:299] Negotiation successful
0807 10:36:21.112391 (+ 464us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":625,"thread_start_us":429,"threads_started":1}
I20260807 10:36:21.115536 23737 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0bf82662b0d24598a72721915e53506f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0bf82662b0d24598a72721915e53506f" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 35617 } }
I20260807 10:36:21.116068 23737 leader_election.cc:302] T 00000000000000000000000000000000 P 0bf82662b0d24598a72721915e53506f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0bf82662b0d24598a72721915e53506f; no voters:
I20260807 10:36:21.116976 23737 leader_election.cc:288] T 00000000000000000000000000000000 P 0bf82662b0d24598a72721915e53506f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 10:36:21.117076 23742 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0bf82662b0d24598a72721915e53506f [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:36:21.117885 23742 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0bf82662b0d24598a72721915e53506f [term 1 LEADER]: Becoming Leader. State: Replica: 0bf82662b0d24598a72721915e53506f, State: Running, Role: LEADER
I20260807 10:36:21.118422 23742 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0bf82662b0d24598a72721915e53506f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0bf82662b0d24598a72721915e53506f" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 35617 } }
I20260807 10:36:21.119158 23737 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0bf82662b0d24598a72721915e53506f [sys.catalog]: configured and running, proceeding with master startup.
I20260807 10:36:21.120868 23743 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0bf82662b0d24598a72721915e53506f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0bf82662b0d24598a72721915e53506f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0bf82662b0d24598a72721915e53506f" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 35617 } } }
I20260807 10:36:21.121258 23743 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0bf82662b0d24598a72721915e53506f [sys.catalog]: This master's current role is: LEADER
I20260807 10:36:21.122954 23747 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 10:36:21.123028 23744 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0bf82662b0d24598a72721915e53506f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0bf82662b0d24598a72721915e53506f. Latest consensus state: current_term: 1 leader_uuid: "0bf82662b0d24598a72721915e53506f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0bf82662b0d24598a72721915e53506f" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 35617 } } }
I20260807 10:36:21.123492 23744 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0bf82662b0d24598a72721915e53506f [sys.catalog]: This master's current role is: LEADER
I20260807 10:36:21.130659 23747 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 10:36:21.142344 23747 catalog_manager.cc:1347] Generated new cluster ID: 31033ed07cbd4cb99e5565fbe47a1abd
I20260807 10:36:21.142457 23747 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 10:36:21.179562 23747 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 10:36:21.181116 23747 catalog_manager.cc:1504] Loading token signing keys...
I20260807 10:36:21.187134 23747 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0bf82662b0d24598a72721915e53506f: Generated new TSK 0
I20260807 10:36:21.187947 23747 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.171.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.171.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.171.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.65.keytab.
Entry for principal kudu/127.20.171.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.65.keytab.
I20260807 10:36:21.248863 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786098956060137-21165-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786098956060137-21165-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786098956060137-21165-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786098956060137-21165-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.171.65:0
--local_ip_for_outbound_sockets=127.20.171.65
--webserver_interface=127.20.171.65
--webserver_port=0
--tserver_master_addrs=127.20.171.126:35617
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.65.keytab
--principal=kudu/127.20.171.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.171.84:38657
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786098956060137-21165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786098956060137-21165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786098956060137-21165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:36:21.579535 23764 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:36:21.579885 23764 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:36:21.580066 23764 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:36:21.587412 23764 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:36:21.587572 23764 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:36:21.587785 23764 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.171.65
I20260807 10:36:21.597916 23764 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.171.84:38657
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786098956060137-21165-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786098956060137-21165-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.65.keytab
--principal=kudu/127.20.171.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.171.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786098956060137-21165-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.171.65
--webserver_port=0
--tserver_master_addrs=127.20.171.126:35617
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.171.65
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786098956060137-21165-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:36:21.599418 23764 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:36:21.600828 23764 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:36:21.614142 23773 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:36:21.614207 23771 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:36:21.614485 23770 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:36:21.615249 23764 server_base.cc:1034] running on GCE node
I20260807 10:36:21.615880 23764 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:36:21.616885 23764 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:36:21.618155 23764 hybrid_clock.cc:648] HybridClock initialized: now 1786098981618095 us; error 62 us; skew 500 ppm
I20260807 10:36:21.618489 23764 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:36:21 dist-test-slave-0b58 krb5kdc[23656](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786098981, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:36:21.621899 23764 init.cc:377] Logged in from keytab as kudu/127.20.171.65@KRBTEST.COM (short username kudu)
I20260807 10:36:21.623447 23764 webserver.cc:460] Webserver started at http://127.20.171.65:34787/ using document root <none> and password file <none>
I20260807 10:36:21.624182 23764 fs_manager.cc:359] Metadata directory not provided
I20260807 10:36:21.624358 23764 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:36:21.624692 23764 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:36:21.627524 23764 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786098956060137-21165-0/minicluster-data/ts-0/data/instance:
uuid: "b1680c9f2e9448f0a1c23a68d7332f5a"
format_stamp: "Formatted at 2026-08-07 10:36:21 on dist-test-slave-0b58"
server_key: "1771ff7918d399f8ee77d2cfd6e37c16"
server_key_iv: "07494219ca2a24e155afa3666d044d1d"
server_key_version: "encryptionkey@0"
I20260807 10:36:21.628414 23764 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786098956060137-21165-0/minicluster-data/ts-0/wal/instance:
uuid: "b1680c9f2e9448f0a1c23a68d7332f5a"
format_stamp: "Formatted at 2026-08-07 10:36:21 on dist-test-slave-0b58"
server_key: "1771ff7918d399f8ee77d2cfd6e37c16"
server_key_iv: "07494219ca2a24e155afa3666d044d1d"
server_key_version: "encryptionkey@0"
I20260807 10:36:21.633823 23764 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260807 10:36:21.637205 23780 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:36:21.638492 23764 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260807 10:36:21.638679 23764 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786098956060137-21165-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786098956060137-21165-0/minicluster-data/ts-0/wal
uuid: "b1680c9f2e9448f0a1c23a68d7332f5a"
format_stamp: "Formatted at 2026-08-07 10:36:21 on dist-test-slave-0b58"
server_key: "1771ff7918d399f8ee77d2cfd6e37c16"
server_key_iv: "07494219ca2a24e155afa3666d044d1d"
server_key_version: "encryptionkey@0"
I20260807 10:36:21.638896 23764 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786098956060137-21165-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786098956060137-21165-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786098956060137-21165-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:36:21.650653 23764 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:36:21.654630 23764 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:36:21.654923 23764 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:36:21.655836 23764 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:36:21.657230 23764 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:36:21.657298 23764 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:36:21.657423 23764 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:36:21.657498 23764 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:36:21.691672 23764 rpc_server.cc:307] RPC server started. Bound to: 127.20.171.65:34211
I20260807 10:36:21.691708 23897 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.171.65:34211 every 8 connection(s)
I20260807 10:36:21.693051 23764 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786098956060137-21165-0/minicluster-data/ts-0/data/info.pb
I20260807 10:36:21.701705 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 23764
I20260807 10:36:21.701956 21165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786098956060137-21165-0/minicluster-data/ts-0/wal/instance
I20260807 10:36:21.702570 21165 external_mini_cluster.cc:1428] Setting key 3d5bd55332f9b3d2c45df8e5fcc9563c
Aug 07 10:36:21 dist-test-slave-0b58 krb5kdc[23656](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786098981, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.65@KRBTEST.COM for kudu/127.20.171.126@KRBTEST.COM
I20260807 10:36:21.714254 23900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:21.695603 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.65:34701 (local address 127.20.171.126:35617)
0807 10:36:21.696055 (+ 452us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:21.696061 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:21.696950 (+ 889us) server_negotiation.cc:407] Connection header received
0807 10:36:21.698648 (+ 1698us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:21.698652 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:21.698719 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:21.698809 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:36:21.700230 (+ 1421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:21.701039 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:21.702724 (+ 1685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:21.703140 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:21.703302 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:21.707919 (+ 4617us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:36:21.707924 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:36:21.707927 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:36:21.707958 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:36:21.710480 (+ 2522us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:21.711473 (+ 993us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:21.711478 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:21.711480 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:21.711606 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:21.712103 (+ 497us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:21.712107 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:21.712109 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:21.712444 (+ 335us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:36:21.712561 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:21.713545 (+ 984us) server_negotiation.cc:299] Negotiation successful
0807 10:36:21.713802 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":334,"thread_start_us":226,"threads_started":1}
I20260807 10:36:21.714911 23901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:21.696020 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:35617 (local address 127.20.171.65:34701)
0807 10:36:21.696778 (+ 758us) negotiation.cc:107] Waiting for socket to connect
0807 10:36:21.696823 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0807 10:36:21.698413 (+ 1590us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:36:21.699029 (+ 616us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:36:21.699036 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:36:21.699535 (+ 499us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:36:21.700087 (+ 552us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:21.700104 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:21.701172 (+ 1068us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:21.701175 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:21.702563 (+ 1388us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:21.702581 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:21.703410 (+ 829us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:21.703419 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:21.703729 (+ 310us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:21.704568 (+ 839us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:36:21.704603 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:36:21.707694 (+ 3091us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:36:21.710631 (+ 2937us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:36:21.710642 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:36:21.710661 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:36:21.711343 (+ 682us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:36:21.711728 (+ 385us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:36:21.711736 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:36:21.711742 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:36:21.711991 (+ 249us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:36:21.712574 (+ 583us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:36:21.712585 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:36:21.713068 (+ 483us) client_negotiation.cc:769] Sending connection context
0807 10:36:21.713396 (+ 328us) client_negotiation.cc:240] Negotiation successful
0807 10:36:21.713815 (+ 419us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":520,"thread_start_us":302,"threads_started":1}
I20260807 10:36:21.716586 23898 heartbeater.cc:347] Connected to a master server at 127.20.171.126:35617
I20260807 10:36:21.716910 23898 heartbeater.cc:464] Registering TS with master...
I20260807 10:36:21.717593 23898 heartbeater.cc:511] Master 127.20.171.126:35617 requested a full tablet report, sending...
I20260807 10:36:21.719877 23701 ts_manager.cc:194] Registered new tserver with Master: b1680c9f2e9448f0a1c23a68d7332f5a (127.20.171.65:34211)
I20260807 10:36:21.721494 23701 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.171.65@KRBTEST.COM'} at 127.20.171.65:34701
WARNING: no policy specified for kudu/127.20.171.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.171.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.171.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.66.keytab.
Entry for principal kudu/127.20.171.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.66.keytab.
I20260807 10:36:21.755541 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786098956060137-21165-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786098956060137-21165-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786098956060137-21165-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786098956060137-21165-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.171.66:0
--local_ip_for_outbound_sockets=127.20.171.66
--webserver_interface=127.20.171.66
--webserver_port=0
--tserver_master_addrs=127.20.171.126:35617
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.66.keytab
--principal=kudu/127.20.171.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.171.84:38657
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786098956060137-21165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786098956060137-21165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786098956060137-21165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:36:22.074569 23904 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:36:22.074942 23904 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:36:22.075053 23904 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:36:22.081672 23904 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:36:22.081779 23904 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:36:22.081971 23904 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.171.66
I20260807 10:36:22.091117 23904 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.171.84:38657
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786098956060137-21165-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786098956060137-21165-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.66.keytab
--principal=kudu/127.20.171.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.171.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786098956060137-21165-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.171.66
--webserver_port=0
--tserver_master_addrs=127.20.171.126:35617
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.171.66
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786098956060137-21165-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:36:22.092350 23904 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:36:22.093583 23904 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:36:22.106648 23910 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:36:22.106623 23913 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:36:22.106647 23911 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:36:22.107520 23904 server_base.cc:1034] running on GCE node
I20260807 10:36:22.108117 23904 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:36:22.109025 23904 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:36:22.110246 23904 hybrid_clock.cc:648] HybridClock initialized: now 1786098982110168 us; error 35 us; skew 500 ppm
I20260807 10:36:22.110563 23904 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:36:22 dist-test-slave-0b58 krb5kdc[23656](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786098982, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:36:22.113680 23904 init.cc:377] Logged in from keytab as kudu/127.20.171.66@KRBTEST.COM (short username kudu)
I20260807 10:36:22.115178 23904 webserver.cc:460] Webserver started at http://127.20.171.66:37757/ using document root <none> and password file <none>
I20260807 10:36:22.115831 23904 fs_manager.cc:359] Metadata directory not provided
I20260807 10:36:22.115973 23904 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:36:22.116356 23904 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:36:22.119287 23904 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786098956060137-21165-0/minicluster-data/ts-1/data/instance:
uuid: "8065f3f7f1c24d47b47faf3e00b64905"
format_stamp: "Formatted at 2026-08-07 10:36:22 on dist-test-slave-0b58"
server_key: "b5dffd656f4893bf4135d35e786df075"
server_key_iv: "0c2dfe0162f8e2867108caec5b4e8885"
server_key_version: "encryptionkey@0"
I20260807 10:36:22.120151 23904 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786098956060137-21165-0/minicluster-data/ts-1/wal/instance:
uuid: "8065f3f7f1c24d47b47faf3e00b64905"
format_stamp: "Formatted at 2026-08-07 10:36:22 on dist-test-slave-0b58"
server_key: "b5dffd656f4893bf4135d35e786df075"
server_key_iv: "0c2dfe0162f8e2867108caec5b4e8885"
server_key_version: "encryptionkey@0"
I20260807 10:36:22.125135 23904 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260807 10:36:22.128525 23920 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:36:22.129689 23904 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260807 10:36:22.129863 23904 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786098956060137-21165-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786098956060137-21165-0/minicluster-data/ts-1/wal
uuid: "8065f3f7f1c24d47b47faf3e00b64905"
format_stamp: "Formatted at 2026-08-07 10:36:22 on dist-test-slave-0b58"
server_key: "b5dffd656f4893bf4135d35e786df075"
server_key_iv: "0c2dfe0162f8e2867108caec5b4e8885"
server_key_version: "encryptionkey@0"
I20260807 10:36:22.130055 23904 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786098956060137-21165-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786098956060137-21165-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786098956060137-21165-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:36:22.160287 23904 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:36:22.164176 23904 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:36:22.164518 23904 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:36:22.165560 23904 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:36:22.167019 23904 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:36:22.167135 23904 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:36:22.167308 23904 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:36:22.167409 23904 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:36:22.200439 23904 rpc_server.cc:307] RPC server started. Bound to: 127.20.171.66:42411
I20260807 10:36:22.200527 24036 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.171.66:42411 every 8 connection(s)
I20260807 10:36:22.201773 23904 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786098956060137-21165-0/minicluster-data/ts-1/data/info.pb
I20260807 10:36:22.206880 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 23904
I20260807 10:36:22.207091 21165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786098956060137-21165-0/minicluster-data/ts-1/wal/instance
I20260807 10:36:22.207584 21165 external_mini_cluster.cc:1428] Setting key 9ff5d74f4562b9956b1ff9745247da5f
Aug 07 10:36:22 dist-test-slave-0b58 krb5kdc[23656](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786098982, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.66@KRBTEST.COM for kudu/127.20.171.126@KRBTEST.COM
I20260807 10:36:22.222961 23900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:22.204455 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.66:51431 (local address 127.20.171.126:35617)
0807 10:36:22.204652 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:22.204657 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:22.205896 (+ 1239us) server_negotiation.cc:407] Connection header received
0807 10:36:22.207937 (+ 2041us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:22.207943 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:22.208032 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:22.208157 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:36:22.209860 (+ 1703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:22.210529 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:22.212099 (+ 1570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:22.212680 (+ 581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:22.212825 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:22.216448 (+ 3623us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:36:22.216453 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:36:22.216456 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:36:22.216488 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:36:22.219110 (+ 2622us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:22.219986 (+ 876us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:22.219989 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:22.219991 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:22.220163 (+ 172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:22.220904 (+ 741us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:22.220913 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:22.220945 (+ 32us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:22.221426 (+ 481us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:36:22.221615 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:22.222302 (+ 687us) server_negotiation.cc:299] Negotiation successful
0807 10:36:22.222548 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260807 10:36:22.223924 24039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:22.204991 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:35617 (local address 127.20.171.66:51431)
0807 10:36:22.205733 (+ 742us) negotiation.cc:107] Waiting for socket to connect
0807 10:36:22.205769 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0807 10:36:22.207610 (+ 1841us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:36:22.208456 (+ 846us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:36:22.208470 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:36:22.209076 (+ 606us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:36:22.209698 (+ 622us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:22.209715 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:22.210706 (+ 991us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:22.210711 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:22.211938 (+ 1227us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:22.211950 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:22.212919 (+ 969us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:22.212926 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:22.213160 (+ 234us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:22.213882 (+ 722us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:36:22.213915 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:36:22.216200 (+ 2285us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:36:22.219229 (+ 3029us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:36:22.219239 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:36:22.219255 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:36:22.219873 (+ 618us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:36:22.220351 (+ 478us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:36:22.220356 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:36:22.220360 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:36:22.220655 (+ 295us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:36:22.221578 (+ 923us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:36:22.221584 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:36:22.221883 (+ 299us) client_negotiation.cc:769] Sending connection context
0807 10:36:22.222119 (+ 236us) client_negotiation.cc:240] Negotiation successful
0807 10:36:22.222560 (+ 441us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":501,"thread_start_us":290,"threads_started":1}
I20260807 10:36:22.225940 24037 heartbeater.cc:347] Connected to a master server at 127.20.171.126:35617
I20260807 10:36:22.226217 24037 heartbeater.cc:464] Registering TS with master...
I20260807 10:36:22.227087 24037 heartbeater.cc:511] Master 127.20.171.126:35617 requested a full tablet report, sending...
I20260807 10:36:22.228888 23701 ts_manager.cc:194] Registered new tserver with Master: 8065f3f7f1c24d47b47faf3e00b64905 (127.20.171.66:42411)
I20260807 10:36:22.230005 23701 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.171.66@KRBTEST.COM'} at 127.20.171.66:51431
WARNING: no policy specified for kudu/127.20.171.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.171.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.171.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.67.keytab.
Entry for principal kudu/127.20.171.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.67.keytab.
I20260807 10:36:22.259207 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786098956060137-21165-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786098956060137-21165-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786098956060137-21165-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786098956060137-21165-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.171.67:0
--local_ip_for_outbound_sockets=127.20.171.67
--webserver_interface=127.20.171.67
--webserver_port=0
--tserver_master_addrs=127.20.171.126:35617
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.67.keytab
--principal=kudu/127.20.171.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.171.84:38657
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786098956060137-21165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786098956060137-21165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786098956060137-21165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:36:22.564564 24042 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:36:22.564800 24042 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:36:22.564962 24042 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:36:22.571805 24042 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:36:22.571930 24042 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:36:22.572140 24042 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.171.67
I20260807 10:36:22.580469 24042 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.171.84:38657
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786098956060137-21165-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786098956060137-21165-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.67.keytab
--principal=kudu/127.20.171.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.171.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786098956060137-21165-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.171.67
--webserver_port=0
--tserver_master_addrs=127.20.171.126:35617
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.171.67
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786098956060137-21165-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:36:22.581585 24042 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:36:22.582821 24042 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:36:22.594782 24047 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:36:22.594820 24048 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:36:22.594846 24050 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:36:22.596048 24042 server_base.cc:1034] running on GCE node
I20260807 10:36:22.596642 24042 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:36:22.597538 24042 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:36:22.598790 24042 hybrid_clock.cc:648] HybridClock initialized: now 1786098982598722 us; error 37 us; skew 500 ppm
I20260807 10:36:22.599105 24042 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:36:22 dist-test-slave-0b58 krb5kdc[23656](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786098982, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:36:22.602226 24042 init.cc:377] Logged in from keytab as kudu/127.20.171.67@KRBTEST.COM (short username kudu)
I20260807 10:36:22.603514 24042 webserver.cc:460] Webserver started at http://127.20.171.67:33427/ using document root <none> and password file <none>
I20260807 10:36:22.604147 24042 fs_manager.cc:359] Metadata directory not provided
I20260807 10:36:22.604246 24042 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:36:22.604579 24042 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:36:22.607190 24042 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786098956060137-21165-0/minicluster-data/ts-2/data/instance:
uuid: "f66f959acadd4b4683597cb98b7c48c2"
format_stamp: "Formatted at 2026-08-07 10:36:22 on dist-test-slave-0b58"
server_key: "99ca328987da8798108ad453c2d37b73"
server_key_iv: "47c16698dadab323ae172e9301c2b736"
server_key_version: "encryptionkey@0"
I20260807 10:36:22.607926 24042 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786098956060137-21165-0/minicluster-data/ts-2/wal/instance:
uuid: "f66f959acadd4b4683597cb98b7c48c2"
format_stamp: "Formatted at 2026-08-07 10:36:22 on dist-test-slave-0b58"
server_key: "99ca328987da8798108ad453c2d37b73"
server_key_iv: "47c16698dadab323ae172e9301c2b736"
server_key_version: "encryptionkey@0"
I20260807 10:36:22.612542 24042 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.001s
I20260807 10:36:22.615756 24057 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:36:22.617079 24042 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 10:36:22.617233 24042 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786098956060137-21165-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786098956060137-21165-0/minicluster-data/ts-2/wal
uuid: "f66f959acadd4b4683597cb98b7c48c2"
format_stamp: "Formatted at 2026-08-07 10:36:22 on dist-test-slave-0b58"
server_key: "99ca328987da8798108ad453c2d37b73"
server_key_iv: "47c16698dadab323ae172e9301c2b736"
server_key_version: "encryptionkey@0"
I20260807 10:36:22.617427 24042 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786098956060137-21165-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786098956060137-21165-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786098956060137-21165-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:36:22.639799 24042 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:36:22.643775 24042 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:36:22.644040 24042 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:36:22.644937 24042 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:36:22.646095 24042 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:36:22.646198 24042 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:36:22.646329 24042 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:36:22.646396 24042 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:36:22.679566 24042 rpc_server.cc:307] RPC server started. Bound to: 127.20.171.67:42235
I20260807 10:36:22.679653 24172 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.171.67:42235 every 8 connection(s)
I20260807 10:36:22.680768 24042 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786098956060137-21165-0/minicluster-data/ts-2/data/info.pb
I20260807 10:36:22.686108 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 24042
I20260807 10:36:22.686354 21165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786098956060137-21165-0/minicluster-data/ts-2/wal/instance
I20260807 10:36:22.686975 21165 external_mini_cluster.cc:1428] Setting key b3e018a3adf0adb23aa0fe79e8f95159
Aug 07 10:36:22 dist-test-slave-0b58 krb5kdc[23656](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786098982, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.67@KRBTEST.COM for kudu/127.20.171.126@KRBTEST.COM
I20260807 10:36:22.700342 23900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:22.683168 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.67:48259 (local address 127.20.171.126:35617)
0807 10:36:22.683395 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:22.683400 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:22.684476 (+ 1076us) server_negotiation.cc:407] Connection header received
0807 10:36:22.686359 (+ 1883us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:22.686364 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:22.686504 (+ 140us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:22.686591 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:36:22.688600 (+ 2009us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:22.689437 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:22.691095 (+ 1658us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:22.691489 (+ 394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:22.691628 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:22.694935 (+ 3307us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:36:22.694940 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:36:22.694943 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:36:22.694971 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:36:22.697529 (+ 2558us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:22.698223 (+ 694us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:22.698232 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:22.698234 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:22.698349 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:22.698779 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:22.698788 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:22.698791 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:22.699029 (+ 238us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:36:22.699195 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:22.699790 (+ 595us) server_negotiation.cc:299] Negotiation successful
0807 10:36:22.699988 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":100}
I20260807 10:36:22.701406 24175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:22.683622 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:35617 (local address 127.20.171.67:48259)
0807 10:36:22.684333 (+ 711us) negotiation.cc:107] Waiting for socket to connect
0807 10:36:22.684377 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0807 10:36:22.686011 (+ 1634us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:36:22.686857 (+ 846us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:36:22.686868 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:36:22.687600 (+ 732us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:36:22.688398 (+ 798us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:22.688450 (+ 52us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:22.689581 (+ 1131us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:22.689585 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:22.690942 (+ 1357us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:22.690954 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:22.691725 (+ 771us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:22.691735 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:22.691960 (+ 225us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:22.692660 (+ 700us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:36:22.692682 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:36:22.694741 (+ 2059us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:36:22.697672 (+ 2931us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:36:22.697687 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:36:22.697700 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:36:22.698082 (+ 382us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:36:22.698475 (+ 393us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:36:22.698480 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:36:22.698483 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:36:22.698653 (+ 170us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:36:22.699161 (+ 508us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:36:22.699168 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:36:22.699442 (+ 274us) client_negotiation.cc:769] Sending connection context
0807 10:36:22.699686 (+ 244us) client_negotiation.cc:240] Negotiation successful
0807 10:36:22.700093 (+ 407us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":448,"thread_start_us":258,"threads_started":1}
I20260807 10:36:22.702720 24173 heartbeater.cc:347] Connected to a master server at 127.20.171.126:35617
I20260807 10:36:22.703004 24173 heartbeater.cc:464] Registering TS with master...
I20260807 10:36:22.703742 24173 heartbeater.cc:511] Master 127.20.171.126:35617 requested a full tablet report, sending...
I20260807 10:36:22.705027 23700 ts_manager.cc:194] Registered new tserver with Master: f66f959acadd4b4683597cb98b7c48c2 (127.20.171.67:42235)
I20260807 10:36:22.705865 23700 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.171.67@KRBTEST.COM'} at 127.20.171.67:48259
I20260807 10:36:22.714382 21165 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 10:36:22.724248 23898 heartbeater.cc:503] Master 127.20.171.126:35617 was elected leader, sending a full tablet report...
W20260807 10:36:22.751428 23900 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:36:22.749050 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39392 (local address 127.20.171.126:35617)
0807 10:36:22.749271 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:22.749277 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:22.749692 (+ 415us) server_negotiation.cc:407] Connection header received
0807 10:36:22.749822 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:22.749826 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:22.749883 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:22.749958 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:36:22.751166 (+ 1208us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39392: BlockingRecv error: recv got EOF from 127.0.0.1:39392 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
I20260807 10:36:22.754303 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 23764
W20260807 10:36:22.756946 21165 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 23764: Not authorized: Client connection negotiation failed: client connection to 127.20.171.65:34211: server requires authentication, but client does not have Kerberos credentials available
I20260807 10:36:22.757148 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 23764
I20260807 10:36:22.775492 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 23904
W20260807 10:36:22.777947 21165 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 23904: Not authorized: Client connection negotiation failed: client connection to 127.20.171.66:42411: server requires authentication, but client does not have Kerberos credentials available
I20260807 10:36:22.778111 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 23904
I20260807 10:36:22.796416 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 24042
W20260807 10:36:22.798733 21165 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 24042: Not authorized: Client connection negotiation failed: client connection to 127.20.171.67:42235: server requires authentication, but client does not have Kerberos credentials available
I20260807 10:36:22.798832 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 24042
I20260807 10:36:22.816365 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 23669
I20260807 10:36:22.817405 23732 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:36:22.918829 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 23669
2026-08-07T10:36:22Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (3559 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786098956060137-21165-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 10:36:23 dist-test-slave-0b58 krb5kdc[24190](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 10:36:23 dist-test-slave-0b58 krb5kdc[24190](info): set up 2 sockets
Aug 07 10:36:23 dist-test-slave-0b58 krb5kdc[24190](info): commencing operation
krb5kdc: starting...
W20260807 10:36:23.986599 21165 mini_kdc.cc:121] Time spent starting KDC: real 1.023s user 0.000s sys 0.021s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786098956060137-21165-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786098956060137-21165-0/krb5kdc/test-user.keytab.
Aug 07 10:36:24 dist-test-slave-0b58 krb5kdc[24190](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786098984, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T10:36:24Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T10:36:24Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.171.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.171.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.171.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.126.keytab.
Entry for principal kudu/127.20.171.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.126.keytab.
I20260807 10:36:24.214176 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786098956060137-21165-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786098956060137-21165-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786098956060137-21165-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.171.126:41639
--webserver_interface=127.20.171.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.126.keytab
--principal=kudu/127.20.171.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.171.84:33077
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.171.126:41639
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786098956060137-21165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786098956060137-21165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786098956060137-21165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:36:24.542582 24203 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:36:24.542852 24203 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:36:24.543022 24203 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:36:24.550132 24203 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 10:36:24.550226 24203 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:36:24.550328 24203 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:36:24.550428 24203 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 10:36:24.550493 24203 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 10:36:24.560004 24203 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.171.84:33077
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786098956060137-21165-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786098956060137-21165-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.171.126:41639
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.126.keytab
--principal=kudu/127.20.171.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.171.126:41639
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.171.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786098956060137-21165-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:36:24.561430 24203 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:36:24.562803 24203 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:36:24.575330 24208 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:36:24.575260 24211 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:36:24.575376 24209 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:36:24.576498 24203 server_base.cc:1034] running on GCE node
I20260807 10:36:24.577239 24203 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:36:24.578693 24203 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:36:24.579903 24203 hybrid_clock.cc:648] HybridClock initialized: now 1786098984579863 us; error 41 us; skew 500 ppm
I20260807 10:36:24.580293 24203 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:36:24 dist-test-slave-0b58 krb5kdc[24190](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786098984, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:36:24.583449 24203 init.cc:377] Logged in from keytab as kudu/127.20.171.126@KRBTEST.COM (short username kudu)
I20260807 10:36:24.584934 24203 webserver.cc:460] Webserver started at http://127.20.171.126:37523/ using document root <none> and password file <none>
I20260807 10:36:24.585630 24203 fs_manager.cc:359] Metadata directory not provided
I20260807 10:36:24.585781 24203 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:36:24.586149 24203 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:36:24.589725 24203 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786098956060137-21165-0/minicluster-data/master-0/data/instance:
uuid: "8e728788902c447aa1329161f349912b"
format_stamp: "Formatted at 2026-08-07 10:36:24 on dist-test-slave-0b58"
server_key: "9f9b45c1b769322985712363fd6661d8"
server_key_iv: "c246eacb2163db75e594e28743450ba6"
server_key_version: "encryptionkey@0"
I20260807 10:36:24.590513 24203 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786098956060137-21165-0/minicluster-data/master-0/wal/instance:
uuid: "8e728788902c447aa1329161f349912b"
format_stamp: "Formatted at 2026-08-07 10:36:24 on dist-test-slave-0b58"
server_key: "9f9b45c1b769322985712363fd6661d8"
server_key_iv: "c246eacb2163db75e594e28743450ba6"
server_key_version: "encryptionkey@0"
I20260807 10:36:24.595575 24203 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.004s
I20260807 10:36:24.599287 24218 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:36:24.600690 24203 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 10:36:24.600886 24203 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786098956060137-21165-0/minicluster-data/master-0/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786098956060137-21165-0/minicluster-data/master-0/wal
uuid: "8e728788902c447aa1329161f349912b"
format_stamp: "Formatted at 2026-08-07 10:36:24 on dist-test-slave-0b58"
server_key: "9f9b45c1b769322985712363fd6661d8"
server_key_iv: "c246eacb2163db75e594e28743450ba6"
server_key_version: "encryptionkey@0"
I20260807 10:36:24.601109 24203 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786098956060137-21165-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786098956060137-21165-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786098956060137-21165-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:36:24.619956 24203 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:36:24.623744 24203 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:36:24.624013 24203 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:36:24.642787 24203 rpc_server.cc:307] RPC server started. Bound to: 127.20.171.126:41639
I20260807 10:36:24.642831 24271 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.171.126:41639 every 8 connection(s)
I20260807 10:36:24.644104 24203 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
I20260807 10:36:24.647893 24272 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:36:24.647907 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 24203
I20260807 10:36:24.648149 21165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786098956060137-21165-0/minicluster-data/master-0/wal/instance
I20260807 10:36:24.648795 21165 external_mini_cluster.cc:1428] Setting key b5b16feb9d431803af5b0949d74c4bf2
I20260807 10:36:24.661738 24272 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8e728788902c447aa1329161f349912b: Bootstrap starting.
Aug 07 10:36:24 dist-test-slave-0b58 krb5kdc[24190](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786098984, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.171.126@KRBTEST.COM
I20260807 10:36:24.665411 24272 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8e728788902c447aa1329161f349912b: Neither blocks nor log segments found. Creating new log.
I20260807 10:36:24.666560 24272 log.cc:824] T 00000000000000000000000000000000 P 8e728788902c447aa1329161f349912b: Log is configured to *not* fsync() on all Append() calls
I20260807 10:36:24.669476 24272 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8e728788902c447aa1329161f349912b: No bootstrap required, opened a new log
I20260807 10:36:24.672736 24275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:24.650578 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47646 (local address 127.20.171.126:41639)
0807 10:36:24.651516 (+ 938us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:24.651527 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:24.651566 (+ 39us) server_negotiation.cc:407] Connection header received
0807 10:36:24.653954 (+ 2388us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:24.653975 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:24.654322 (+ 347us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:24.654623 (+ 301us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:36:24.656456 (+ 1833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:24.657631 (+ 1175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:24.659354 (+ 1723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:24.659938 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:24.660058 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:24.664896 (+ 4838us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:36:24.664904 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:36:24.664917 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:36:24.664952 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:36:24.668559 (+ 3607us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:24.669231 (+ 672us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:24.669237 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:24.669243 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:24.669394 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:24.669833 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:24.669838 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:24.669841 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:24.670408 (+ 567us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:36:24.670730 (+ 322us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:24.671257 (+ 527us) server_negotiation.cc:299] Negotiation successful
0807 10:36:24.671655 (+ 398us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":711,"thread_start_us":465,"threads_started":1}
I20260807 10:36:24.676460 21165 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 10:36:24.677623 24272 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8e728788902c447aa1329161f349912b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e728788902c447aa1329161f349912b" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 41639 } }
I20260807 10:36:24.677994 24272 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8e728788902c447aa1329161f349912b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:36:24.678107 24272 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8e728788902c447aa1329161f349912b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e728788902c447aa1329161f349912b, State: Initialized, Role: FOLLOWER
I20260807 10:36:24.678654 24272 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8e728788902c447aa1329161f349912b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e728788902c447aa1329161f349912b" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 41639 } }
I20260807 10:36:24.678915 24272 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8e728788902c447aa1329161f349912b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 10:36:24.679064 24272 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8e728788902c447aa1329161f349912b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 10:36:24.679241 24272 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8e728788902c447aa1329161f349912b [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:36:24.681542 24272 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8e728788902c447aa1329161f349912b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e728788902c447aa1329161f349912b" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 41639 } }
I20260807 10:36:24.682024 24272 leader_election.cc:302] T 00000000000000000000000000000000 P 8e728788902c447aa1329161f349912b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8e728788902c447aa1329161f349912b; no voters:
I20260807 10:36:24.682782 24272 leader_election.cc:288] T 00000000000000000000000000000000 P 8e728788902c447aa1329161f349912b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 10:36:24.682895 24277 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8e728788902c447aa1329161f349912b [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:36:24.684504 24277 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8e728788902c447aa1329161f349912b [term 1 LEADER]: Becoming Leader. State: Replica: 8e728788902c447aa1329161f349912b, State: Running, Role: LEADER
I20260807 10:36:24.685084 24277 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8e728788902c447aa1329161f349912b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e728788902c447aa1329161f349912b" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 41639 } }
I20260807 10:36:24.685307 24272 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8e728788902c447aa1329161f349912b [sys.catalog]: configured and running, proceeding with master startup.
I20260807 10:36:24.688141 24278 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8e728788902c447aa1329161f349912b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8e728788902c447aa1329161f349912b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e728788902c447aa1329161f349912b" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 41639 } } }
I20260807 10:36:24.688602 24278 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8e728788902c447aa1329161f349912b [sys.catalog]: This master's current role is: LEADER
I20260807 10:36:24.689145 24279 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8e728788902c447aa1329161f349912b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8e728788902c447aa1329161f349912b. Latest consensus state: current_term: 1 leader_uuid: "8e728788902c447aa1329161f349912b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e728788902c447aa1329161f349912b" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 41639 } } }
I20260807 10:36:24.689451 24279 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8e728788902c447aa1329161f349912b [sys.catalog]: This master's current role is: LEADER
I20260807 10:36:24.699605 24284 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 10:36:24.706202 24284 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 10:36:24.717878 24284 catalog_manager.cc:1347] Generated new cluster ID: 79ff85795c204cb8b8dd80d253cf55e9
I20260807 10:36:24.718027 24284 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 10:36:24.733117 24284 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 10:36:24.734349 24284 catalog_manager.cc:1504] Loading token signing keys...
I20260807 10:36:24.747711 24284 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8e728788902c447aa1329161f349912b: Generated new TSK 0
I20260807 10:36:24.748693 24284 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 10:36:24.753418 24275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:24.742672 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47654 (local address 127.20.171.126:41639)
0807 10:36:24.742850 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:24.742856 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:24.745194 (+ 2338us) server_negotiation.cc:407] Connection header received
0807 10:36:24.745395 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:24.745402 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:24.745487 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:24.745604 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:36:24.746977 (+ 1373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:24.748053 (+ 1076us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:24.750035 (+ 1982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:24.750455 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:24.750545 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:24.751810 (+ 1265us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:36:24.751815 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:36:24.751819 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:36:24.752686 (+ 867us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:36:24.752745 (+ 59us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:36:24.752775 (+ 30us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:36:24.752859 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:24.753039 (+ 180us) server_negotiation.cc:299] Negotiation successful
0807 10:36:24.753117 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260807 10:36:24.760772 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 24203
I20260807 10:36:24.761974 24267 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:36:24.848870 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 24203
2026-08-07T10:36:24Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (1925 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786098956060137-21165-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 10:36:24 dist-test-slave-0b58 krb5kdc[24306](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 10:36:24 dist-test-slave-0b58 krb5kdc[24306](info): set up 2 sockets
Aug 07 10:36:24 dist-test-slave-0b58 krb5kdc[24306](info): commencing operation
krb5kdc: starting...
W20260807 10:36:25.938293 21165 mini_kdc.cc:121] Time spent starting KDC: real 1.049s user 0.001s sys 0.025s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786098956060137-21165-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786098956060137-21165-0/krb5kdc/test-user.keytab.
Aug 07 10:36:26 dist-test-slave-0b58 krb5kdc[24306](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786098986, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T10:36:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T10:36:26Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.171.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.171.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.171.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.126.keytab.
Entry for principal kudu/127.20.171.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.126.keytab.
I20260807 10:36:26.170104 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786098956060137-21165-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786098956060137-21165-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786098956060137-21165-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.171.126:36607
--webserver_interface=127.20.171.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.126.keytab
--principal=kudu/127.20.171.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.171.84:34511
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.171.126:36607
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786098956060137-21165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786098956060137-21165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786098956060137-21165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:36:26.504532 24320 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:36:26.504825 24320 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:36:26.505008 24320 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:36:26.512436 24320 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 10:36:26.512569 24320 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:36:26.512678 24320 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:36:26.512778 24320 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 10:36:26.512866 24320 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 10:36:26.522915 24320 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.171.84:34511
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786098956060137-21165-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786098956060137-21165-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.171.126:36607
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.126.keytab
--principal=kudu/127.20.171.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.171.126:36607
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.171.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786098956060137-21165-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:36:26.524350 24320 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:36:26.525696 24320 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:36:26.537848 24326 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:36:26.537866 24328 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:36:26.537868 24325 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:36:26.538769 24320 server_base.cc:1034] running on GCE node
I20260807 10:36:26.539549 24320 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:36:26.541115 24320 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:36:26.542362 24320 hybrid_clock.cc:648] HybridClock initialized: now 1786098986542380 us; error 121 us; skew 500 ppm
I20260807 10:36:26.542724 24320 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:36:26 dist-test-slave-0b58 krb5kdc[24306](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786098986, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:36:26.545949 24320 init.cc:377] Logged in from keytab as kudu/127.20.171.126@KRBTEST.COM (short username kudu)
I20260807 10:36:26.547505 24320 webserver.cc:460] Webserver started at http://127.20.171.126:39875/ using document root <none> and password file <none>
I20260807 10:36:26.548197 24320 fs_manager.cc:359] Metadata directory not provided
I20260807 10:36:26.548393 24320 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:36:26.548708 24320 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:36:26.551771 24320 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786098956060137-21165-0/minicluster-data/master-0/data/instance:
uuid: "e40c19c851154ea2a376491490355ad8"
format_stamp: "Formatted at 2026-08-07 10:36:26 on dist-test-slave-0b58"
server_key: "a038bc59691d9c8b2644dd553e8afdfd"
server_key_iv: "38bc168b2ca1acf0187df4e9bb4ce993"
server_key_version: "encryptionkey@0"
I20260807 10:36:26.552625 24320 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786098956060137-21165-0/minicluster-data/master-0/wal/instance:
uuid: "e40c19c851154ea2a376491490355ad8"
format_stamp: "Formatted at 2026-08-07 10:36:26 on dist-test-slave-0b58"
server_key: "a038bc59691d9c8b2644dd553e8afdfd"
server_key_iv: "38bc168b2ca1acf0187df4e9bb4ce993"
server_key_version: "encryptionkey@0"
I20260807 10:36:26.557794 24320 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260807 10:36:26.561040 24335 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:36:26.562372 24320 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260807 10:36:26.562562 24320 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786098956060137-21165-0/minicluster-data/master-0/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786098956060137-21165-0/minicluster-data/master-0/wal
uuid: "e40c19c851154ea2a376491490355ad8"
format_stamp: "Formatted at 2026-08-07 10:36:26 on dist-test-slave-0b58"
server_key: "a038bc59691d9c8b2644dd553e8afdfd"
server_key_iv: "38bc168b2ca1acf0187df4e9bb4ce993"
server_key_version: "encryptionkey@0"
I20260807 10:36:26.562748 24320 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786098956060137-21165-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786098956060137-21165-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786098956060137-21165-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:36:26.590538 24320 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:36:26.594676 24320 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:36:26.594969 24320 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:36:26.614212 24320 rpc_server.cc:307] RPC server started. Bound to: 127.20.171.126:36607
I20260807 10:36:26.614252 24389 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.171.126:36607 every 8 connection(s)
I20260807 10:36:26.615628 24320 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
I20260807 10:36:26.619412 24390 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:36:26.622599 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 24320
I20260807 10:36:26.622821 21165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786098956060137-21165-0/minicluster-data/master-0/wal/instance
I20260807 10:36:26.623677 21165 external_mini_cluster.cc:1428] Setting key 8a1296734337b6a10c6ef77f14a0d7d7
I20260807 10:36:26.632725 24390 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e40c19c851154ea2a376491490355ad8: Bootstrap starting.
I20260807 10:36:26.636613 24390 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e40c19c851154ea2a376491490355ad8: Neither blocks nor log segments found. Creating new log.
I20260807 10:36:26.638011 24390 log.cc:824] T 00000000000000000000000000000000 P e40c19c851154ea2a376491490355ad8: Log is configured to *not* fsync() on all Append() calls
Aug 07 10:36:26 dist-test-slave-0b58 krb5kdc[24306](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786098986, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.171.126@KRBTEST.COM
I20260807 10:36:26.641234 24390 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e40c19c851154ea2a376491490355ad8: No bootstrap required, opened a new log
I20260807 10:36:26.646998 24393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:26.625832 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59902 (local address 127.20.171.126:36607)
0807 10:36:26.626620 (+ 788us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:26.626631 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:26.626673 (+ 42us) server_negotiation.cc:407] Connection header received
0807 10:36:26.628444 (+ 1771us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:26.628466 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:26.628836 (+ 370us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:26.629151 (+ 315us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:36:26.630913 (+ 1762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:26.632222 (+ 1309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:26.634040 (+ 1818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:26.634686 (+ 646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:26.634821 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:26.639609 (+ 4788us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:36:26.639617 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:36:26.639630 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:36:26.639670 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:36:26.642782 (+ 3112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:26.643536 (+ 754us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:26.643542 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:26.643548 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:26.643730 (+ 182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:26.644132 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:26.644138 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:26.644147 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:26.644736 (+ 589us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:36:26.645067 (+ 331us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:26.645524 (+ 457us) server_negotiation.cc:299] Negotiation successful
0807 10:36:26.645952 (+ 428us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":584,"thread_start_us":394,"threads_started":1}
I20260807 10:36:26.649468 24390 raft_consensus.cc:348] T 00000000000000000000000000000000 P e40c19c851154ea2a376491490355ad8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e40c19c851154ea2a376491490355ad8" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 36607 } }
I20260807 10:36:26.649930 24390 raft_consensus.cc:374] T 00000000000000000000000000000000 P e40c19c851154ea2a376491490355ad8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:36:26.650015 24390 raft_consensus.cc:729] T 00000000000000000000000000000000 P e40c19c851154ea2a376491490355ad8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e40c19c851154ea2a376491490355ad8, State: Initialized, Role: FOLLOWER
I20260807 10:36:26.650558 24390 consensus_queue.cc:260] T 00000000000000000000000000000000 P e40c19c851154ea2a376491490355ad8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e40c19c851154ea2a376491490355ad8" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 36607 } }
I20260807 10:36:26.650791 24390 raft_consensus.cc:388] T 00000000000000000000000000000000 P e40c19c851154ea2a376491490355ad8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 10:36:26.650893 24390 raft_consensus.cc:482] T 00000000000000000000000000000000 P e40c19c851154ea2a376491490355ad8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 10:36:26.651077 24390 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e40c19c851154ea2a376491490355ad8 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:36:26.653628 24390 raft_consensus.cc:504] T 00000000000000000000000000000000 P e40c19c851154ea2a376491490355ad8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e40c19c851154ea2a376491490355ad8" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 36607 } }
I20260807 10:36:26.654070 24390 leader_election.cc:302] T 00000000000000000000000000000000 P e40c19c851154ea2a376491490355ad8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e40c19c851154ea2a376491490355ad8; no voters:
I20260807 10:36:26.654587 24390 leader_election.cc:288] T 00000000000000000000000000000000 P e40c19c851154ea2a376491490355ad8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 10:36:26.654728 24395 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e40c19c851154ea2a376491490355ad8 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:36:26.655522 24395 raft_consensus.cc:686] T 00000000000000000000000000000000 P e40c19c851154ea2a376491490355ad8 [term 1 LEADER]: Becoming Leader. State: Replica: e40c19c851154ea2a376491490355ad8, State: Running, Role: LEADER
I20260807 10:36:26.656069 24395 consensus_queue.cc:237] T 00000000000000000000000000000000 P e40c19c851154ea2a376491490355ad8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e40c19c851154ea2a376491490355ad8" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 36607 } }
I20260807 10:36:26.656870 24390 sys_catalog.cc:564] T 00000000000000000000000000000000 P e40c19c851154ea2a376491490355ad8 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 10:36:26.658964 24396 sys_catalog.cc:455] T 00000000000000000000000000000000 P e40c19c851154ea2a376491490355ad8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e40c19c851154ea2a376491490355ad8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e40c19c851154ea2a376491490355ad8" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 36607 } } }
I20260807 10:36:26.659364 24396 sys_catalog.cc:458] T 00000000000000000000000000000000 P e40c19c851154ea2a376491490355ad8 [sys.catalog]: This master's current role is: LEADER
I20260807 10:36:26.660878 24397 sys_catalog.cc:455] T 00000000000000000000000000000000 P e40c19c851154ea2a376491490355ad8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e40c19c851154ea2a376491490355ad8. Latest consensus state: current_term: 1 leader_uuid: "e40c19c851154ea2a376491490355ad8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e40c19c851154ea2a376491490355ad8" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 36607 } } }
I20260807 10:36:26.661703 24397 sys_catalog.cc:458] T 00000000000000000000000000000000 P e40c19c851154ea2a376491490355ad8 [sys.catalog]: This master's current role is: LEADER
I20260807 10:36:26.662611 24403 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 10:36:26.667922 24403 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 10:36:26.678336 24403 catalog_manager.cc:1347] Generated new cluster ID: c6501ef538b34c309679f3efe68a1fbe
I20260807 10:36:26.678459 24403 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 10:36:26.693645 24403 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 10:36:26.695464 24403 catalog_manager.cc:1504] Loading token signing keys...
I20260807 10:36:26.705729 24403 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e40c19c851154ea2a376491490355ad8: Generated new TSK 0
I20260807 10:36:26.706624 24403 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.171.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.171.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.171.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.65.keytab.
Entry for principal kudu/127.20.171.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.65.keytab.
I20260807 10:36:26.770052 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786098956060137-21165-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786098956060137-21165-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786098956060137-21165-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786098956060137-21165-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.171.65:0
--local_ip_for_outbound_sockets=127.20.171.65
--webserver_interface=127.20.171.65
--webserver_port=0
--tserver_master_addrs=127.20.171.126:36607
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.65.keytab
--principal=kudu/127.20.171.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.171.84:34511
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786098956060137-21165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786098956060137-21165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786098956060137-21165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:36:27.102849 24418 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:36:27.103111 24418 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:36:27.103204 24418 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:36:27.109953 24418 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:36:27.110066 24418 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:36:27.110167 24418 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.171.65
I20260807 10:36:27.119124 24418 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.171.84:34511
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786098956060137-21165-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786098956060137-21165-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.65.keytab
--principal=kudu/127.20.171.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.171.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786098956060137-21165-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.171.65
--webserver_port=0
--tserver_master_addrs=127.20.171.126:36607
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.171.65
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786098956060137-21165-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:36:27.120348 24418 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:36:27.121675 24418 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:36:27.134464 24423 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:36:27.134440 24426 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:36:27.134533 24424 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:36:27.135476 24418 server_base.cc:1034] running on GCE node
I20260807 10:36:27.136046 24418 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:36:27.136981 24418 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:36:27.138206 24418 hybrid_clock.cc:648] HybridClock initialized: now 1786098987138166 us; error 49 us; skew 500 ppm
I20260807 10:36:27.138509 24418 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:36:27 dist-test-slave-0b58 krb5kdc[24306](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786098987, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:36:27.141649 24418 init.cc:377] Logged in from keytab as kudu/127.20.171.65@KRBTEST.COM (short username kudu)
I20260807 10:36:27.143011 24418 webserver.cc:460] Webserver started at http://127.20.171.65:34729/ using document root <none> and password file <none>
I20260807 10:36:27.143604 24418 fs_manager.cc:359] Metadata directory not provided
I20260807 10:36:27.143702 24418 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:36:27.143934 24418 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:36:27.146826 24418 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786098956060137-21165-0/minicluster-data/ts-0/data/instance:
uuid: "9c01d065f3b2469484b11024eae9abff"
format_stamp: "Formatted at 2026-08-07 10:36:27 on dist-test-slave-0b58"
server_key: "807172495749265f827b685fb60bb568"
server_key_iv: "979ca129a3804e5a4bf215f833f6d405"
server_key_version: "encryptionkey@0"
I20260807 10:36:27.147585 24418 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786098956060137-21165-0/minicluster-data/ts-0/wal/instance:
uuid: "9c01d065f3b2469484b11024eae9abff"
format_stamp: "Formatted at 2026-08-07 10:36:27 on dist-test-slave-0b58"
server_key: "807172495749265f827b685fb60bb568"
server_key_iv: "979ca129a3804e5a4bf215f833f6d405"
server_key_version: "encryptionkey@0"
I20260807 10:36:27.152968 24418 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.004s
I20260807 10:36:27.156471 24433 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:36:27.157828 24418 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260807 10:36:27.158000 24418 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786098956060137-21165-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786098956060137-21165-0/minicluster-data/ts-0/wal
uuid: "9c01d065f3b2469484b11024eae9abff"
format_stamp: "Formatted at 2026-08-07 10:36:27 on dist-test-slave-0b58"
server_key: "807172495749265f827b685fb60bb568"
server_key_iv: "979ca129a3804e5a4bf215f833f6d405"
server_key_version: "encryptionkey@0"
I20260807 10:36:27.158294 24418 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786098956060137-21165-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786098956060137-21165-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786098956060137-21165-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:36:27.174034 24418 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:36:27.178254 24418 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:36:27.178573 24418 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:36:27.179606 24418 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:36:27.181031 24418 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:36:27.181145 24418 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:36:27.181329 24418 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:36:27.181412 24418 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:36:27.214589 24418 rpc_server.cc:307] RPC server started. Bound to: 127.20.171.65:45427
I20260807 10:36:27.214634 24548 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.171.65:45427 every 8 connection(s)
I20260807 10:36:27.215894 24418 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786098956060137-21165-0/minicluster-data/ts-0/data/info.pb
I20260807 10:36:27.223451 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 24418
I20260807 10:36:27.223666 21165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786098956060137-21165-0/minicluster-data/ts-0/wal/instance
I20260807 10:36:27.224452 21165 external_mini_cluster.cc:1428] Setting key aa5b58637d630c75a85142759c219f42
Aug 07 10:36:27 dist-test-slave-0b58 krb5kdc[24306](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786098987, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.65@KRBTEST.COM for kudu/127.20.171.126@KRBTEST.COM
I20260807 10:36:27.236066 24551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:27.218553 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.65:47029 (local address 127.20.171.126:36607)
0807 10:36:27.219020 (+ 467us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:27.219025 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:27.219978 (+ 953us) server_negotiation.cc:407] Connection header received
0807 10:36:27.221881 (+ 1903us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:27.221887 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:27.221979 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:27.222104 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:36:27.223748 (+ 1644us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:27.224633 (+ 885us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:27.226451 (+ 1818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:27.226858 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:27.226999 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:27.230387 (+ 3388us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:36:27.230392 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:36:27.230395 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:36:27.230425 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:36:27.233176 (+ 2751us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:27.233853 (+ 677us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:27.233860 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:27.233863 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:27.233980 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:27.234406 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:27.234411 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:27.234414 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:27.234668 (+ 254us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:36:27.234820 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:27.235624 (+ 804us) server_negotiation.cc:299] Negotiation successful
0807 10:36:27.235793 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":354,"thread_start_us":239,"threads_started":1}
I20260807 10:36:27.237546 24552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:27.219122 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:36607 (local address 127.20.171.65:47029)
0807 10:36:27.219824 (+ 702us) negotiation.cc:107] Waiting for socket to connect
0807 10:36:27.219867 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0807 10:36:27.221606 (+ 1739us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:36:27.222410 (+ 804us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:36:27.222439 (+ 29us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:36:27.222990 (+ 551us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:36:27.223546 (+ 556us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:27.223563 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:27.224800 (+ 1237us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:27.224810 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:27.226294 (+ 1484us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:27.226307 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:27.227088 (+ 781us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:27.227097 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:27.227343 (+ 246us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:27.228034 (+ 691us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:36:27.228056 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:36:27.230172 (+ 2116us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:36:27.233311 (+ 3139us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:36:27.233321 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:36:27.233335 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:36:27.233728 (+ 393us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:36:27.234088 (+ 360us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:36:27.234092 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:36:27.234096 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:36:27.234293 (+ 197us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:36:27.234793 (+ 500us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:36:27.234801 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:36:27.235185 (+ 384us) client_negotiation.cc:769] Sending connection context
0807 10:36:27.235530 (+ 345us) client_negotiation.cc:240] Negotiation successful
0807 10:36:27.236114 (+ 584us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":472,"thread_start_us":274,"threads_started":1}
I20260807 10:36:27.239193 24549 heartbeater.cc:347] Connected to a master server at 127.20.171.126:36607
I20260807 10:36:27.239488 24549 heartbeater.cc:464] Registering TS with master...
I20260807 10:36:27.240187 24549 heartbeater.cc:511] Master 127.20.171.126:36607 requested a full tablet report, sending...
I20260807 10:36:27.242261 24353 ts_manager.cc:194] Registered new tserver with Master: 9c01d065f3b2469484b11024eae9abff (127.20.171.65:45427)
I20260807 10:36:27.243626 24353 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.171.65@KRBTEST.COM'} at 127.20.171.65:47029
WARNING: no policy specified for kudu/127.20.171.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.171.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.171.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.66.keytab.
Entry for principal kudu/127.20.171.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.66.keytab.
I20260807 10:36:27.277819 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786098956060137-21165-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786098956060137-21165-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786098956060137-21165-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786098956060137-21165-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.171.66:0
--local_ip_for_outbound_sockets=127.20.171.66
--webserver_interface=127.20.171.66
--webserver_port=0
--tserver_master_addrs=127.20.171.126:36607
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.66.keytab
--principal=kudu/127.20.171.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.171.84:34511
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786098956060137-21165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786098956060137-21165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786098956060137-21165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:36:27.602552 24555 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:36:27.602824 24555 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:36:27.602913 24555 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:36:27.609975 24555 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:36:27.610087 24555 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:36:27.610208 24555 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.171.66
I20260807 10:36:27.623678 24555 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.171.84:34511
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786098956060137-21165-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786098956060137-21165-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.66.keytab
--principal=kudu/127.20.171.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.171.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786098956060137-21165-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.171.66
--webserver_port=0
--tserver_master_addrs=127.20.171.126:36607
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.171.66
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786098956060137-21165-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:36:27.625281 24555 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:36:27.626869 24555 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:36:27.641744 24561 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:36:27.641835 24560 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:36:27.642379 24563 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:36:27.642472 24555 server_base.cc:1034] running on GCE node
I20260807 10:36:27.643065 24555 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:36:27.643929 24555 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:36:27.645128 24555 hybrid_clock.cc:648] HybridClock initialized: now 1786098987645073 us; error 39 us; skew 500 ppm
I20260807 10:36:27.645407 24555 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:36:27 dist-test-slave-0b58 krb5kdc[24306](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786098987, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:36:27.648535 24555 init.cc:377] Logged in from keytab as kudu/127.20.171.66@KRBTEST.COM (short username kudu)
I20260807 10:36:27.649979 24555 webserver.cc:460] Webserver started at http://127.20.171.66:45827/ using document root <none> and password file <none>
I20260807 10:36:27.650641 24555 fs_manager.cc:359] Metadata directory not provided
I20260807 10:36:27.650779 24555 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:36:27.651088 24555 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:36:27.654035 24555 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786098956060137-21165-0/minicluster-data/ts-1/data/instance:
uuid: "e64b0dd2c69b478b99b5ea4509af116b"
format_stamp: "Formatted at 2026-08-07 10:36:27 on dist-test-slave-0b58"
server_key: "b10f23c2fd2d331f52ef1e78d7e5460b"
server_key_iv: "deb90f7a50da1211a43a29e79222145f"
server_key_version: "encryptionkey@0"
I20260807 10:36:27.654860 24555 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786098956060137-21165-0/minicluster-data/ts-1/wal/instance:
uuid: "e64b0dd2c69b478b99b5ea4509af116b"
format_stamp: "Formatted at 2026-08-07 10:36:27 on dist-test-slave-0b58"
server_key: "b10f23c2fd2d331f52ef1e78d7e5460b"
server_key_iv: "deb90f7a50da1211a43a29e79222145f"
server_key_version: "encryptionkey@0"
I20260807 10:36:27.660238 24555 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260807 10:36:27.663985 24570 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:36:27.665463 24555 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260807 10:36:27.665656 24555 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786098956060137-21165-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786098956060137-21165-0/minicluster-data/ts-1/wal
uuid: "e64b0dd2c69b478b99b5ea4509af116b"
format_stamp: "Formatted at 2026-08-07 10:36:27 on dist-test-slave-0b58"
server_key: "b10f23c2fd2d331f52ef1e78d7e5460b"
server_key_iv: "deb90f7a50da1211a43a29e79222145f"
server_key_version: "encryptionkey@0"
I20260807 10:36:27.665906 24555 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786098956060137-21165-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786098956060137-21165-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786098956060137-21165-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:36:27.693473 24555 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:36:27.697523 24555 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:36:27.697863 24555 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:36:27.698869 24555 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:36:27.700181 24555 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:36:27.700249 24555 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:36:27.700394 24555 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:36:27.700469 24555 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:36:27.733253 24555 rpc_server.cc:307] RPC server started. Bound to: 127.20.171.66:44763
I20260807 10:36:27.733292 24685 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.171.66:44763 every 8 connection(s)
I20260807 10:36:27.734683 24555 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786098956060137-21165-0/minicluster-data/ts-1/data/info.pb
I20260807 10:36:27.741441 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 24555
I20260807 10:36:27.741621 21165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786098956060137-21165-0/minicluster-data/ts-1/wal/instance
I20260807 10:36:27.742058 21165 external_mini_cluster.cc:1428] Setting key 9b2509e8d707193578c53452fdcf6c21
Aug 07 10:36:27 dist-test-slave-0b58 krb5kdc[24306](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786098987, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.66@KRBTEST.COM for kudu/127.20.171.126@KRBTEST.COM
I20260807 10:36:27.756348 24688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:27.737300 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.66:40281 (local address 127.20.171.126:36607)
0807 10:36:27.737778 (+ 478us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:27.737784 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:27.738881 (+ 1097us) server_negotiation.cc:407] Connection header received
0807 10:36:27.740760 (+ 1879us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:27.740766 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:27.740831 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:27.740930 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:36:27.742625 (+ 1695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:27.743503 (+ 878us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:27.745224 (+ 1721us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:27.745957 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:27.746106 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:27.749604 (+ 3498us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:36:27.749613 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:36:27.749620 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:36:27.749676 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:36:27.753175 (+ 3499us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:27.753931 (+ 756us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:27.753938 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:27.753943 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:27.754107 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:27.754533 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:27.754537 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:27.754540 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:27.754923 (+ 383us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:36:27.755087 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:27.755710 (+ 623us) server_negotiation.cc:299] Negotiation successful
0807 10:36:27.755940 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":329,"thread_start_us":201,"threads_started":1}
I20260807 10:36:27.757633 24689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:27.737878 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:36607 (local address 127.20.171.66:40281)
0807 10:36:27.738717 (+ 839us) negotiation.cc:107] Waiting for socket to connect
0807 10:36:27.738756 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0807 10:36:27.740470 (+ 1714us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:36:27.741138 (+ 668us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:36:27.741146 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:36:27.741799 (+ 653us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:36:27.742427 (+ 628us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:27.742446 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:27.743668 (+ 1222us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:27.743673 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:27.745077 (+ 1404us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:27.745090 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:27.746209 (+ 1119us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:27.746214 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:27.746413 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:27.747126 (+ 713us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:36:27.747149 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:36:27.749384 (+ 2235us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:36:27.753316 (+ 3932us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:36:27.753322 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:36:27.753333 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:36:27.753777 (+ 444us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:36:27.754230 (+ 453us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:36:27.754234 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:36:27.754236 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:36:27.754409 (+ 173us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:36:27.755041 (+ 632us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:36:27.755047 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:36:27.755340 (+ 293us) client_negotiation.cc:769] Sending connection context
0807 10:36:27.755598 (+ 258us) client_negotiation.cc:240] Negotiation successful
0807 10:36:27.756118 (+ 520us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":529,"thread_start_us":312,"threads_started":1}
I20260807 10:36:27.759121 24686 heartbeater.cc:347] Connected to a master server at 127.20.171.126:36607
I20260807 10:36:27.759447 24686 heartbeater.cc:464] Registering TS with master...
I20260807 10:36:27.760145 24686 heartbeater.cc:511] Master 127.20.171.126:36607 requested a full tablet report, sending...
I20260807 10:36:27.761780 24353 ts_manager.cc:194] Registered new tserver with Master: e64b0dd2c69b478b99b5ea4509af116b (127.20.171.66:44763)
I20260807 10:36:27.763149 24353 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.171.66@KRBTEST.COM'} at 127.20.171.66:40281
WARNING: no policy specified for kudu/127.20.171.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.171.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.171.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.67.keytab.
Entry for principal kudu/127.20.171.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.67.keytab.
I20260807 10:36:27.796016 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786098956060137-21165-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786098956060137-21165-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786098956060137-21165-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786098956060137-21165-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.171.67:0
--local_ip_for_outbound_sockets=127.20.171.67
--webserver_interface=127.20.171.67
--webserver_port=0
--tserver_master_addrs=127.20.171.126:36607
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.67.keytab
--principal=kudu/127.20.171.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.171.84:34511
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786098956060137-21165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786098956060137-21165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786098956060137-21165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:36:28.120491 24692 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:36:28.120754 24692 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:36:28.120844 24692 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:36:28.127679 24692 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:36:28.127775 24692 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:36:28.127887 24692 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.171.67
I20260807 10:36:28.137195 24692 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.171.84:34511
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786098956060137-21165-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786098956060137-21165-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.67.keytab
--principal=kudu/127.20.171.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.171.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786098956060137-21165-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.171.67
--webserver_port=0
--tserver_master_addrs=127.20.171.126:36607
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.171.67
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786098956060137-21165-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:36:28.138386 24692 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:36:28.139536 24692 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:36:28.152395 24698 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:36:28.152496 24701 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:36:28.152467 24699 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:36:28.153453 24692 server_base.cc:1034] running on GCE node
I20260807 10:36:28.153985 24692 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:36:28.154932 24692 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:36:28.156127 24692 hybrid_clock.cc:648] HybridClock initialized: now 1786098988156074 us; error 48 us; skew 500 ppm
I20260807 10:36:28.156497 24692 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:36:28 dist-test-slave-0b58 krb5kdc[24306](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786098988, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:36:28.159938 24692 init.cc:377] Logged in from keytab as kudu/127.20.171.67@KRBTEST.COM (short username kudu)
I20260807 10:36:28.161415 24692 webserver.cc:460] Webserver started at http://127.20.171.67:44897/ using document root <none> and password file <none>
I20260807 10:36:28.162034 24692 fs_manager.cc:359] Metadata directory not provided
I20260807 10:36:28.162202 24692 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:36:28.162524 24692 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:36:28.165591 24692 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786098956060137-21165-0/minicluster-data/ts-2/data/instance:
uuid: "974779bf1e96484ca60508ce638d1acb"
format_stamp: "Formatted at 2026-08-07 10:36:28 on dist-test-slave-0b58"
server_key: "190ce82aa2cd4b197abf3b51b717b399"
server_key_iv: "f5386690bcb014cba8cbf23169daa589"
server_key_version: "encryptionkey@0"
I20260807 10:36:28.166668 24692 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786098956060137-21165-0/minicluster-data/ts-2/wal/instance:
uuid: "974779bf1e96484ca60508ce638d1acb"
format_stamp: "Formatted at 2026-08-07 10:36:28 on dist-test-slave-0b58"
server_key: "190ce82aa2cd4b197abf3b51b717b399"
server_key_iv: "f5386690bcb014cba8cbf23169daa589"
server_key_version: "encryptionkey@0"
I20260807 10:36:28.171927 24692 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.005s
I20260807 10:36:28.175413 24708 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:36:28.176852 24692 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.003s
I20260807 10:36:28.176977 24692 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786098956060137-21165-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786098956060137-21165-0/minicluster-data/ts-2/wal
uuid: "974779bf1e96484ca60508ce638d1acb"
format_stamp: "Formatted at 2026-08-07 10:36:28 on dist-test-slave-0b58"
server_key: "190ce82aa2cd4b197abf3b51b717b399"
server_key_iv: "f5386690bcb014cba8cbf23169daa589"
server_key_version: "encryptionkey@0"
I20260807 10:36:28.177126 24692 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786098956060137-21165-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786098956060137-21165-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786098956060137-21165-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:36:28.202805 24692 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:36:28.206914 24692 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:36:28.207276 24692 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:36:28.208199 24692 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:36:28.209478 24692 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:36:28.209550 24692 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:36:28.209631 24692 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:36:28.209681 24692 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:36:28.246549 24549 heartbeater.cc:503] Master 127.20.171.126:36607 was elected leader, sending a full tablet report...
I20260807 10:36:28.249681 24692 rpc_server.cc:307] RPC server started. Bound to: 127.20.171.67:34849
I20260807 10:36:28.249724 24824 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.171.67:34849 every 8 connection(s)
I20260807 10:36:28.251041 24692 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786098956060137-21165-0/minicluster-data/ts-2/data/info.pb
I20260807 10:36:28.258329 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 24692
I20260807 10:36:28.258529 21165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786098956060137-21165-0/minicluster-data/ts-2/wal/instance
I20260807 10:36:28.259044 21165 external_mini_cluster.cc:1428] Setting key 3326c20088e761335095117b9d3d99b3
Aug 07 10:36:28 dist-test-slave-0b58 krb5kdc[24306](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786098988, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.67@KRBTEST.COM for kudu/127.20.171.126@KRBTEST.COM
I20260807 10:36:28.272111 24688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:28.253569 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.67:58671 (local address 127.20.171.126:36607)
0807 10:36:28.253753 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:28.253757 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:28.254819 (+ 1062us) server_negotiation.cc:407] Connection header received
0807 10:36:28.256712 (+ 1893us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:28.256717 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:28.256819 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:28.256930 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:36:28.259156 (+ 2226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:28.260143 (+ 987us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:28.262509 (+ 2366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:28.262992 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:28.263085 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:28.266695 (+ 3610us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:36:28.266700 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:36:28.266703 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:36:28.266736 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:36:28.269416 (+ 2680us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:28.270106 (+ 690us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:28.270110 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:28.270113 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:28.270239 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:28.270610 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:28.270613 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:28.270615 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:28.270928 (+ 313us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:36:28.271048 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:28.271706 (+ 658us) server_negotiation.cc:299] Negotiation successful
0807 10:36:28.271884 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260807 10:36:28.273243 24827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:28.253947 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:36607 (local address 127.20.171.67:58671)
0807 10:36:28.254649 (+ 702us) negotiation.cc:107] Waiting for socket to connect
0807 10:36:28.254703 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0807 10:36:28.256452 (+ 1749us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:36:28.257159 (+ 707us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:36:28.257167 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:36:28.257680 (+ 513us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:36:28.258967 (+ 1287us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:28.258986 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:28.260348 (+ 1362us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:28.260353 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:28.262310 (+ 1957us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:28.262335 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:28.263175 (+ 840us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:28.263180 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:28.263372 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:28.263969 (+ 597us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:36:28.263990 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:36:28.266503 (+ 2513us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:36:28.269529 (+ 3026us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:36:28.269536 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:36:28.269547 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:36:28.269993 (+ 446us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:36:28.270315 (+ 322us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:36:28.270318 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:36:28.270320 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:36:28.270503 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:36:28.271035 (+ 532us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:36:28.271040 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:36:28.271352 (+ 312us) client_negotiation.cc:769] Sending connection context
0807 10:36:28.271595 (+ 243us) client_negotiation.cc:240] Negotiation successful
0807 10:36:28.271977 (+ 382us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":467,"thread_start_us":267,"threads_started":1}
I20260807 10:36:28.275019 24825 heartbeater.cc:347] Connected to a master server at 127.20.171.126:36607
I20260807 10:36:28.275323 24825 heartbeater.cc:464] Registering TS with master...
I20260807 10:36:28.276008 24825 heartbeater.cc:511] Master 127.20.171.126:36607 requested a full tablet report, sending...
I20260807 10:36:28.277520 24352 ts_manager.cc:194] Registered new tserver with Master: 974779bf1e96484ca60508ce638d1acb (127.20.171.67:34849)
I20260807 10:36:28.278399 24352 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.171.67@KRBTEST.COM'} at 127.20.171.67:58671
I20260807 10:36:28.287154 21165 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 07 10:36:28 dist-test-slave-0b58 krb5kdc[24306](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786098988, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Aug 07 10:36:28 dist-test-slave-0b58 krb5kdc[24306](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786098988, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.20.171.126@KRBTEST.COM
I20260807 10:36:28.340237 24688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:28.326918 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59908 (local address 127.20.171.126:36607)
0807 10:36:28.327196 (+ 278us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:28.327203 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:28.327530 (+ 327us) server_negotiation.cc:407] Connection header received
0807 10:36:28.327677 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:28.327681 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:28.327771 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:28.327855 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:36:28.329253 (+ 1398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:28.329969 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:28.331165 (+ 1196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:28.331589 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:28.331683 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:28.335267 (+ 3584us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:36:28.335276 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:36:28.335280 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:36:28.335327 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:36:28.337857 (+ 2530us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:28.338562 (+ 705us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:28.338565 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:28.338567 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:28.338682 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:28.338980 (+ 298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:28.338982 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:28.338984 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:28.339267 (+ 283us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:36:28.339443 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:28.339677 (+ 234us) server_negotiation.cc:299] Negotiation successful
0807 10:36:28.339838 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
W20260807 10:36:28.340860 24352 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:59908
I20260807 10:36:28.342461 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 24418
Aug 07 10:36:28 dist-test-slave-0b58 krb5kdc[24306](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786098988, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.20.171.65@KRBTEST.COM
I20260807 10:36:28.357895 24836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:28.343475 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46198 (local address 127.20.171.65:45427)
0807 10:36:28.344125 (+ 650us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:28.344132 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:28.344154 (+ 22us) server_negotiation.cc:407] Connection header received
0807 10:36:28.344214 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:28.344220 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:28.344480 (+ 260us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:28.344656 (+ 176us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:36:28.345825 (+ 1169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:28.346877 (+ 1052us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:28.348105 (+ 1228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:28.348799 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:28.348936 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:28.352565 (+ 3629us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:36:28.352589 (+ 24us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:36:28.352601 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:36:28.352636 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:36:28.355128 (+ 2492us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:28.355806 (+ 678us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:28.355819 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:28.355823 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:28.355946 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:28.356358 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:28.356363 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:28.356365 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:28.356685 (+ 320us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:36:28.357013 (+ 328us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:28.357278 (+ 265us) server_negotiation.cc:299] Negotiation successful
0807 10:36:28.357547 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":505,"thread_start_us":331,"threads_started":1}
W20260807 10:36:28.359227 24544 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:46198
W20260807 10:36:28.360268 21165 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 24418: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260807 10:36:28.360453 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 24418
I20260807 10:36:28.381280 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 24555
Aug 07 10:36:28 dist-test-slave-0b58 krb5kdc[24306](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786098988, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.20.171.66@KRBTEST.COM
I20260807 10:36:28.396807 24837 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:28.382219 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54172 (local address 127.20.171.66:44763)
0807 10:36:28.382795 (+ 576us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:28.382802 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:28.382827 (+ 25us) server_negotiation.cc:407] Connection header received
0807 10:36:28.382888 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:28.382894 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:28.383113 (+ 219us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:28.383240 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:36:28.384544 (+ 1304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:28.385487 (+ 943us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:28.386642 (+ 1155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:28.387179 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:28.387277 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:28.391489 (+ 4212us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:36:28.391502 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:36:28.391517 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:36:28.391554 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:36:28.394362 (+ 2808us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:28.394910 (+ 548us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:28.394917 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:28.394919 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:28.395036 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:28.395428 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:28.395432 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:28.395434 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:28.395778 (+ 344us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:36:28.395984 (+ 206us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:28.396235 (+ 251us) server_negotiation.cc:299] Negotiation successful
0807 10:36:28.396497 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":414,"thread_start_us":294,"threads_started":1}
W20260807 10:36:28.397985 24681 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:54172
W20260807 10:36:28.398998 21165 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 24555: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260807 10:36:28.399142 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 24555
I20260807 10:36:28.417855 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 24692
Aug 07 10:36:28 dist-test-slave-0b58 krb5kdc[24306](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786098988, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.20.171.67@KRBTEST.COM
I20260807 10:36:28.434043 24838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:28.418816 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36128 (local address 127.20.171.67:34849)
0807 10:36:28.419475 (+ 659us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:28.419483 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:28.419512 (+ 29us) server_negotiation.cc:407] Connection header received
0807 10:36:28.419569 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:28.419575 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:28.419784 (+ 209us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:28.419904 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:36:28.421313 (+ 1409us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:28.422373 (+ 1060us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:28.423555 (+ 1182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:28.424085 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:28.424182 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:28.428617 (+ 4435us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:36:28.428630 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:36:28.428644 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:36:28.428678 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:36:28.431492 (+ 2814us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:28.432118 (+ 626us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:28.432125 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:28.432127 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:28.432319 (+ 192us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:28.432672 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:28.432675 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:28.432677 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:28.432998 (+ 321us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:36:28.433254 (+ 256us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:28.433457 (+ 203us) server_negotiation.cc:299] Negotiation successful
0807 10:36:28.433651 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":512,"thread_start_us":358,"threads_started":1}
W20260807 10:36:28.435300 24820 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:36128
W20260807 10:36:28.436365 21165 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 24692: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260807 10:36:28.436512 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 24692
I20260807 10:36:28.455444 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 24320
I20260807 10:36:28.456794 24385 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:36:28.562536 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 24320
2026-08-07T10:36:28Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (3719 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786098956060137-21165-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 10:36:28 dist-test-slave-0b58 krb5kdc[24842](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 10:36:28 dist-test-slave-0b58 krb5kdc[24842](info): set up 2 sockets
Aug 07 10:36:28 dist-test-slave-0b58 krb5kdc[24842](info): commencing operation
krb5kdc: starting...
W20260807 10:36:29.673933 21165 mini_kdc.cc:121] Time spent starting KDC: real 1.064s user 0.002s sys 0.026s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786098956060137-21165-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786098956060137-21165-0/krb5kdc/test-user.keytab.
Aug 07 10:36:29 dist-test-slave-0b58 krb5kdc[24842](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786098989, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T10:36:29Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T10:36:29Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.171.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.171.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.171.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.126.keytab.
Entry for principal kudu/127.20.171.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.126.keytab.
I20260807 10:36:29.903687 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786098956060137-21165-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786098956060137-21165-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786098956060137-21165-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.171.126:39215
--webserver_interface=127.20.171.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.126.keytab
--principal=kudu/127.20.171.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.171.84:32831
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.171.126:39215
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786098956060137-21165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786098956060137-21165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786098956060137-21165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:36:30.226433 24856 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:36:30.226760 24856 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:36:30.226925 24856 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:36:30.235280 24856 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 10:36:30.235442 24856 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:36:30.235538 24856 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:36:30.235632 24856 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 10:36:30.235697 24856 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 10:36:30.245113 24856 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.171.84:32831
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786098956060137-21165-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786098956060137-21165-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.171.126:39215
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.126.keytab
--principal=kudu/127.20.171.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.171.126:39215
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.171.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786098956060137-21165-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:36:30.246436 24856 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:36:30.247766 24856 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:36:30.259119 24864 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:36:30.259200 24861 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:36:30.259145 24862 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:36:30.259909 24856 server_base.cc:1034] running on GCE node
I20260807 10:36:30.260747 24856 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:36:30.262329 24856 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:36:30.263581 24856 hybrid_clock.cc:648] HybridClock initialized: now 1786098990263541 us; error 57 us; skew 500 ppm
I20260807 10:36:30.263942 24856 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:36:30 dist-test-slave-0b58 krb5kdc[24842](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786098990, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:36:30.267361 24856 init.cc:377] Logged in from keytab as kudu/127.20.171.126@KRBTEST.COM (short username kudu)
I20260807 10:36:30.268937 24856 webserver.cc:460] Webserver started at http://127.20.171.126:34189/ using document root <none> and password file <none>
I20260807 10:36:30.269555 24856 fs_manager.cc:359] Metadata directory not provided
I20260807 10:36:30.269659 24856 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:36:30.269917 24856 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:36:30.272955 24856 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786098956060137-21165-0/minicluster-data/master-0/data/instance:
uuid: "eca42a87efd444b1b816479fda702ebd"
format_stamp: "Formatted at 2026-08-07 10:36:30 on dist-test-slave-0b58"
server_key: "52b4dea6124c272f750c31c0017c197a"
server_key_iv: "3b1445c5c62dfabb7b5a13cef44e0841"
server_key_version: "encryptionkey@0"
I20260807 10:36:30.273691 24856 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786098956060137-21165-0/minicluster-data/master-0/wal/instance:
uuid: "eca42a87efd444b1b816479fda702ebd"
format_stamp: "Formatted at 2026-08-07 10:36:30 on dist-test-slave-0b58"
server_key: "52b4dea6124c272f750c31c0017c197a"
server_key_iv: "3b1445c5c62dfabb7b5a13cef44e0841"
server_key_version: "encryptionkey@0"
I20260807 10:36:30.278792 24856 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260807 10:36:30.282142 24871 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:36:30.283420 24856 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 10:36:30.283699 24856 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786098956060137-21165-0/minicluster-data/master-0/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786098956060137-21165-0/minicluster-data/master-0/wal
uuid: "eca42a87efd444b1b816479fda702ebd"
format_stamp: "Formatted at 2026-08-07 10:36:30 on dist-test-slave-0b58"
server_key: "52b4dea6124c272f750c31c0017c197a"
server_key_iv: "3b1445c5c62dfabb7b5a13cef44e0841"
server_key_version: "encryptionkey@0"
I20260807 10:36:30.283897 24856 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786098956060137-21165-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786098956060137-21165-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786098956060137-21165-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:36:30.306488 24856 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:36:30.311116 24856 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:36:30.311424 24856 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:36:30.330227 24856 rpc_server.cc:307] RPC server started. Bound to: 127.20.171.126:39215
I20260807 10:36:30.330255 24923 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.171.126:39215 every 8 connection(s)
I20260807 10:36:30.331642 24856 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
I20260807 10:36:30.334283 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 24856
I20260807 10:36:30.334538 21165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786098956060137-21165-0/minicluster-data/master-0/wal/instance
I20260807 10:36:30.335404 21165 external_mini_cluster.cc:1428] Setting key 789ef48c38660d055f261bea2b563350
I20260807 10:36:30.336176 24924 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 07 10:36:30 dist-test-slave-0b58 krb5kdc[24842](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786098989, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.171.126@KRBTEST.COM
I20260807 10:36:30.351158 24924 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eca42a87efd444b1b816479fda702ebd: Bootstrap starting.
I20260807 10:36:30.354398 24924 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P eca42a87efd444b1b816479fda702ebd: Neither blocks nor log segments found. Creating new log.
I20260807 10:36:30.355417 24924 log.cc:824] T 00000000000000000000000000000000 P eca42a87efd444b1b816479fda702ebd: Log is configured to *not* fsync() on all Append() calls
I20260807 10:36:30.358868 24924 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eca42a87efd444b1b816479fda702ebd: No bootstrap required, opened a new log
I20260807 10:36:30.358886 24927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:30.337451 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55006 (local address 127.20.171.126:39215)
0807 10:36:30.338329 (+ 878us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:30.338339 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:30.338377 (+ 38us) server_negotiation.cc:407] Connection header received
0807 10:36:30.339845 (+ 1468us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:30.339865 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:30.340218 (+ 353us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:30.340611 (+ 393us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:36:30.342505 (+ 1894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:30.343846 (+ 1341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:30.345655 (+ 1809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:30.346335 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:30.346464 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:30.351149 (+ 4685us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:36:30.351173 (+ 24us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:36:30.351187 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:36:30.351227 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:36:30.354363 (+ 3136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:30.355056 (+ 693us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:30.355062 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:30.355068 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:30.355243 (+ 175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:30.355660 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:30.355664 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:30.355667 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:30.356364 (+ 697us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:36:30.356587 (+ 223us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:30.357109 (+ 522us) server_negotiation.cc:299] Negotiation successful
0807 10:36:30.357524 (+ 415us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":680,"thread_start_us":457,"threads_started":1}
I20260807 10:36:30.367022 24924 raft_consensus.cc:348] T 00000000000000000000000000000000 P eca42a87efd444b1b816479fda702ebd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eca42a87efd444b1b816479fda702ebd" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 39215 } }
I20260807 10:36:30.367400 24924 raft_consensus.cc:374] T 00000000000000000000000000000000 P eca42a87efd444b1b816479fda702ebd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:36:30.367470 24924 raft_consensus.cc:729] T 00000000000000000000000000000000 P eca42a87efd444b1b816479fda702ebd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eca42a87efd444b1b816479fda702ebd, State: Initialized, Role: FOLLOWER
I20260807 10:36:30.367918 24924 consensus_queue.cc:260] T 00000000000000000000000000000000 P eca42a87efd444b1b816479fda702ebd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eca42a87efd444b1b816479fda702ebd" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 39215 } }
I20260807 10:36:30.368108 24924 raft_consensus.cc:388] T 00000000000000000000000000000000 P eca42a87efd444b1b816479fda702ebd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 10:36:30.368214 24924 raft_consensus.cc:482] T 00000000000000000000000000000000 P eca42a87efd444b1b816479fda702ebd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 10:36:30.368408 24924 raft_consensus.cc:3037] T 00000000000000000000000000000000 P eca42a87efd444b1b816479fda702ebd [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:36:30.370414 24924 raft_consensus.cc:504] T 00000000000000000000000000000000 P eca42a87efd444b1b816479fda702ebd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eca42a87efd444b1b816479fda702ebd" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 39215 } }
I20260807 10:36:30.370895 24924 leader_election.cc:302] T 00000000000000000000000000000000 P eca42a87efd444b1b816479fda702ebd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: eca42a87efd444b1b816479fda702ebd; no voters:
I20260807 10:36:30.371678 24924 leader_election.cc:288] T 00000000000000000000000000000000 P eca42a87efd444b1b816479fda702ebd [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 10:36:30.371937 24929 raft_consensus.cc:2781] T 00000000000000000000000000000000 P eca42a87efd444b1b816479fda702ebd [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:36:30.372781 24929 raft_consensus.cc:686] T 00000000000000000000000000000000 P eca42a87efd444b1b816479fda702ebd [term 1 LEADER]: Becoming Leader. State: Replica: eca42a87efd444b1b816479fda702ebd, State: Running, Role: LEADER
I20260807 10:36:30.373360 24929 consensus_queue.cc:237] T 00000000000000000000000000000000 P eca42a87efd444b1b816479fda702ebd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eca42a87efd444b1b816479fda702ebd" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 39215 } }
I20260807 10:36:30.373867 24924 sys_catalog.cc:564] T 00000000000000000000000000000000 P eca42a87efd444b1b816479fda702ebd [sys.catalog]: configured and running, proceeding with master startup.
I20260807 10:36:30.375761 24930 sys_catalog.cc:455] T 00000000000000000000000000000000 P eca42a87efd444b1b816479fda702ebd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "eca42a87efd444b1b816479fda702ebd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eca42a87efd444b1b816479fda702ebd" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 39215 } } }
I20260807 10:36:30.376099 24930 sys_catalog.cc:458] T 00000000000000000000000000000000 P eca42a87efd444b1b816479fda702ebd [sys.catalog]: This master's current role is: LEADER
I20260807 10:36:30.376894 24931 sys_catalog.cc:455] T 00000000000000000000000000000000 P eca42a87efd444b1b816479fda702ebd [sys.catalog]: SysCatalogTable state changed. Reason: New leader eca42a87efd444b1b816479fda702ebd. Latest consensus state: current_term: 1 leader_uuid: "eca42a87efd444b1b816479fda702ebd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eca42a87efd444b1b816479fda702ebd" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 39215 } } }
I20260807 10:36:30.377314 24931 sys_catalog.cc:458] T 00000000000000000000000000000000 P eca42a87efd444b1b816479fda702ebd [sys.catalog]: This master's current role is: LEADER
I20260807 10:36:30.381268 24934 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 10:36:30.387876 24934 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 10:36:30.396808 24934 catalog_manager.cc:1347] Generated new cluster ID: 2fdefe07220d49b295324e3b25c84e9f
I20260807 10:36:30.396929 24934 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 10:36:30.417702 24934 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 10:36:30.419024 24934 catalog_manager.cc:1504] Loading token signing keys...
I20260807 10:36:30.430312 24934 catalog_manager.cc:5868] T 00000000000000000000000000000000 P eca42a87efd444b1b816479fda702ebd: Generated new TSK 0
I20260807 10:36:30.431166 24934 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.171.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.171.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.171.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.65.keytab.
Entry for principal kudu/127.20.171.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.65.keytab.
I20260807 10:36:30.487897 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786098956060137-21165-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786098956060137-21165-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786098956060137-21165-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786098956060137-21165-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.171.65:0
--local_ip_for_outbound_sockets=127.20.171.65
--webserver_interface=127.20.171.65
--webserver_port=0
--tserver_master_addrs=127.20.171.126:39215
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.65.keytab
--principal=kudu/127.20.171.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.171.84:32831
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786098956060137-21165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786098956060137-21165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786098956060137-21165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:36:30.822978 24950 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:36:30.823271 24950 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:36:30.823431 24950 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:36:30.830788 24950 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:36:30.830894 24950 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:36:30.831087 24950 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.171.65
I20260807 10:36:30.840495 24950 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.171.84:32831
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786098956060137-21165-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786098956060137-21165-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.65.keytab
--principal=kudu/127.20.171.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.171.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786098956060137-21165-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.171.65
--webserver_port=0
--tserver_master_addrs=127.20.171.126:39215
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.171.65
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786098956060137-21165-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:36:30.841821 24950 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:36:30.843250 24950 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:36:30.856479 24958 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:36:30.856647 24956 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:36:30.856419 24955 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:36:30.857640 24950 server_base.cc:1034] running on GCE node
I20260807 10:36:30.858291 24950 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:36:30.859263 24950 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:36:30.860503 24950 hybrid_clock.cc:648] HybridClock initialized: now 1786098990860433 us; error 53 us; skew 500 ppm
I20260807 10:36:30.860805 24950 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:36:30 dist-test-slave-0b58 krb5kdc[24842](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786098990, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:36:30.863934 24950 init.cc:377] Logged in from keytab as kudu/127.20.171.65@KRBTEST.COM (short username kudu)
I20260807 10:36:30.865558 24950 webserver.cc:460] Webserver started at http://127.20.171.65:33577/ using document root <none> and password file <none>
I20260807 10:36:30.866297 24950 fs_manager.cc:359] Metadata directory not provided
I20260807 10:36:30.866443 24950 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:36:30.866758 24950 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:36:30.869843 24950 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786098956060137-21165-0/minicluster-data/ts-0/data/instance:
uuid: "243e88d225f6481b878262e0a2f185f9"
format_stamp: "Formatted at 2026-08-07 10:36:30 on dist-test-slave-0b58"
server_key: "c065806e07a93170c82c4f91a6ac1bc1"
server_key_iv: "ff136a0a1894289ef6910bc2c0422593"
server_key_version: "encryptionkey@0"
I20260807 10:36:30.870750 24950 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786098956060137-21165-0/minicluster-data/ts-0/wal/instance:
uuid: "243e88d225f6481b878262e0a2f185f9"
format_stamp: "Formatted at 2026-08-07 10:36:30 on dist-test-slave-0b58"
server_key: "c065806e07a93170c82c4f91a6ac1bc1"
server_key_iv: "ff136a0a1894289ef6910bc2c0422593"
server_key_version: "encryptionkey@0"
I20260807 10:36:30.876331 24950 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260807 10:36:30.879722 24965 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:36:30.881071 24950 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260807 10:36:30.881263 24950 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786098956060137-21165-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786098956060137-21165-0/minicluster-data/ts-0/wal
uuid: "243e88d225f6481b878262e0a2f185f9"
format_stamp: "Formatted at 2026-08-07 10:36:30 on dist-test-slave-0b58"
server_key: "c065806e07a93170c82c4f91a6ac1bc1"
server_key_iv: "ff136a0a1894289ef6910bc2c0422593"
server_key_version: "encryptionkey@0"
I20260807 10:36:30.881475 24950 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786098956060137-21165-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786098956060137-21165-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786098956060137-21165-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:36:30.905304 24950 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:36:30.909255 24950 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:36:30.909539 24950 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:36:30.910465 24950 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:36:30.911808 24950 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:36:30.911911 24950 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:36:30.912055 24950 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:36:30.912135 24950 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:36:30.944836 24950 rpc_server.cc:307] RPC server started. Bound to: 127.20.171.65:34759
I20260807 10:36:30.944934 25081 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.171.65:34759 every 8 connection(s)
I20260807 10:36:30.946168 24950 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786098956060137-21165-0/minicluster-data/ts-0/data/info.pb
I20260807 10:36:30.952005 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 24950
I20260807 10:36:30.952328 21165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786098956060137-21165-0/minicluster-data/ts-0/wal/instance
I20260807 10:36:30.953017 21165 external_mini_cluster.cc:1428] Setting key ea4faa442d831b5ae20665bb8c8631eb
Aug 07 10:36:30 dist-test-slave-0b58 krb5kdc[24842](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786098990, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.65@KRBTEST.COM for kudu/127.20.171.126@KRBTEST.COM
I20260807 10:36:30.965844 25084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:30.948880 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.65:37575 (local address 127.20.171.126:39215)
0807 10:36:30.949342 (+ 462us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:30.949348 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:30.950303 (+ 955us) server_negotiation.cc:407] Connection header received
0807 10:36:30.952092 (+ 1789us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:30.952097 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:30.952199 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:30.952365 (+ 166us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:36:30.953952 (+ 1587us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:30.954917 (+ 965us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:30.956382 (+ 1465us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:30.956788 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:30.956932 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:30.960205 (+ 3273us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:36:30.960210 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:36:30.960218 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:36:30.960247 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:36:30.962808 (+ 2561us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:30.963610 (+ 802us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:30.963614 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:30.963618 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:30.963767 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:30.964171 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:30.964177 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:30.964179 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:30.964491 (+ 312us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:36:30.964649 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:30.965297 (+ 648us) server_negotiation.cc:299] Negotiation successful
0807 10:36:30.965506 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":341,"thread_start_us":207,"threads_started":1}
I20260807 10:36:30.966825 25085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:30.949492 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:39215 (local address 127.20.171.65:37575)
0807 10:36:30.950139 (+ 647us) negotiation.cc:107] Waiting for socket to connect
0807 10:36:30.950178 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0807 10:36:30.951832 (+ 1654us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:36:30.952580 (+ 748us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:36:30.952588 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:36:30.953093 (+ 505us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:36:30.953774 (+ 681us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:30.953801 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:30.955072 (+ 1271us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:30.955080 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:30.956194 (+ 1114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:30.956205 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:30.957037 (+ 832us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:30.957044 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:30.957267 (+ 223us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:30.957934 (+ 667us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:36:30.957956 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:36:30.960005 (+ 2049us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:36:30.962949 (+ 2944us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:36:30.962957 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:36:30.962972 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:36:30.963494 (+ 522us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:36:30.963883 (+ 389us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:36:30.963888 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:36:30.963891 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:36:30.964070 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:36:30.964618 (+ 548us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:36:30.964625 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:36:30.964949 (+ 324us) client_negotiation.cc:769] Sending connection context
0807 10:36:30.965191 (+ 242us) client_negotiation.cc:240] Negotiation successful
0807 10:36:30.965678 (+ 487us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":445,"thread_start_us":260,"threads_started":1}
I20260807 10:36:30.968459 25082 heartbeater.cc:347] Connected to a master server at 127.20.171.126:39215
I20260807 10:36:30.968802 25082 heartbeater.cc:464] Registering TS with master...
I20260807 10:36:30.969738 25082 heartbeater.cc:511] Master 127.20.171.126:39215 requested a full tablet report, sending...
I20260807 10:36:30.971832 24888 ts_manager.cc:194] Registered new tserver with Master: 243e88d225f6481b878262e0a2f185f9 (127.20.171.65:34759)
I20260807 10:36:30.973311 24888 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.171.65@KRBTEST.COM'} at 127.20.171.65:37575
WARNING: no policy specified for kudu/127.20.171.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.171.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.171.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.66.keytab.
Entry for principal kudu/127.20.171.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.66.keytab.
I20260807 10:36:31.005693 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786098956060137-21165-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786098956060137-21165-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786098956060137-21165-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786098956060137-21165-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.171.66:0
--local_ip_for_outbound_sockets=127.20.171.66
--webserver_interface=127.20.171.66
--webserver_port=0
--tserver_master_addrs=127.20.171.126:39215
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.66.keytab
--principal=kudu/127.20.171.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.171.84:32831
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786098956060137-21165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786098956060137-21165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786098956060137-21165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:36:31.328655 25088 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:36:31.328920 25088 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:36:31.329013 25088 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:36:31.335839 25088 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:36:31.335935 25088 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:36:31.336108 25088 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.171.66
I20260807 10:36:31.345460 25088 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.171.84:32831
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786098956060137-21165-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786098956060137-21165-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.66.keytab
--principal=kudu/127.20.171.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.171.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786098956060137-21165-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.171.66
--webserver_port=0
--tserver_master_addrs=127.20.171.126:39215
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.171.66
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786098956060137-21165-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:36:31.346758 25088 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:36:31.348062 25088 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:36:31.361025 25093 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:36:31.361076 25094 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:36:31.361148 25096 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:36:31.361883 25088 server_base.cc:1034] running on GCE node
I20260807 10:36:31.362511 25088 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:36:31.363436 25088 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:36:31.364660 25088 hybrid_clock.cc:648] HybridClock initialized: now 1786098991364616 us; error 53 us; skew 500 ppm
I20260807 10:36:31.364986 25088 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:36:31 dist-test-slave-0b58 krb5kdc[24842](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786098991, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:36:31.368454 25088 init.cc:377] Logged in from keytab as kudu/127.20.171.66@KRBTEST.COM (short username kudu)
I20260807 10:36:31.369804 25088 webserver.cc:460] Webserver started at http://127.20.171.66:38013/ using document root <none> and password file <none>
I20260807 10:36:31.370390 25088 fs_manager.cc:359] Metadata directory not provided
I20260807 10:36:31.370499 25088 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:36:31.370764 25088 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:36:31.373680 25088 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786098956060137-21165-0/minicluster-data/ts-1/data/instance:
uuid: "5d049b11c2cf4c7fa5199416c89caadb"
format_stamp: "Formatted at 2026-08-07 10:36:31 on dist-test-slave-0b58"
server_key: "2a3214a1b26f85ca9ae4f81a6ef67826"
server_key_iv: "9554be853e07452e85770d2923be8e61"
server_key_version: "encryptionkey@0"
I20260807 10:36:31.374501 25088 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786098956060137-21165-0/minicluster-data/ts-1/wal/instance:
uuid: "5d049b11c2cf4c7fa5199416c89caadb"
format_stamp: "Formatted at 2026-08-07 10:36:31 on dist-test-slave-0b58"
server_key: "2a3214a1b26f85ca9ae4f81a6ef67826"
server_key_iv: "9554be853e07452e85770d2923be8e61"
server_key_version: "encryptionkey@0"
I20260807 10:36:31.379714 25088 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260807 10:36:31.383317 25103 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:36:31.384645 25088 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 10:36:31.384815 25088 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786098956060137-21165-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786098956060137-21165-0/minicluster-data/ts-1/wal
uuid: "5d049b11c2cf4c7fa5199416c89caadb"
format_stamp: "Formatted at 2026-08-07 10:36:31 on dist-test-slave-0b58"
server_key: "2a3214a1b26f85ca9ae4f81a6ef67826"
server_key_iv: "9554be853e07452e85770d2923be8e61"
server_key_version: "encryptionkey@0"
I20260807 10:36:31.385007 25088 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786098956060137-21165-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786098956060137-21165-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786098956060137-21165-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:36:31.405681 25088 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:36:31.410247 25088 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:36:31.410519 25088 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:36:31.411446 25088 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:36:31.412823 25088 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:36:31.412938 25088 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:36:31.413089 25088 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:36:31.413168 25088 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:36:31.446949 25088 rpc_server.cc:307] RPC server started. Bound to: 127.20.171.66:34505
I20260807 10:36:31.447006 25217 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.171.66:34505 every 8 connection(s)
I20260807 10:36:31.448319 25088 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786098956060137-21165-0/minicluster-data/ts-1/data/info.pb
I20260807 10:36:31.456840 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 25088
I20260807 10:36:31.457042 21165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786098956060137-21165-0/minicluster-data/ts-1/wal/instance
I20260807 10:36:31.457563 21165 external_mini_cluster.cc:1428] Setting key 00183e8b9845afe0b0ced23044dc520c
Aug 07 10:36:31 dist-test-slave-0b58 krb5kdc[24842](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786098991, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.66@KRBTEST.COM for kudu/127.20.171.126@KRBTEST.COM
I20260807 10:36:31.469908 25084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:31.450774 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.66:52263 (local address 127.20.171.126:39215)
0807 10:36:31.450958 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:31.450962 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:31.452146 (+ 1184us) server_negotiation.cc:407] Connection header received
0807 10:36:31.453950 (+ 1804us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:31.453954 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:31.454022 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:31.454108 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:36:31.455574 (+ 1466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:31.456348 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:31.458447 (+ 2099us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:31.459088 (+ 641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:31.459208 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:31.463496 (+ 4288us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:36:31.463500 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:36:31.463503 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:36:31.463534 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:36:31.466334 (+ 2800us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:31.467244 (+ 910us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:31.467247 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:31.467250 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:31.467390 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:31.467878 (+ 488us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:31.467885 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:31.467891 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:31.468177 (+ 286us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:36:31.468373 (+ 196us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:31.469254 (+ 881us) server_negotiation.cc:299] Negotiation successful
0807 10:36:31.469520 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260807 10:36:31.470566 25220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:31.451231 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:39215 (local address 127.20.171.66:52263)
0807 10:36:31.451972 (+ 741us) negotiation.cc:107] Waiting for socket to connect
0807 10:36:31.452008 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0807 10:36:31.453700 (+ 1692us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:36:31.454348 (+ 648us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:36:31.454355 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:36:31.454842 (+ 487us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:36:31.455386 (+ 544us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:31.455403 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:31.456504 (+ 1101us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:31.456512 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:31.458262 (+ 1750us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:31.458273 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:31.459293 (+ 1020us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:31.459298 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:31.459576 (+ 278us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:31.460290 (+ 714us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:36:31.460329 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:36:31.463280 (+ 2951us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:36:31.466467 (+ 3187us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:36:31.466477 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:36:31.466494 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:36:31.467115 (+ 621us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:36:31.467493 (+ 378us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:36:31.467500 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:36:31.467506 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:36:31.467748 (+ 242us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:36:31.468345 (+ 597us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:36:31.468355 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:36:31.468797 (+ 442us) client_negotiation.cc:769] Sending connection context
0807 10:36:31.469089 (+ 292us) client_negotiation.cc:240] Negotiation successful
0807 10:36:31.469463 (+ 374us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":504,"thread_start_us":276,"threads_started":1}
I20260807 10:36:31.472101 25218 heartbeater.cc:347] Connected to a master server at 127.20.171.126:39215
I20260807 10:36:31.472476 25218 heartbeater.cc:464] Registering TS with master...
I20260807 10:36:31.473196 25218 heartbeater.cc:511] Master 127.20.171.126:39215 requested a full tablet report, sending...
I20260807 10:36:31.474722 24888 ts_manager.cc:194] Registered new tserver with Master: 5d049b11c2cf4c7fa5199416c89caadb (127.20.171.66:34505)
I20260807 10:36:31.475986 24888 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.171.66@KRBTEST.COM'} at 127.20.171.66:52263
WARNING: no policy specified for kudu/127.20.171.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.171.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.171.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.67.keytab.
Entry for principal kudu/127.20.171.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.67.keytab.
I20260807 10:36:31.512071 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786098956060137-21165-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786098956060137-21165-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786098956060137-21165-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786098956060137-21165-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.171.67:0
--local_ip_for_outbound_sockets=127.20.171.67
--webserver_interface=127.20.171.67
--webserver_port=0
--tserver_master_addrs=127.20.171.126:39215
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.67.keytab
--principal=kudu/127.20.171.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.171.84:32831
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786098956060137-21165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786098956060137-21165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786098956060137-21165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:36:31.835214 25223 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:36:31.835528 25223 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:36:31.835717 25223 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:36:31.842633 25223 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:36:31.842788 25223 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:36:31.842986 25223 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.171.67
I20260807 10:36:31.852470 25223 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.171.84:32831
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786098956060137-21165-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786098956060137-21165-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.67.keytab
--principal=kudu/127.20.171.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.171.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786098956060137-21165-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.171.67
--webserver_port=0
--tserver_master_addrs=127.20.171.126:39215
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.171.67
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786098956060137-21165-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:36:31.853825 25223 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:36:31.855086 25223 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:36:31.867832 25228 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:36:31.867906 25229 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:36:31.867933 25231 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:36:31.868918 25223 server_base.cc:1034] running on GCE node
I20260807 10:36:31.869498 25223 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:36:31.870424 25223 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:36:31.871649 25223 hybrid_clock.cc:648] HybridClock initialized: now 1786098991871602 us; error 54 us; skew 500 ppm
I20260807 10:36:31.871989 25223 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:36:31 dist-test-slave-0b58 krb5kdc[24842](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786098991, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:36:31.875229 25223 init.cc:377] Logged in from keytab as kudu/127.20.171.67@KRBTEST.COM (short username kudu)
I20260807 10:36:31.876556 25223 webserver.cc:460] Webserver started at http://127.20.171.67:46325/ using document root <none> and password file <none>
I20260807 10:36:31.877173 25223 fs_manager.cc:359] Metadata directory not provided
I20260807 10:36:31.877285 25223 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:36:31.877528 25223 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:36:31.880301 25223 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786098956060137-21165-0/minicluster-data/ts-2/data/instance:
uuid: "c5375a9f96b448bca2130e3fd78bcf99"
format_stamp: "Formatted at 2026-08-07 10:36:31 on dist-test-slave-0b58"
server_key: "2c1fc4b9196ace871575f50090911105"
server_key_iv: "b9d36dabb47fd6468b29511cc213b89e"
server_key_version: "encryptionkey@0"
I20260807 10:36:31.881064 25223 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786098956060137-21165-0/minicluster-data/ts-2/wal/instance:
uuid: "c5375a9f96b448bca2130e3fd78bcf99"
format_stamp: "Formatted at 2026-08-07 10:36:31 on dist-test-slave-0b58"
server_key: "2c1fc4b9196ace871575f50090911105"
server_key_iv: "b9d36dabb47fd6468b29511cc213b89e"
server_key_version: "encryptionkey@0"
I20260807 10:36:31.886523 25223 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260807 10:36:31.890087 25238 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:36:31.891342 25223 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 10:36:31.891522 25223 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786098956060137-21165-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786098956060137-21165-0/minicluster-data/ts-2/wal
uuid: "c5375a9f96b448bca2130e3fd78bcf99"
format_stamp: "Formatted at 2026-08-07 10:36:31 on dist-test-slave-0b58"
server_key: "2c1fc4b9196ace871575f50090911105"
server_key_iv: "b9d36dabb47fd6468b29511cc213b89e"
server_key_version: "encryptionkey@0"
I20260807 10:36:31.891717 25223 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786098956060137-21165-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786098956060137-21165-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786098956060137-21165-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:36:31.912657 25223 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:36:31.916929 25223 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:36:31.917217 25223 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:36:31.918222 25223 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:36:31.919560 25223 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:36:31.919636 25223 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:36:31.919807 25223 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:36:31.919857 25223 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:36:31.952390 25223 rpc_server.cc:307] RPC server started. Bound to: 127.20.171.67:43013
I20260807 10:36:31.952419 25352 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.171.67:43013 every 8 connection(s)
I20260807 10:36:31.953655 25223 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786098956060137-21165-0/minicluster-data/ts-2/data/info.pb
I20260807 10:36:31.954355 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 25223
I20260807 10:36:31.954561 21165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786098956060137-21165-0/minicluster-data/ts-2/wal/instance
I20260807 10:36:31.955091 21165 external_mini_cluster.cc:1428] Setting key 0635ee933340e4ad3f5fdf2ababb3b2f
Aug 07 10:36:31 dist-test-slave-0b58 krb5kdc[24842](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786098991, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.67@KRBTEST.COM for kudu/127.20.171.126@KRBTEST.COM
I20260807 10:36:31.973060 25084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:31.956357 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.67:40211 (local address 127.20.171.126:39215)
0807 10:36:31.956550 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:31.956556 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:31.957835 (+ 1279us) server_negotiation.cc:407] Connection header received
0807 10:36:31.959597 (+ 1762us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:31.959601 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:31.959690 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:31.959834 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:36:31.961342 (+ 1508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:31.962091 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:31.963538 (+ 1447us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:31.963938 (+ 400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:31.964069 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:31.967301 (+ 3232us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:36:31.967306 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:36:31.967309 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:36:31.967350 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:36:31.970344 (+ 2994us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:31.971064 (+ 720us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:31.971068 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:31.971070 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:31.971199 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:31.971562 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:31.971565 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:31.971567 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:31.971849 (+ 282us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:36:31.971961 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:31.972644 (+ 683us) server_negotiation.cc:299] Negotiation successful
0807 10:36:31.972816 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260807 10:36:31.974042 25355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:31.956961 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:39215 (local address 127.20.171.67:40211)
0807 10:36:31.957697 (+ 736us) negotiation.cc:107] Waiting for socket to connect
0807 10:36:31.957737 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0807 10:36:31.959368 (+ 1631us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:36:31.960088 (+ 720us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:36:31.960095 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:36:31.960644 (+ 549us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:36:31.961187 (+ 543us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:31.961206 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:31.962254 (+ 1048us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:31.962259 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:31.963405 (+ 1146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:31.963416 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:31.964160 (+ 744us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:31.964166 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:31.964426 (+ 260us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:31.964991 (+ 565us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:36:31.965010 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:36:31.967075 (+ 2065us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:36:31.970471 (+ 3396us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:36:31.970477 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:36:31.970487 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:36:31.970930 (+ 443us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:36:31.971297 (+ 367us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:36:31.971301 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:36:31.971303 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:36:31.971466 (+ 163us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:36:31.971954 (+ 488us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:36:31.971959 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:36:31.972238 (+ 279us) client_negotiation.cc:769] Sending connection context
0807 10:36:31.972531 (+ 293us) client_negotiation.cc:240] Negotiation successful
0807 10:36:31.972895 (+ 364us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":518,"thread_start_us":323,"threads_started":1}
I20260807 10:36:31.975466 25353 heartbeater.cc:347] Connected to a master server at 127.20.171.126:39215
I20260807 10:36:31.975726 25353 heartbeater.cc:464] Registering TS with master...
I20260807 10:36:31.976150 25082 heartbeater.cc:503] Master 127.20.171.126:39215 was elected leader, sending a full tablet report...
I20260807 10:36:31.976475 25353 heartbeater.cc:511] Master 127.20.171.126:39215 requested a full tablet report, sending...
I20260807 10:36:31.978019 24888 ts_manager.cc:194] Registered new tserver with Master: c5375a9f96b448bca2130e3fd78bcf99 (127.20.171.67:43013)
I20260807 10:36:31.978797 24888 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.171.67@KRBTEST.COM'} at 127.20.171.67:40211
I20260807 10:36:31.983063 21165 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 07 10:36:32 dist-test-slave-0b58 krb5kdc[24842](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786098992, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 07 10:36:32 dist-test-slave-0b58 krb5kdc[24842](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786098992, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.171.65@KRBTEST.COM
I20260807 10:36:32.038549 25360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:32.023679 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42868 (local address 127.20.171.65:34759)
0807 10:36:32.024320 (+ 641us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:32.024328 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:32.024361 (+ 33us) server_negotiation.cc:407] Connection header received
0807 10:36:32.024425 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:32.024431 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:32.024644 (+ 213us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:32.024768 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:36:32.026125 (+ 1357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:32.027143 (+ 1018us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:32.028560 (+ 1417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:32.029156 (+ 596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:32.029255 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:32.033263 (+ 4008us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:36:32.033275 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:36:32.033291 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:36:32.033326 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:36:32.035998 (+ 2672us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:32.036641 (+ 643us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:32.036648 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:32.036651 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:32.036778 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:32.037159 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:32.037162 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:32.037164 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:32.037510 (+ 346us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:36:32.037749 (+ 239us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:32.037990 (+ 241us) server_negotiation.cc:299] Negotiation successful
0807 10:36:32.038229 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":433,"thread_start_us":259,"threads_started":1}
Aug 07 10:36:32 dist-test-slave-0b58 krb5kdc[24842](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786098992, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.171.126@KRBTEST.COM
I20260807 10:36:32.056491 25084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:32.043057 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47956 (local address 127.20.171.126:39215)
0807 10:36:32.043320 (+ 263us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:32.043327 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:32.043432 (+ 105us) server_negotiation.cc:407] Connection header received
0807 10:36:32.043627 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:32.043631 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:32.043697 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:32.043801 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:36:32.045159 (+ 1358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:32.045870 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:32.047124 (+ 1254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:32.047573 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:32.047712 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:32.051538 (+ 3826us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:36:32.051543 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:36:32.051546 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:36:32.051577 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:36:32.054244 (+ 2667us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:32.054795 (+ 551us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:32.054798 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:32.054800 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:32.054931 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:32.055234 (+ 303us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:32.055237 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:32.055239 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:32.055559 (+ 320us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:36:32.055764 (+ 205us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:32.056022 (+ 258us) server_negotiation.cc:299] Negotiation successful
0807 10:36:32.056195 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
W20260807 10:36:32.057091 24888 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47956
I20260807 10:36:32.058099 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 24950
I20260807 10:36:32.070228 25360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:32.059078 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42876 (local address 127.20.171.65:34759)
0807 10:36:32.059296 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:32.059301 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:32.059387 (+ 86us) server_negotiation.cc:407] Connection header received
0807 10:36:32.059500 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:32.059503 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:32.059588 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:32.059660 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:36:32.060811 (+ 1151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:32.061469 (+ 658us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:32.062689 (+ 1220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:32.063100 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:32.063234 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:32.065586 (+ 2352us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:36:32.065591 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:36:32.065594 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:36:32.065625 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:36:32.068086 (+ 2461us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:32.068694 (+ 608us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:32.068697 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:32.068700 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:32.068824 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:32.069137 (+ 313us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:32.069140 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:32.069142 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:32.069386 (+ 244us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:36:32.069561 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:32.069823 (+ 262us) server_negotiation.cc:299] Negotiation successful
0807 10:36:32.069985 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260807 10:36:32.070945 25077 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:36:32.151921 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 24950
I20260807 10:36:32.171468 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 25088
Aug 07 10:36:32 dist-test-slave-0b58 krb5kdc[24842](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786098992, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.171.66@KRBTEST.COM
I20260807 10:36:32.187027 25365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:32.172424 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53090 (local address 127.20.171.66:34505)
0807 10:36:32.172926 (+ 502us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:32.172934 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:32.172958 (+ 24us) server_negotiation.cc:407] Connection header received
0807 10:36:32.173022 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:32.173028 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:32.173228 (+ 200us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:32.173349 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:36:32.174527 (+ 1178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:32.175582 (+ 1055us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:32.176865 (+ 1283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:32.177366 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:32.177453 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:32.181315 (+ 3862us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:36:32.181339 (+ 24us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:36:32.181353 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:36:32.181388 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:36:32.184520 (+ 3132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:32.185083 (+ 563us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:32.185089 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:32.185091 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:32.185211 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:32.185526 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:32.185529 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:32.185531 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:32.185857 (+ 326us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:36:32.186083 (+ 226us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:32.186374 (+ 291us) server_negotiation.cc:299] Negotiation successful
0807 10:36:32.186631 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":349,"thread_start_us":248,"threads_started":1}
I20260807 10:36:32.188531 25213 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:36:32.272207 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 25088
I20260807 10:36:32.292182 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 25223
Aug 07 10:36:32 dist-test-slave-0b58 krb5kdc[24842](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786098992, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.171.67@KRBTEST.COM
I20260807 10:36:32.307708 25367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:32.293155 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55256 (local address 127.20.171.67:43013)
0807 10:36:32.293767 (+ 612us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:32.293774 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:32.293802 (+ 28us) server_negotiation.cc:407] Connection header received
0807 10:36:32.293865 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:32.293871 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:32.294072 (+ 201us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:32.294195 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:36:32.295494 (+ 1299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:32.296633 (+ 1139us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:32.297816 (+ 1183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:32.298345 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:32.298477 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:32.302506 (+ 4029us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:36:32.302518 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:36:32.302532 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:36:32.302566 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:36:32.305436 (+ 2870us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:32.306003 (+ 567us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:32.306009 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:32.306011 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:32.306127 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:32.306452 (+ 325us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:32.306455 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:32.306457 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:32.306776 (+ 319us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:36:32.306998 (+ 222us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:32.307195 (+ 197us) server_negotiation.cc:299] Negotiation successful
0807 10:36:32.307408 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":472,"thread_start_us":319,"threads_started":1}
I20260807 10:36:32.309026 25348 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:36:32.391078 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 25223
I20260807 10:36:32.410384 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 24856
I20260807 10:36:32.411603 24919 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:36:32.518117 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 24856
2026-08-07T10:36:32Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (3956 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786098956060137-21165-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 10:36:32 dist-test-slave-0b58 krb5kdc[25372](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 10:36:32 dist-test-slave-0b58 krb5kdc[25372](info): set up 2 sockets
Aug 07 10:36:32 dist-test-slave-0b58 krb5kdc[25372](info): commencing operation
krb5kdc: starting...
W20260807 10:36:33.594489 21165 mini_kdc.cc:121] Time spent starting KDC: real 1.029s user 0.000s sys 0.029s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786098956060137-21165-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786098956060137-21165-0/krb5kdc/test-user.keytab.
Aug 07 10:36:33 dist-test-slave-0b58 krb5kdc[25372](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786098993, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T10:36:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T10:36:33Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.171.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.171.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.171.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.126.keytab.
Entry for principal kudu/127.20.171.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.126.keytab.
I20260807 10:36:33.823179 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786098956060137-21165-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786098956060137-21165-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786098956060137-21165-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.171.126:40315
--webserver_interface=127.20.171.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.126.keytab
--principal=kudu/127.20.171.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.171.84:46189
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.171.126:40315
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786098956060137-21165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786098956060137-21165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786098956060137-21165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:36:34.148913 25385 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:36:34.149245 25385 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:36:34.149410 25385 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:36:34.156529 25385 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 10:36:34.156668 25385 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:36:34.156772 25385 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:36:34.156874 25385 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 10:36:34.156955 25385 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 10:36:34.166538 25385 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.171.84:46189
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786098956060137-21165-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786098956060137-21165-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.171.126:40315
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.126.keytab
--principal=kudu/127.20.171.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.171.126:40315
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.171.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786098956060137-21165-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:36:34.167834 25385 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:36:34.169230 25385 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:36:34.180781 25394 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:36:34.180840 25391 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:36:34.180863 25392 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:36:34.181984 25385 server_base.cc:1034] running on GCE node
I20260807 10:36:34.182828 25385 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:36:34.184186 25385 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:36:34.185457 25385 hybrid_clock.cc:648] HybridClock initialized: now 1786098994185401 us; error 37 us; skew 500 ppm
I20260807 10:36:34.185787 25385 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:36:34 dist-test-slave-0b58 krb5kdc[25372](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786098994, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:36:34.188858 25385 init.cc:377] Logged in from keytab as kudu/127.20.171.126@KRBTEST.COM (short username kudu)
I20260807 10:36:34.189863 25385 fs_manager.cc:359] Metadata directory not provided
I20260807 10:36:34.189946 25385 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:36:34.190197 25385 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:36:34.193230 25385 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786098956060137-21165-0/minicluster-data/master-0/data/instance:
uuid: "866074e9f97a4a13843a9abc1b06886d"
format_stamp: "Formatted at 2026-08-07 10:36:34 on dist-test-slave-0b58"
server_key: "f216bdff23821f6737d241920a6b9737"
server_key_iv: "75d3d1cbefbfa5551714cf6ce19da9d1"
server_key_version: "encryptionkey@0"
I20260807 10:36:34.193904 25385 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786098956060137-21165-0/minicluster-data/master-0/wal/instance:
uuid: "866074e9f97a4a13843a9abc1b06886d"
format_stamp: "Formatted at 2026-08-07 10:36:34 on dist-test-slave-0b58"
server_key: "f216bdff23821f6737d241920a6b9737"
server_key_iv: "75d3d1cbefbfa5551714cf6ce19da9d1"
server_key_version: "encryptionkey@0"
I20260807 10:36:34.198510 25385 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260807 10:36:34.201756 25400 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:36:34.203004 25385 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260807 10:36:34.203153 25385 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786098956060137-21165-0/minicluster-data/master-0/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786098956060137-21165-0/minicluster-data/master-0/wal
uuid: "866074e9f97a4a13843a9abc1b06886d"
format_stamp: "Formatted at 2026-08-07 10:36:34 on dist-test-slave-0b58"
server_key: "f216bdff23821f6737d241920a6b9737"
server_key_iv: "75d3d1cbefbfa5551714cf6ce19da9d1"
server_key_version: "encryptionkey@0"
I20260807 10:36:34.203393 25385 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786098956060137-21165-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786098956060137-21165-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786098956060137-21165-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:36:34.234349 25385 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:36:34.238376 25385 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:36:34.238663 25385 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:36:34.257294 25385 rpc_server.cc:307] RPC server started. Bound to: 127.20.171.126:40315
I20260807 10:36:34.257313 25452 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.171.126:40315 every 8 connection(s)
I20260807 10:36:34.258155 25385 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
I20260807 10:36:34.261651 25453 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:36:34.264784 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 25385
I20260807 10:36:34.265019 21165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786098956060137-21165-0/minicluster-data/master-0/wal/instance
I20260807 10:36:34.265813 21165 external_mini_cluster.cc:1428] Setting key d83c97d509a8354d1df86bb82041bd1d
I20260807 10:36:34.275175 25453 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 866074e9f97a4a13843a9abc1b06886d: Bootstrap starting.
I20260807 10:36:34.278631 25453 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 866074e9f97a4a13843a9abc1b06886d: Neither blocks nor log segments found. Creating new log.
I20260807 10:36:34.279610 25453 log.cc:824] T 00000000000000000000000000000000 P 866074e9f97a4a13843a9abc1b06886d: Log is configured to *not* fsync() on all Append() calls
Aug 07 10:36:34 dist-test-slave-0b58 krb5kdc[25372](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786098993, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.171.126@KRBTEST.COM
I20260807 10:36:34.282497 25453 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 866074e9f97a4a13843a9abc1b06886d: No bootstrap required, opened a new log
I20260807 10:36:34.290153 25456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:34.267947 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49660 (local address 127.20.171.126:40315)
0807 10:36:34.268758 (+ 811us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:34.268773 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:34.268821 (+ 48us) server_negotiation.cc:407] Connection header received
0807 10:36:34.271031 (+ 2210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:34.271058 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:34.271533 (+ 475us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:34.271964 (+ 431us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:36:34.273432 (+ 1468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:34.275285 (+ 1853us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:34.276537 (+ 1252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:34.277589 (+ 1052us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:34.277774 (+ 185us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:34.281675 (+ 3901us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:36:34.281685 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:36:34.281700 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:36:34.281747 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:36:34.285751 (+ 4004us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:34.286453 (+ 702us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:34.286462 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:34.286470 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:34.286665 (+ 195us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:34.287046 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:34.287052 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:34.287055 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:34.287782 (+ 727us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:36:34.288080 (+ 298us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:34.288431 (+ 351us) server_negotiation.cc:299] Negotiation successful
0807 10:36:34.288851 (+ 420us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":568,"thread_start_us":373,"threads_started":1}
I20260807 10:36:34.293176 25453 raft_consensus.cc:348] T 00000000000000000000000000000000 P 866074e9f97a4a13843a9abc1b06886d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "866074e9f97a4a13843a9abc1b06886d" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 40315 } }
I20260807 10:36:34.293478 25453 raft_consensus.cc:374] T 00000000000000000000000000000000 P 866074e9f97a4a13843a9abc1b06886d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:36:34.293542 25453 raft_consensus.cc:729] T 00000000000000000000000000000000 P 866074e9f97a4a13843a9abc1b06886d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 866074e9f97a4a13843a9abc1b06886d, State: Initialized, Role: FOLLOWER
I20260807 10:36:34.293999 25453 consensus_queue.cc:260] T 00000000000000000000000000000000 P 866074e9f97a4a13843a9abc1b06886d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "866074e9f97a4a13843a9abc1b06886d" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 40315 } }
I20260807 10:36:34.294185 25453 raft_consensus.cc:388] T 00000000000000000000000000000000 P 866074e9f97a4a13843a9abc1b06886d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 10:36:34.294291 25453 raft_consensus.cc:482] T 00000000000000000000000000000000 P 866074e9f97a4a13843a9abc1b06886d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 10:36:34.294399 25453 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 866074e9f97a4a13843a9abc1b06886d [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:36:34.296532 25453 raft_consensus.cc:504] T 00000000000000000000000000000000 P 866074e9f97a4a13843a9abc1b06886d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "866074e9f97a4a13843a9abc1b06886d" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 40315 } }
I20260807 10:36:34.297036 25453 leader_election.cc:302] T 00000000000000000000000000000000 P 866074e9f97a4a13843a9abc1b06886d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 866074e9f97a4a13843a9abc1b06886d; no voters:
I20260807 10:36:34.297727 25453 leader_election.cc:288] T 00000000000000000000000000000000 P 866074e9f97a4a13843a9abc1b06886d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 10:36:34.297864 25458 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 866074e9f97a4a13843a9abc1b06886d [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:36:34.298532 25458 raft_consensus.cc:686] T 00000000000000000000000000000000 P 866074e9f97a4a13843a9abc1b06886d [term 1 LEADER]: Becoming Leader. State: Replica: 866074e9f97a4a13843a9abc1b06886d, State: Running, Role: LEADER
I20260807 10:36:34.299041 25458 consensus_queue.cc:237] T 00000000000000000000000000000000 P 866074e9f97a4a13843a9abc1b06886d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "866074e9f97a4a13843a9abc1b06886d" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 40315 } }
I20260807 10:36:34.299731 25453 sys_catalog.cc:564] T 00000000000000000000000000000000 P 866074e9f97a4a13843a9abc1b06886d [sys.catalog]: configured and running, proceeding with master startup.
I20260807 10:36:34.301960 25459 sys_catalog.cc:455] T 00000000000000000000000000000000 P 866074e9f97a4a13843a9abc1b06886d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "866074e9f97a4a13843a9abc1b06886d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "866074e9f97a4a13843a9abc1b06886d" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 40315 } } }
I20260807 10:36:34.302181 25460 sys_catalog.cc:455] T 00000000000000000000000000000000 P 866074e9f97a4a13843a9abc1b06886d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 866074e9f97a4a13843a9abc1b06886d. Latest consensus state: current_term: 1 leader_uuid: "866074e9f97a4a13843a9abc1b06886d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "866074e9f97a4a13843a9abc1b06886d" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 40315 } } }
I20260807 10:36:34.302564 25460 sys_catalog.cc:458] T 00000000000000000000000000000000 P 866074e9f97a4a13843a9abc1b06886d [sys.catalog]: This master's current role is: LEADER
I20260807 10:36:34.302572 25459 sys_catalog.cc:458] T 00000000000000000000000000000000 P 866074e9f97a4a13843a9abc1b06886d [sys.catalog]: This master's current role is: LEADER
I20260807 10:36:34.303897 25463 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 10:36:34.309528 25463 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 10:36:34.317596 25463 catalog_manager.cc:1347] Generated new cluster ID: bfb7dda754b44313a4175879b5c316a5
I20260807 10:36:34.317713 25463 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 10:36:34.336170 25463 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 10:36:34.337975 25463 catalog_manager.cc:1504] Loading token signing keys...
I20260807 10:36:34.347572 25463 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 866074e9f97a4a13843a9abc1b06886d: Generated new TSK 0
I20260807 10:36:34.348430 25463 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.171.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.171.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.171.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.65.keytab.
Entry for principal kudu/127.20.171.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.65.keytab.
I20260807 10:36:34.408524 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786098956060137-21165-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786098956060137-21165-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786098956060137-21165-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786098956060137-21165-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.171.65:0
--local_ip_for_outbound_sockets=127.20.171.65
--webserver_interface=127.20.171.65
--webserver_port=0
--tserver_master_addrs=127.20.171.126:40315
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.65.keytab
--principal=kudu/127.20.171.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.171.84:46189
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786098956060137-21165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786098956060137-21165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786098956060137-21165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:36:34.734856 25479 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:36:34.735141 25479 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:36:34.735307 25479 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:36:34.742452 25479 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:36:34.742578 25479 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:36:34.742772 25479 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.171.65
I20260807 10:36:34.752002 25479 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.171.84:46189
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786098956060137-21165-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786098956060137-21165-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.65.keytab
--principal=kudu/127.20.171.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.171.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786098956060137-21165-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.171.65
--webserver_port=0
--tserver_master_addrs=127.20.171.126:40315
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.171.65
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786098956060137-21165-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:36:34.753338 25479 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:36:34.754642 25479 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:36:34.766877 25484 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:36:34.766964 25487 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:36:34.766986 25485 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:36:34.768355 25479 server_base.cc:1034] running on GCE node
I20260807 10:36:34.768914 25479 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:36:34.769771 25479 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:36:34.770992 25479 hybrid_clock.cc:648] HybridClock initialized: now 1786098994770952 us; error 48 us; skew 500 ppm
I20260807 10:36:34.771369 25479 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:36:34 dist-test-slave-0b58 krb5kdc[25372](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786098994, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:36:34.778997 25479 init.cc:377] Logged in from keytab as kudu/127.20.171.65@KRBTEST.COM (short username kudu)
I20260807 10:36:34.780179 25479 fs_manager.cc:359] Metadata directory not provided
I20260807 10:36:34.780308 25479 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:36:34.780591 25479 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:36:34.783553 25479 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786098956060137-21165-0/minicluster-data/ts-0/data/instance:
uuid: "d4a71f9c7b6c48e59c3eed29e77e0c06"
format_stamp: "Formatted at 2026-08-07 10:36:34 on dist-test-slave-0b58"
server_key: "96c4def79a49c045dba062daced61788"
server_key_iv: "13b6c16516b19f0eedf070d42635ef38"
server_key_version: "encryptionkey@0"
I20260807 10:36:34.784458 25479 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786098956060137-21165-0/minicluster-data/ts-0/wal/instance:
uuid: "d4a71f9c7b6c48e59c3eed29e77e0c06"
format_stamp: "Formatted at 2026-08-07 10:36:34 on dist-test-slave-0b58"
server_key: "96c4def79a49c045dba062daced61788"
server_key_iv: "13b6c16516b19f0eedf070d42635ef38"
server_key_version: "encryptionkey@0"
I20260807 10:36:34.789608 25479 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260807 10:36:34.792970 25493 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:36:34.794183 25479 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.003s
I20260807 10:36:34.794332 25479 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786098956060137-21165-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786098956060137-21165-0/minicluster-data/ts-0/wal
uuid: "d4a71f9c7b6c48e59c3eed29e77e0c06"
format_stamp: "Formatted at 2026-08-07 10:36:34 on dist-test-slave-0b58"
server_key: "96c4def79a49c045dba062daced61788"
server_key_iv: "13b6c16516b19f0eedf070d42635ef38"
server_key_version: "encryptionkey@0"
I20260807 10:36:34.794502 25479 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786098956060137-21165-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786098956060137-21165-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786098956060137-21165-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:36:34.810889 25479 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:36:34.814900 25479 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:36:34.815116 25479 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:36:34.815902 25479 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:36:34.817154 25479 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:36:34.817235 25479 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:36:34.817306 25479 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:36:34.817361 25479 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:36:34.849937 25479 rpc_server.cc:307] RPC server started. Bound to: 127.20.171.65:39113
I20260807 10:36:34.849970 25607 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.171.65:39113 every 8 connection(s)
I20260807 10:36:34.850762 25479 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786098956060137-21165-0/minicluster-data/ts-0/data/info.pb
I20260807 10:36:34.860724 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 25479
I20260807 10:36:34.860936 21165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786098956060137-21165-0/minicluster-data/ts-0/wal/instance
I20260807 10:36:34.861660 21165 external_mini_cluster.cc:1428] Setting key bceef4ddb063ea6ff18a48f0e4fc3da2
Aug 07 10:36:34 dist-test-slave-0b58 krb5kdc[25372](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786098994, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.65@KRBTEST.COM for kudu/127.20.171.126@KRBTEST.COM
I20260807 10:36:34.871286 25610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:34.853166 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.65:43749 (local address 127.20.171.126:40315)
0807 10:36:34.853588 (+ 422us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:34.853592 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:34.854512 (+ 920us) server_negotiation.cc:407] Connection header received
0807 10:36:34.856189 (+ 1677us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:34.856195 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:34.856307 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:34.856427 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:36:34.857783 (+ 1356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:34.858458 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:34.859872 (+ 1414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:34.860241 (+ 369us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:34.860419 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:34.864382 (+ 3963us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:36:34.864388 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:36:34.864393 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:36:34.864431 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:36:34.867939 (+ 3508us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:34.868733 (+ 794us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:34.868741 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:34.868748 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:34.868936 (+ 188us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:34.869373 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:34.869380 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:34.869385 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:34.869762 (+ 377us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:36:34.869906 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:34.870573 (+ 667us) server_negotiation.cc:299] Negotiation successful
0807 10:36:34.870822 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":302,"thread_start_us":205,"threads_started":1}
I20260807 10:36:34.871961 25611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:34.853692 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:40315 (local address 127.20.171.65:43749)
0807 10:36:34.854365 (+ 673us) negotiation.cc:107] Waiting for socket to connect
0807 10:36:34.854405 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0807 10:36:34.855945 (+ 1540us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:36:34.856651 (+ 706us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:36:34.856658 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:36:34.857122 (+ 464us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:36:34.857620 (+ 498us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:34.857635 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:34.858618 (+ 983us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:34.858622 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:34.859724 (+ 1102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:34.859736 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:34.860527 (+ 791us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:34.860532 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:34.860715 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:34.861426 (+ 711us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:36:34.861451 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:36:34.864025 (+ 2574us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:36:34.868084 (+ 4059us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:36:34.868090 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:36:34.868101 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:36:34.868618 (+ 517us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:36:34.869067 (+ 449us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:36:34.869070 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:36:34.869072 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:36:34.869268 (+ 196us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:36:34.869887 (+ 619us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:36:34.869892 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:36:34.870203 (+ 311us) client_negotiation.cc:769] Sending connection context
0807 10:36:34.870425 (+ 222us) client_negotiation.cc:240] Negotiation successful
0807 10:36:34.870784 (+ 359us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":473,"thread_start_us":289,"threads_started":1}
I20260807 10:36:34.873601 25608 heartbeater.cc:347] Connected to a master server at 127.20.171.126:40315
I20260807 10:36:34.873893 25608 heartbeater.cc:464] Registering TS with master...
I20260807 10:36:34.874631 25608 heartbeater.cc:511] Master 127.20.171.126:40315 requested a full tablet report, sending...
I20260807 10:36:34.876919 25417 ts_manager.cc:194] Registered new tserver with Master: d4a71f9c7b6c48e59c3eed29e77e0c06 (127.20.171.65:39113)
I20260807 10:36:34.879067 25417 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.171.65@KRBTEST.COM'} at 127.20.171.65:43749
WARNING: no policy specified for kudu/127.20.171.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.171.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.171.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.66.keytab.
Entry for principal kudu/127.20.171.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.66.keytab.
I20260807 10:36:34.917248 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786098956060137-21165-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786098956060137-21165-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786098956060137-21165-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786098956060137-21165-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.171.66:0
--local_ip_for_outbound_sockets=127.20.171.66
--webserver_interface=127.20.171.66
--webserver_port=0
--tserver_master_addrs=127.20.171.126:40315
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.66.keytab
--principal=kudu/127.20.171.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.171.84:46189
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786098956060137-21165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786098956060137-21165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786098956060137-21165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:36:35.237083 25614 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:36:35.237344 25614 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:36:35.237439 25614 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:36:35.244344 25614 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:36:35.244441 25614 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:36:35.244546 25614 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.171.66
I20260807 10:36:35.253247 25614 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.171.84:46189
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786098956060137-21165-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786098956060137-21165-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.66.keytab
--principal=kudu/127.20.171.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.171.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786098956060137-21165-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.171.66
--webserver_port=0
--tserver_master_addrs=127.20.171.126:40315
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.171.66
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786098956060137-21165-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:36:35.254309 25614 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:36:35.255599 25614 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:36:35.268754 25622 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:36:35.268777 25620 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:36:35.269388 25619 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:36:35.269578 25614 server_base.cc:1034] running on GCE node
I20260807 10:36:35.270217 25614 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:36:35.271168 25614 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:36:35.272382 25614 hybrid_clock.cc:648] HybridClock initialized: now 1786098995272328 us; error 39 us; skew 500 ppm
I20260807 10:36:35.272768 25614 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:36:35 dist-test-slave-0b58 krb5kdc[25372](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786098995, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:36:35.275846 25614 init.cc:377] Logged in from keytab as kudu/127.20.171.66@KRBTEST.COM (short username kudu)
I20260807 10:36:35.277084 25614 fs_manager.cc:359] Metadata directory not provided
I20260807 10:36:35.277220 25614 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:36:35.277540 25614 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:36:35.280411 25614 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786098956060137-21165-0/minicluster-data/ts-1/data/instance:
uuid: "53981e25a74a4a30b8e62a0476c02c95"
format_stamp: "Formatted at 2026-08-07 10:36:35 on dist-test-slave-0b58"
server_key: "3404e5b010e2b64d2d5da944356f45b7"
server_key_iv: "0d2cb02d00838f86c2b7896beb74e746"
server_key_version: "encryptionkey@0"
I20260807 10:36:35.281250 25614 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786098956060137-21165-0/minicluster-data/ts-1/wal/instance:
uuid: "53981e25a74a4a30b8e62a0476c02c95"
format_stamp: "Formatted at 2026-08-07 10:36:35 on dist-test-slave-0b58"
server_key: "3404e5b010e2b64d2d5da944356f45b7"
server_key_iv: "0d2cb02d00838f86c2b7896beb74e746"
server_key_version: "encryptionkey@0"
I20260807 10:36:35.286557 25614 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260807 10:36:35.289992 25628 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:36:35.291250 25614 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260807 10:36:35.291422 25614 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786098956060137-21165-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786098956060137-21165-0/minicluster-data/ts-1/wal
uuid: "53981e25a74a4a30b8e62a0476c02c95"
format_stamp: "Formatted at 2026-08-07 10:36:35 on dist-test-slave-0b58"
server_key: "3404e5b010e2b64d2d5da944356f45b7"
server_key_iv: "0d2cb02d00838f86c2b7896beb74e746"
server_key_version: "encryptionkey@0"
I20260807 10:36:35.291646 25614 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786098956060137-21165-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786098956060137-21165-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786098956060137-21165-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:36:35.303902 25614 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:36:35.308336 25614 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:36:35.308589 25614 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:36:35.309449 25614 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:36:35.310715 25614 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:36:35.310842 25614 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:36:35.310952 25614 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:36:35.311033 25614 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:36:35.344030 25614 rpc_server.cc:307] RPC server started. Bound to: 127.20.171.66:42911
I20260807 10:36:35.344111 25744 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.171.66:42911 every 8 connection(s)
I20260807 10:36:35.344895 25614 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786098956060137-21165-0/minicluster-data/ts-1/data/info.pb
I20260807 10:36:35.347891 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 25614
I20260807 10:36:35.348093 21165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786098956060137-21165-0/minicluster-data/ts-1/wal/instance
I20260807 10:36:35.348618 21165 external_mini_cluster.cc:1428] Setting key 1e2ecf9a3ac89c670777836e1f456f9d
Aug 07 10:36:35 dist-test-slave-0b58 krb5kdc[25372](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786098995, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.66@KRBTEST.COM for kudu/127.20.171.126@KRBTEST.COM
I20260807 10:36:35.364221 25610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:35.347256 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.66:36577 (local address 127.20.171.126:40315)
0807 10:36:35.347450 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:35.347454 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:35.348770 (+ 1316us) server_negotiation.cc:407] Connection header received
0807 10:36:35.350888 (+ 2118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:35.350893 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:35.351003 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:35.351121 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:36:35.352705 (+ 1584us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:35.353449 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:35.354874 (+ 1425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:35.355302 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:35.355427 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:35.358575 (+ 3148us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:36:35.358580 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:36:35.358583 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:36:35.358611 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:36:35.361128 (+ 2517us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:35.361863 (+ 735us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:35.361882 (+ 19us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:35.361886 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:35.362051 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:35.362593 (+ 542us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:35.362597 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:35.362599 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:35.362864 (+ 265us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:36:35.362977 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:35.363799 (+ 822us) server_negotiation.cc:299] Negotiation successful
0807 10:36:35.363968 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260807 10:36:35.365687 25747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:35.347752 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:40315 (local address 127.20.171.66:36577)
0807 10:36:35.348596 (+ 844us) negotiation.cc:107] Waiting for socket to connect
0807 10:36:35.348639 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0807 10:36:35.350628 (+ 1989us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:36:35.351348 (+ 720us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:36:35.351356 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:36:35.351906 (+ 550us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:36:35.352525 (+ 619us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:35.352544 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:35.353601 (+ 1057us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:35.353605 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:35.354727 (+ 1122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:35.354738 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:35.355524 (+ 786us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:35.355531 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:35.355728 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:35.356378 (+ 650us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:36:35.356403 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:36:35.358349 (+ 1946us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:36:35.361281 (+ 2932us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:36:35.361288 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:36:35.361300 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:36:35.361717 (+ 417us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:36:35.362211 (+ 494us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:36:35.362219 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:36:35.362226 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:36:35.362464 (+ 238us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:36:35.362993 (+ 529us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:36:35.363003 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:36:35.363435 (+ 432us) client_negotiation.cc:769] Sending connection context
0807 10:36:35.363717 (+ 282us) client_negotiation.cc:240] Negotiation successful
0807 10:36:35.364282 (+ 565us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":582,"thread_start_us":381,"threads_started":1}
I20260807 10:36:35.367137 25745 heartbeater.cc:347] Connected to a master server at 127.20.171.126:40315
I20260807 10:36:35.367446 25745 heartbeater.cc:464] Registering TS with master...
I20260807 10:36:35.368319 25745 heartbeater.cc:511] Master 127.20.171.126:40315 requested a full tablet report, sending...
I20260807 10:36:35.369875 25417 ts_manager.cc:194] Registered new tserver with Master: 53981e25a74a4a30b8e62a0476c02c95 (127.20.171.66:42911)
I20260807 10:36:35.370646 25417 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.171.66@KRBTEST.COM'} at 127.20.171.66:36577
WARNING: no policy specified for kudu/127.20.171.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.171.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.171.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.67.keytab.
Entry for principal kudu/127.20.171.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.67.keytab.
I20260807 10:36:35.400695 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786098956060137-21165-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786098956060137-21165-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786098956060137-21165-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786098956060137-21165-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.171.67:0
--local_ip_for_outbound_sockets=127.20.171.67
--webserver_interface=127.20.171.67
--webserver_port=0
--tserver_master_addrs=127.20.171.126:40315
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.67.keytab
--principal=kudu/127.20.171.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.171.84:46189
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786098956060137-21165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786098956060137-21165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786098956060137-21165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:36:35.711491 25750 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:36:35.711769 25750 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:36:35.711954 25750 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:36:35.718843 25750 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:36:35.718988 25750 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:36:35.719170 25750 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.171.67
I20260807 10:36:35.728225 25750 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.171.84:46189
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786098956060137-21165-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786098956060137-21165-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.67.keytab
--principal=kudu/127.20.171.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.171.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786098956060137-21165-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.171.67
--webserver_port=0
--tserver_master_addrs=127.20.171.126:40315
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.171.67
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786098956060137-21165-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:36:35.729440 25750 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:36:35.730639 25750 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:36:35.742815 25755 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:36:35.742774 25756 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:36:35.742847 25758 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:36:35.743808 25750 server_base.cc:1034] running on GCE node
I20260807 10:36:35.744445 25750 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:36:35.745306 25750 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:36:35.746521 25750 hybrid_clock.cc:648] HybridClock initialized: now 1786098995746483 us; error 45 us; skew 500 ppm
I20260807 10:36:35.746840 25750 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:36:35 dist-test-slave-0b58 krb5kdc[25372](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786098995, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:36:35.749926 25750 init.cc:377] Logged in from keytab as kudu/127.20.171.67@KRBTEST.COM (short username kudu)
I20260807 10:36:35.751071 25750 fs_manager.cc:359] Metadata directory not provided
I20260807 10:36:35.751230 25750 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:36:35.751533 25750 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:36:35.754340 25750 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786098956060137-21165-0/minicluster-data/ts-2/data/instance:
uuid: "61a9bf1cb65040dd9f95f5496821ba00"
format_stamp: "Formatted at 2026-08-07 10:36:35 on dist-test-slave-0b58"
server_key: "2683949afe6fb75a956d05d5e6bb0891"
server_key_iv: "006c1abe8d7b4e4d9e8c51284b7ce4ef"
server_key_version: "encryptionkey@0"
I20260807 10:36:35.755088 25750 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786098956060137-21165-0/minicluster-data/ts-2/wal/instance:
uuid: "61a9bf1cb65040dd9f95f5496821ba00"
format_stamp: "Formatted at 2026-08-07 10:36:35 on dist-test-slave-0b58"
server_key: "2683949afe6fb75a956d05d5e6bb0891"
server_key_iv: "006c1abe8d7b4e4d9e8c51284b7ce4ef"
server_key_version: "encryptionkey@0"
I20260807 10:36:35.759550 25750 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260807 10:36:35.762758 25764 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:36:35.764150 25750 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 10:36:35.764379 25750 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786098956060137-21165-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786098956060137-21165-0/minicluster-data/ts-2/wal
uuid: "61a9bf1cb65040dd9f95f5496821ba00"
format_stamp: "Formatted at 2026-08-07 10:36:35 on dist-test-slave-0b58"
server_key: "2683949afe6fb75a956d05d5e6bb0891"
server_key_iv: "006c1abe8d7b4e4d9e8c51284b7ce4ef"
server_key_version: "encryptionkey@0"
I20260807 10:36:35.764622 25750 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786098956060137-21165-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786098956060137-21165-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786098956060137-21165-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:36:35.778244 25750 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:36:35.782260 25750 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:36:35.782532 25750 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:36:35.783434 25750 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:36:35.785020 25750 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:36:35.785146 25750 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:36:35.785264 25750 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:36:35.785351 25750 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:36:35.818099 25750 rpc_server.cc:307] RPC server started. Bound to: 127.20.171.67:45425
I20260807 10:36:35.818161 25881 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.171.67:45425 every 8 connection(s)
I20260807 10:36:35.818949 25750 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786098956060137-21165-0/minicluster-data/ts-2/data/info.pb
I20260807 10:36:35.819926 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 25750
I20260807 10:36:35.820125 21165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786098956060137-21165-0/minicluster-data/ts-2/wal/instance
I20260807 10:36:35.820632 21165 external_mini_cluster.cc:1428] Setting key 0ca9beb0d4459d70bf472fffcc9122bb
Aug 07 10:36:35 dist-test-slave-0b58 krb5kdc[25372](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786098995, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.67@KRBTEST.COM for kudu/127.20.171.126@KRBTEST.COM
I20260807 10:36:35.838148 25610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:35.821583 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.67:35157 (local address 127.20.171.126:40315)
0807 10:36:35.821779 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:35.821784 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:35.823063 (+ 1279us) server_negotiation.cc:407] Connection header received
0807 10:36:35.825027 (+ 1964us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:35.825032 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:35.825116 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:35.825216 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:36:35.826642 (+ 1426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:35.827405 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:35.828951 (+ 1546us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:35.829387 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:35.829523 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:35.832780 (+ 3257us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:36:35.832785 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:36:35.832788 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:36:35.832819 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:36:35.835612 (+ 2793us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:35.836411 (+ 799us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:35.836415 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:35.836417 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:35.836535 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:35.836859 (+ 324us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:35.836862 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:35.836863 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:35.837087 (+ 224us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:36:35.837222 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:35.837765 (+ 543us) server_negotiation.cc:299] Negotiation successful
0807 10:36:35.837908 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260807 10:36:35.838927 25884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:35.822104 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:40315 (local address 127.20.171.67:35157)
0807 10:36:35.822918 (+ 814us) negotiation.cc:107] Waiting for socket to connect
0807 10:36:35.822964 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0807 10:36:35.824795 (+ 1831us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:36:35.825434 (+ 639us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:36:35.825441 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:36:35.825911 (+ 470us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:36:35.826464 (+ 553us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:35.826481 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:35.827547 (+ 1066us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:35.827552 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:35.828814 (+ 1262us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:35.828826 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:35.829628 (+ 802us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:35.829635 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:35.829862 (+ 227us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:35.830465 (+ 603us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:36:35.830490 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:36:35.832579 (+ 2089us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:36:35.835740 (+ 3161us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:36:35.835747 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:36:35.835760 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:36:35.836249 (+ 489us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:36:35.836620 (+ 371us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:36:35.836623 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:36:35.836625 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:36:35.836772 (+ 147us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:36:35.837215 (+ 443us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:36:35.837220 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:36:35.837473 (+ 253us) client_negotiation.cc:769] Sending connection context
0807 10:36:35.837663 (+ 190us) client_negotiation.cc:240] Negotiation successful
0807 10:36:35.837986 (+ 323us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":524,"thread_start_us":329,"threads_started":1}
I20260807 10:36:35.840068 25882 heartbeater.cc:347] Connected to a master server at 127.20.171.126:40315
I20260807 10:36:35.840400 25882 heartbeater.cc:464] Registering TS with master...
I20260807 10:36:35.840972 25882 heartbeater.cc:511] Master 127.20.171.126:40315 requested a full tablet report, sending...
I20260807 10:36:35.842293 25417 ts_manager.cc:194] Registered new tserver with Master: 61a9bf1cb65040dd9f95f5496821ba00 (127.20.171.67:45425)
I20260807 10:36:35.843066 25417 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.171.67@KRBTEST.COM'} at 127.20.171.67:35157
I20260807 10:36:35.847939 21165 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 10:36:35.864360 25610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:35.852773 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49668 (local address 127.20.171.126:40315)
0807 10:36:35.852967 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:35.852973 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:35.853554 (+ 581us) server_negotiation.cc:407] Connection header received
0807 10:36:35.853650 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:35.853657 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:35.853736 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:35.853824 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:36:35.855031 (+ 1207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:35.855644 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:35.856889 (+ 1245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:35.857307 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:35.857397 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:35.859441 (+ 2044us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:36:35.859446 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:36:35.859449 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:36:35.859477 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:36:35.862022 (+ 2545us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:35.862616 (+ 594us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:35.862620 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:35.862622 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:35.862750 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:35.863135 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:35.863138 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:35.863140 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:35.863438 (+ 298us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:36:35.863613 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:35.863898 (+ 285us) server_negotiation.cc:299] Negotiation successful
0807 10:36:35.864051 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260807 10:36:35.868170 25417 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49668:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 10:36:35.875667 25417 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 10:36:35.882548 25608 heartbeater.cc:503] Master 127.20.171.126:40315 was elected leader, sending a full tablet report...
I20260807 10:36:35.901662 25894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:35.887452 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47326 (local address 127.20.171.66:42911)
0807 10:36:35.889105 (+ 1653us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:35.889115 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:35.889615 (+ 500us) server_negotiation.cc:407] Connection header received
0807 10:36:35.890042 (+ 427us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:35.890051 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:35.890289 (+ 238us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:35.890457 (+ 168us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:36:35.892028 (+ 1571us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:35.894087 (+ 2059us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:35.897902 (+ 3815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:35.899780 (+ 1878us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:35.899913 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:35.900153 (+ 240us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:35.901120 (+ 967us) server_negotiation.cc:299] Negotiation successful
0807 10:36:35.901347 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1460,"thread_start_us":1340,"threads_started":1}
I20260807 10:36:35.902895 25896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:35.887397 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.66:42911 (local address 127.0.0.1:47326)
0807 10:36:35.889479 (+ 2082us) negotiation.cc:107] Waiting for socket to connect
0807 10:36:35.889525 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0807 10:36:35.889768 (+ 243us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:36:35.890750 (+ 982us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:36:35.890757 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:36:35.890792 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:36:35.891291 (+ 499us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:35.891308 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:35.894305 (+ 2997us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:35.894313 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:35.897611 (+ 3298us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:35.897631 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:35.900505 (+ 2874us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:35.900513 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:35.900800 (+ 287us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:35.900866 (+ 66us) client_negotiation.cc:769] Sending connection context
0807 10:36:35.902220 (+ 1354us) client_negotiation.cc:240] Negotiation successful
0807 10:36:35.902435 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1886,"mutex_wait_us":7,"thread_start_us":2351,"threads_started":1}
I20260807 10:36:35.903513 25897 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:35.888113 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41172 (local address 127.20.171.65:39113)
0807 10:36:35.889592 (+ 1479us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:35.889602 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:35.890117 (+ 515us) server_negotiation.cc:407] Connection header received
0807 10:36:35.890390 (+ 273us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:35.890399 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:35.890597 (+ 198us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:35.890746 (+ 149us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:36:35.891969 (+ 1223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:35.894118 (+ 2149us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:35.900008 (+ 5890us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:35.901901 (+ 1893us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:35.902066 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:35.902312 (+ 246us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:35.902953 (+ 641us) server_negotiation.cc:299] Negotiation successful
0807 10:36:35.903145 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1298,"thread_start_us":1156,"threads_started":1}
I20260807 10:36:35.904726 25895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:35.887552 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.65:39113 (local address 127.0.0.1:41172)
0807 10:36:35.890021 (+ 2469us) negotiation.cc:107] Waiting for socket to connect
0807 10:36:35.890038 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 10:36:35.890214 (+ 176us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:36:35.891021 (+ 807us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:36:35.891027 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:36:35.891062 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:36:35.891793 (+ 731us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:35.891807 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:35.895558 (+ 3751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:35.895568 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:35.898592 (+ 3024us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:35.898613 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:35.902514 (+ 3901us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:35.902522 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:35.902737 (+ 215us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:35.902768 (+ 31us) client_negotiation.cc:769] Sending connection context
0807 10:36:35.903695 (+ 927us) client_negotiation.cc:240] Negotiation successful
0807 10:36:35.904345 (+ 650us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2340,"mutex_wait_us":228,"thread_start_us":1594,"threads_started":1}
I20260807 10:36:35.906746 25677 tablet_service.cc:1467] Processing CreateTablet for tablet f617495c5471477a84a6dc0ba50d8236 (DEFAULT_TABLE table=test-table [id=7511e4860baf4e72bd12a36332bc6d46]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:36:35.908191 25677 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f617495c5471477a84a6dc0ba50d8236. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:36:35.908097 25541 tablet_service.cc:1467] Processing CreateTablet for tablet f617495c5471477a84a6dc0ba50d8236 (DEFAULT_TABLE table=test-table [id=7511e4860baf4e72bd12a36332bc6d46]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:36:35.909246 25541 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f617495c5471477a84a6dc0ba50d8236. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:36:35.910374 25898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:35.889872 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.67:45425 (local address 127.0.0.1:47746)
0807 10:36:35.902414 (+ 12542us) negotiation.cc:107] Waiting for socket to connect
0807 10:36:35.902434 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0807 10:36:35.902576 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:36:35.903462 (+ 886us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:36:35.903466 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:36:35.903491 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:36:35.903852 (+ 361us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:35.903864 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:35.905808 (+ 1944us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:35.905813 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:35.907835 (+ 2022us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:35.907849 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:35.909536 (+ 1687us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:35.909544 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:35.909699 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:35.909732 (+ 33us) client_negotiation.cc:769] Sending connection context
0807 10:36:35.909828 (+ 96us) client_negotiation.cc:240] Negotiation successful
0807 10:36:35.909948 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12406,"mutex_wait_us":207,"thread_start_us":12031,"threads_started":1}
I20260807 10:36:35.911125 25899 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:35.890324 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47746 (local address 127.20.171.67:45425)
0807 10:36:35.901771 (+ 11447us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:35.901780 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:35.902559 (+ 779us) server_negotiation.cc:407] Connection header received
0807 10:36:35.902753 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:35.902761 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:35.902986 (+ 225us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:35.903169 (+ 183us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:36:35.904145 (+ 976us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:35.905667 (+ 1522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:35.908007 (+ 2340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:35.909337 (+ 1330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:35.909472 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:35.909692 (+ 220us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:35.910641 (+ 949us) server_negotiation.cc:299] Negotiation successful
0807 10:36:35.910792 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11247,"thread_start_us":11455,"threads_started":1}
I20260807 10:36:35.914842 25813 tablet_service.cc:1467] Processing CreateTablet for tablet f617495c5471477a84a6dc0ba50d8236 (DEFAULT_TABLE table=test-table [id=7511e4860baf4e72bd12a36332bc6d46]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:36:35.916132 25813 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f617495c5471477a84a6dc0ba50d8236. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:36:35.919493 25900 tablet_bootstrap.cc:492] T f617495c5471477a84a6dc0ba50d8236 P 53981e25a74a4a30b8e62a0476c02c95: Bootstrap starting.
I20260807 10:36:35.922487 25900 tablet_bootstrap.cc:654] T f617495c5471477a84a6dc0ba50d8236 P 53981e25a74a4a30b8e62a0476c02c95: Neither blocks nor log segments found. Creating new log.
I20260807 10:36:35.923363 25901 tablet_bootstrap.cc:492] T f617495c5471477a84a6dc0ba50d8236 P d4a71f9c7b6c48e59c3eed29e77e0c06: Bootstrap starting.
I20260807 10:36:35.923812 25900 log.cc:824] T f617495c5471477a84a6dc0ba50d8236 P 53981e25a74a4a30b8e62a0476c02c95: Log is configured to *not* fsync() on all Append() calls
I20260807 10:36:35.926729 25901 tablet_bootstrap.cc:654] T f617495c5471477a84a6dc0ba50d8236 P d4a71f9c7b6c48e59c3eed29e77e0c06: Neither blocks nor log segments found. Creating new log.
I20260807 10:36:35.927263 25900 tablet_bootstrap.cc:492] T f617495c5471477a84a6dc0ba50d8236 P 53981e25a74a4a30b8e62a0476c02c95: No bootstrap required, opened a new log
I20260807 10:36:35.927541 25900 ts_tablet_manager.cc:1397] T f617495c5471477a84a6dc0ba50d8236 P 53981e25a74a4a30b8e62a0476c02c95: Time spent bootstrapping tablet: real 0.008s user 0.005s sys 0.001s
I20260807 10:36:35.927991 25901 log.cc:824] T f617495c5471477a84a6dc0ba50d8236 P d4a71f9c7b6c48e59c3eed29e77e0c06: Log is configured to *not* fsync() on all Append() calls
I20260807 10:36:35.930931 25901 tablet_bootstrap.cc:492] T f617495c5471477a84a6dc0ba50d8236 P d4a71f9c7b6c48e59c3eed29e77e0c06: No bootstrap required, opened a new log
I20260807 10:36:35.931172 25901 ts_tablet_manager.cc:1397] T f617495c5471477a84a6dc0ba50d8236 P d4a71f9c7b6c48e59c3eed29e77e0c06: Time spent bootstrapping tablet: real 0.008s user 0.003s sys 0.003s
I20260807 10:36:35.932483 25904 tablet_bootstrap.cc:492] T f617495c5471477a84a6dc0ba50d8236 P 61a9bf1cb65040dd9f95f5496821ba00: Bootstrap starting.
I20260807 10:36:35.934965 25904 tablet_bootstrap.cc:654] T f617495c5471477a84a6dc0ba50d8236 P 61a9bf1cb65040dd9f95f5496821ba00: Neither blocks nor log segments found. Creating new log.
I20260807 10:36:35.935971 25904 log.cc:824] T f617495c5471477a84a6dc0ba50d8236 P 61a9bf1cb65040dd9f95f5496821ba00: Log is configured to *not* fsync() on all Append() calls
I20260807 10:36:35.938086 25900 raft_consensus.cc:348] T f617495c5471477a84a6dc0ba50d8236 P 53981e25a74a4a30b8e62a0476c02c95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53981e25a74a4a30b8e62a0476c02c95" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 42911 } } peers { permanent_uuid: "d4a71f9c7b6c48e59c3eed29e77e0c06" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 39113 } } peers { permanent_uuid: "61a9bf1cb65040dd9f95f5496821ba00" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 45425 } }
I20260807 10:36:35.938514 25900 raft_consensus.cc:374] T f617495c5471477a84a6dc0ba50d8236 P 53981e25a74a4a30b8e62a0476c02c95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:36:35.938619 25900 raft_consensus.cc:729] T f617495c5471477a84a6dc0ba50d8236 P 53981e25a74a4a30b8e62a0476c02c95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53981e25a74a4a30b8e62a0476c02c95, State: Initialized, Role: FOLLOWER
I20260807 10:36:35.939254 25900 consensus_queue.cc:260] T f617495c5471477a84a6dc0ba50d8236 P 53981e25a74a4a30b8e62a0476c02c95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53981e25a74a4a30b8e62a0476c02c95" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 42911 } } peers { permanent_uuid: "d4a71f9c7b6c48e59c3eed29e77e0c06" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 39113 } } peers { permanent_uuid: "61a9bf1cb65040dd9f95f5496821ba00" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 45425 } }
I20260807 10:36:35.939596 25904 tablet_bootstrap.cc:492] T f617495c5471477a84a6dc0ba50d8236 P 61a9bf1cb65040dd9f95f5496821ba00: No bootstrap required, opened a new log
I20260807 10:36:35.939926 25904 ts_tablet_manager.cc:1397] T f617495c5471477a84a6dc0ba50d8236 P 61a9bf1cb65040dd9f95f5496821ba00: Time spent bootstrapping tablet: real 0.011s user 0.000s sys 0.007s
I20260807 10:36:35.941035 25901 raft_consensus.cc:348] T f617495c5471477a84a6dc0ba50d8236 P d4a71f9c7b6c48e59c3eed29e77e0c06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53981e25a74a4a30b8e62a0476c02c95" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 42911 } } peers { permanent_uuid: "d4a71f9c7b6c48e59c3eed29e77e0c06" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 39113 } } peers { permanent_uuid: "61a9bf1cb65040dd9f95f5496821ba00" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 45425 } }
I20260807 10:36:35.941382 25901 raft_consensus.cc:374] T f617495c5471477a84a6dc0ba50d8236 P d4a71f9c7b6c48e59c3eed29e77e0c06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:36:35.941493 25901 raft_consensus.cc:729] T f617495c5471477a84a6dc0ba50d8236 P d4a71f9c7b6c48e59c3eed29e77e0c06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4a71f9c7b6c48e59c3eed29e77e0c06, State: Initialized, Role: FOLLOWER
I20260807 10:36:35.942092 25901 consensus_queue.cc:260] T f617495c5471477a84a6dc0ba50d8236 P d4a71f9c7b6c48e59c3eed29e77e0c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53981e25a74a4a30b8e62a0476c02c95" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 42911 } } peers { permanent_uuid: "d4a71f9c7b6c48e59c3eed29e77e0c06" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 39113 } } peers { permanent_uuid: "61a9bf1cb65040dd9f95f5496821ba00" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 45425 } }
I20260807 10:36:35.943842 25901 ts_tablet_manager.cc:1428] T f617495c5471477a84a6dc0ba50d8236 P d4a71f9c7b6c48e59c3eed29e77e0c06: Time spent starting tablet: real 0.013s user 0.008s sys 0.004s
I20260807 10:36:35.944846 25745 heartbeater.cc:503] Master 127.20.171.126:40315 was elected leader, sending a full tablet report...
I20260807 10:36:35.945436 25900 ts_tablet_manager.cc:1428] T f617495c5471477a84a6dc0ba50d8236 P 53981e25a74a4a30b8e62a0476c02c95: Time spent starting tablet: real 0.018s user 0.012s sys 0.006s
I20260807 10:36:35.950909 25904 raft_consensus.cc:348] T f617495c5471477a84a6dc0ba50d8236 P 61a9bf1cb65040dd9f95f5496821ba00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53981e25a74a4a30b8e62a0476c02c95" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 42911 } } peers { permanent_uuid: "d4a71f9c7b6c48e59c3eed29e77e0c06" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 39113 } } peers { permanent_uuid: "61a9bf1cb65040dd9f95f5496821ba00" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 45425 } }
I20260807 10:36:35.951220 25904 raft_consensus.cc:374] T f617495c5471477a84a6dc0ba50d8236 P 61a9bf1cb65040dd9f95f5496821ba00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:36:35.951316 25904 raft_consensus.cc:729] T f617495c5471477a84a6dc0ba50d8236 P 61a9bf1cb65040dd9f95f5496821ba00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61a9bf1cb65040dd9f95f5496821ba00, State: Initialized, Role: FOLLOWER
I20260807 10:36:35.951862 25904 consensus_queue.cc:260] T f617495c5471477a84a6dc0ba50d8236 P 61a9bf1cb65040dd9f95f5496821ba00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53981e25a74a4a30b8e62a0476c02c95" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 42911 } } peers { permanent_uuid: "d4a71f9c7b6c48e59c3eed29e77e0c06" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 39113 } } peers { permanent_uuid: "61a9bf1cb65040dd9f95f5496821ba00" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 45425 } }
I20260807 10:36:35.952860 25882 heartbeater.cc:503] Master 127.20.171.126:40315 was elected leader, sending a full tablet report...
I20260807 10:36:35.953423 25904 ts_tablet_manager.cc:1428] T f617495c5471477a84a6dc0ba50d8236 P 61a9bf1cb65040dd9f95f5496821ba00: Time spent starting tablet: real 0.013s user 0.012s sys 0.001s
I20260807 10:36:35.998622 25906 raft_consensus.cc:482] T f617495c5471477a84a6dc0ba50d8236 P 53981e25a74a4a30b8e62a0476c02c95 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 10:36:35.998975 25906 raft_consensus.cc:504] T f617495c5471477a84a6dc0ba50d8236 P 53981e25a74a4a30b8e62a0476c02c95 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53981e25a74a4a30b8e62a0476c02c95" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 42911 } } peers { permanent_uuid: "d4a71f9c7b6c48e59c3eed29e77e0c06" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 39113 } } peers { permanent_uuid: "61a9bf1cb65040dd9f95f5496821ba00" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 45425 } }
I20260807 10:36:36.000733 25906 leader_election.cc:288] T f617495c5471477a84a6dc0ba50d8236 P 53981e25a74a4a30b8e62a0476c02c95 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d4a71f9c7b6c48e59c3eed29e77e0c06 (127.20.171.65:39113), 61a9bf1cb65040dd9f95f5496821ba00 (127.20.171.67:45425)
I20260807 10:36:36.007581 25897 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:36.001159 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.66:46605 (local address 127.20.171.65:39113)
0807 10:36:36.001347 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:36.001352 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:36.002054 (+ 702us) server_negotiation.cc:407] Connection header received
0807 10:36:36.002356 (+ 302us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:36.002362 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:36.002444 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:36.002513 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:36:36.003181 (+ 668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:36.003963 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:36.005772 (+ 1809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:36.006627 (+ 855us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:36.006850 (+ 223us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:36.006934 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:36.007276 (+ 342us) server_negotiation.cc:299] Negotiation successful
0807 10:36:36.007406 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260807 10:36:36.008327 25909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:36.001131 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.65:39113 (local address 127.20.171.66:46605)
0807 10:36:36.001921 (+ 790us) negotiation.cc:107] Waiting for socket to connect
0807 10:36:36.001941 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0807 10:36:36.002109 (+ 168us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:36:36.002698 (+ 589us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:36:36.002701 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:36:36.002723 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:36:36.003035 (+ 312us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:36.003043 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:36.004101 (+ 1058us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:36.004106 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:36.005596 (+ 1490us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:36.005609 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:36.006888 (+ 1279us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:36.006894 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:36.007068 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:36.007094 (+ 26us) client_negotiation.cc:769] Sending connection context
0807 10:36:36.007787 (+ 693us) client_negotiation.cc:240] Negotiation successful
0807 10:36:36.007918 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":629,"thread_start_us":398,"threads_started":1}
I20260807 10:36:36.008448 25899 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:36.002245 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.66:58441 (local address 127.20.171.67:45425)
0807 10:36:36.002462 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:36.002468 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:36.002720 (+ 252us) server_negotiation.cc:407] Connection header received
0807 10:36:36.002928 (+ 208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:36.002940 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:36.002998 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:36.003094 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:36:36.003619 (+ 525us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:36.004413 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:36.006046 (+ 1633us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:36.007107 (+ 1061us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:36.007296 (+ 189us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:36.007392 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:36.007661 (+ 269us) server_negotiation.cc:299] Negotiation successful
0807 10:36:36.008222 (+ 561us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260807 10:36:36.008750 25910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:36.002006 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.67:45425 (local address 127.20.171.66:58441)
0807 10:36:36.002605 (+ 599us) negotiation.cc:107] Waiting for socket to connect
0807 10:36:36.002619 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 10:36:36.002788 (+ 169us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:36:36.003108 (+ 320us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:36:36.003112 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:36:36.003134 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:36:36.003466 (+ 332us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:36.003474 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:36.004551 (+ 1077us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:36.004556 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:36.005901 (+ 1345us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:36.005914 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:36.007344 (+ 1430us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:36.007350 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:36.007512 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:36.007535 (+ 23us) client_negotiation.cc:769] Sending connection context
0807 10:36:36.007636 (+ 101us) client_negotiation.cc:240] Negotiation successful
0807 10:36:36.007852 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":507,"thread_start_us":306,"threads_started":1}
I20260807 10:36:36.009495 25561 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f617495c5471477a84a6dc0ba50d8236" candidate_uuid: "53981e25a74a4a30b8e62a0476c02c95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4a71f9c7b6c48e59c3eed29e77e0c06" is_pre_election: true
I20260807 10:36:36.009755 25835 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f617495c5471477a84a6dc0ba50d8236" candidate_uuid: "53981e25a74a4a30b8e62a0476c02c95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61a9bf1cb65040dd9f95f5496821ba00" is_pre_election: true
I20260807 10:36:36.010085 25561 raft_consensus.cc:2454] T f617495c5471477a84a6dc0ba50d8236 P d4a71f9c7b6c48e59c3eed29e77e0c06 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53981e25a74a4a30b8e62a0476c02c95 in term 0.
I20260807 10:36:36.010245 25835 raft_consensus.cc:2454] T f617495c5471477a84a6dc0ba50d8236 P 61a9bf1cb65040dd9f95f5496821ba00 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53981e25a74a4a30b8e62a0476c02c95 in term 0.
I20260807 10:36:36.010809 25631 leader_election.cc:302] T f617495c5471477a84a6dc0ba50d8236 P 53981e25a74a4a30b8e62a0476c02c95 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53981e25a74a4a30b8e62a0476c02c95, d4a71f9c7b6c48e59c3eed29e77e0c06; no voters:
I20260807 10:36:36.011158 25906 raft_consensus.cc:2781] T f617495c5471477a84a6dc0ba50d8236 P 53981e25a74a4a30b8e62a0476c02c95 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 10:36:36.011335 25906 raft_consensus.cc:482] T f617495c5471477a84a6dc0ba50d8236 P 53981e25a74a4a30b8e62a0476c02c95 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 10:36:36.011431 25906 raft_consensus.cc:3037] T f617495c5471477a84a6dc0ba50d8236 P 53981e25a74a4a30b8e62a0476c02c95 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:36:36.013681 25906 raft_consensus.cc:504] T f617495c5471477a84a6dc0ba50d8236 P 53981e25a74a4a30b8e62a0476c02c95 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53981e25a74a4a30b8e62a0476c02c95" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 42911 } } peers { permanent_uuid: "d4a71f9c7b6c48e59c3eed29e77e0c06" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 39113 } } peers { permanent_uuid: "61a9bf1cb65040dd9f95f5496821ba00" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 45425 } }
I20260807 10:36:36.014249 25906 leader_election.cc:288] T f617495c5471477a84a6dc0ba50d8236 P 53981e25a74a4a30b8e62a0476c02c95 [CANDIDATE]: Term 1 election: Requested vote from peers d4a71f9c7b6c48e59c3eed29e77e0c06 (127.20.171.65:39113), 61a9bf1cb65040dd9f95f5496821ba00 (127.20.171.67:45425)
I20260807 10:36:36.014639 25561 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f617495c5471477a84a6dc0ba50d8236" candidate_uuid: "53981e25a74a4a30b8e62a0476c02c95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4a71f9c7b6c48e59c3eed29e77e0c06"
I20260807 10:36:36.014696 25835 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f617495c5471477a84a6dc0ba50d8236" candidate_uuid: "53981e25a74a4a30b8e62a0476c02c95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61a9bf1cb65040dd9f95f5496821ba00"
I20260807 10:36:36.014814 25561 raft_consensus.cc:3037] T f617495c5471477a84a6dc0ba50d8236 P d4a71f9c7b6c48e59c3eed29e77e0c06 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:36:36.014895 25835 raft_consensus.cc:3037] T f617495c5471477a84a6dc0ba50d8236 P 61a9bf1cb65040dd9f95f5496821ba00 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:36:36.016956 25561 raft_consensus.cc:2454] T f617495c5471477a84a6dc0ba50d8236 P d4a71f9c7b6c48e59c3eed29e77e0c06 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53981e25a74a4a30b8e62a0476c02c95 in term 1.
I20260807 10:36:36.017053 25835 raft_consensus.cc:2454] T f617495c5471477a84a6dc0ba50d8236 P 61a9bf1cb65040dd9f95f5496821ba00 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53981e25a74a4a30b8e62a0476c02c95 in term 1.
I20260807 10:36:36.017436 25631 leader_election.cc:302] T f617495c5471477a84a6dc0ba50d8236 P 53981e25a74a4a30b8e62a0476c02c95 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53981e25a74a4a30b8e62a0476c02c95, 61a9bf1cb65040dd9f95f5496821ba00; no voters:
I20260807 10:36:36.017693 25906 raft_consensus.cc:2781] T f617495c5471477a84a6dc0ba50d8236 P 53981e25a74a4a30b8e62a0476c02c95 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:36:36.018115 25906 raft_consensus.cc:686] T f617495c5471477a84a6dc0ba50d8236 P 53981e25a74a4a30b8e62a0476c02c95 [term 1 LEADER]: Becoming Leader. State: Replica: 53981e25a74a4a30b8e62a0476c02c95, State: Running, Role: LEADER
I20260807 10:36:36.018587 25906 consensus_queue.cc:237] T f617495c5471477a84a6dc0ba50d8236 P 53981e25a74a4a30b8e62a0476c02c95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53981e25a74a4a30b8e62a0476c02c95" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 42911 } } peers { permanent_uuid: "d4a71f9c7b6c48e59c3eed29e77e0c06" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 39113 } } peers { permanent_uuid: "61a9bf1cb65040dd9f95f5496821ba00" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 45425 } }
I20260807 10:36:36.023212 25416 catalog_manager.cc:5495] T f617495c5471477a84a6dc0ba50d8236 P 53981e25a74a4a30b8e62a0476c02c95 reported cstate change: term changed from 0 to 1, leader changed from <none> to 53981e25a74a4a30b8e62a0476c02c95 (127.20.171.66). New cstate: current_term: 1 leader_uuid: "53981e25a74a4a30b8e62a0476c02c95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53981e25a74a4a30b8e62a0476c02c95" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 42911 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d4a71f9c7b6c48e59c3eed29e77e0c06" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 39113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61a9bf1cb65040dd9f95f5496821ba00" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 45425 } health_report { overall_health: UNKNOWN } } }
I20260807 10:36:36.049958 25894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:36.045061 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47342 (local address 127.20.171.66:42911)
0807 10:36:36.045241 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:36.045245 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:36.045261 (+ 16us) server_negotiation.cc:407] Connection header received
0807 10:36:36.045337 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:36.045340 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:36.045419 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:36.045539 (+ 120us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 10:36:36.045873 (+ 334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:36.046575 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:36.047878 (+ 1303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:36.048314 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:36.048405 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:36.048817 (+ 412us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 10:36:36.049316 (+ 499us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 10:36:36.049473 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:36.049559 (+ 86us) server_negotiation.cc:299] Negotiation successful
0807 10:36:36.049622 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260807 10:36:36.057711 25835 raft_consensus.cc:1261] T f617495c5471477a84a6dc0ba50d8236 P 61a9bf1cb65040dd9f95f5496821ba00 [term 1 FOLLOWER]: Refusing update from remote peer 53981e25a74a4a30b8e62a0476c02c95: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 10:36:36.057724 25561 raft_consensus.cc:1261] T f617495c5471477a84a6dc0ba50d8236 P d4a71f9c7b6c48e59c3eed29e77e0c06 [term 1 FOLLOWER]: Refusing update from remote peer 53981e25a74a4a30b8e62a0476c02c95: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 10:36:36.058638 25911 consensus_queue.cc:1035] T f617495c5471477a84a6dc0ba50d8236 P 53981e25a74a4a30b8e62a0476c02c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61a9bf1cb65040dd9f95f5496821ba00" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 45425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 10:36:36.058982 25906 consensus_queue.cc:1035] T f617495c5471477a84a6dc0ba50d8236 P 53981e25a74a4a30b8e62a0476c02c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d4a71f9c7b6c48e59c3eed29e77e0c06" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 39113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260807 10:36:36.070504 25883 tablet.cc:2369] T f617495c5471477a84a6dc0ba50d8236 P 61a9bf1cb65040dd9f95f5496821ba00: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 10:36:36.071147 25914 mvcc.cc:205] Tried to move back new op lower bound from 7315861487842852864 to 7315861487695785984. Current Snapshot: MvccSnapshot[applied={T|T < 7315861487842852864}]
I20260807 10:36:36.083841 25416 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49668:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 10:36:36.084132 25416 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49668:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 10:36:36.087706 25416 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 866074e9f97a4a13843a9abc1b06886d: Sending DeleteTablet for 3 replicas of tablet f617495c5471477a84a6dc0ba50d8236
I20260807 10:36:36.088680 25677 tablet_service.cc:1514] Processing DeleteTablet for tablet f617495c5471477a84a6dc0ba50d8236 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:36:36 UTC) from {username='kudu', principal='kudu/127.20.171.126@KRBTEST.COM'} at 127.0.0.1:47326
I20260807 10:36:36.088768 25541 tablet_service.cc:1514] Processing DeleteTablet for tablet f617495c5471477a84a6dc0ba50d8236 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:36:36 UTC) from {username='kudu', principal='kudu/127.20.171.126@KRBTEST.COM'} at 127.0.0.1:41172
I20260807 10:36:36.089119 25813 tablet_service.cc:1514] Processing DeleteTablet for tablet f617495c5471477a84a6dc0ba50d8236 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:36:36 UTC) from {username='kudu', principal='kudu/127.20.171.126@KRBTEST.COM'} at 127.0.0.1:47746
I20260807 10:36:36.090806 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 25479
I20260807 10:36:36.101565 25926 tablet_replica.cc:330] T f617495c5471477a84a6dc0ba50d8236 P 61a9bf1cb65040dd9f95f5496821ba00: stopping tablet replica
I20260807 10:36:36.102262 25926 raft_consensus.cc:2229] T f617495c5471477a84a6dc0ba50d8236 P 61a9bf1cb65040dd9f95f5496821ba00 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 10:36:36.102891 25926 raft_consensus.cc:2258] T f617495c5471477a84a6dc0ba50d8236 P 61a9bf1cb65040dd9f95f5496821ba00 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:36:36.105794 25926 ts_tablet_manager.cc:1905] T f617495c5471477a84a6dc0ba50d8236 P 61a9bf1cb65040dd9f95f5496821ba00: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 10:36:36.115286 25926 ts_tablet_manager.cc:1918] T f617495c5471477a84a6dc0ba50d8236 P 61a9bf1cb65040dd9f95f5496821ba00: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 10:36:36.115602 25926 log.cc:1196] T f617495c5471477a84a6dc0ba50d8236 P 61a9bf1cb65040dd9f95f5496821ba00: Deleting WAL directory at /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786098956060137-21165-0/minicluster-data/ts-2/wal/wals/f617495c5471477a84a6dc0ba50d8236
I20260807 10:36:36.116369 25926 ts_tablet_manager.cc:1939] T f617495c5471477a84a6dc0ba50d8236 P 61a9bf1cb65040dd9f95f5496821ba00: Deleting consensus metadata
I20260807 10:36:36.118687 25402 catalog_manager.cc:4841] TS 61a9bf1cb65040dd9f95f5496821ba00 (127.20.171.67:45425): tablet f617495c5471477a84a6dc0ba50d8236 (table test-table [id=7511e4860baf4e72bd12a36332bc6d46]) successfully deleted
I20260807 10:36:36.119865 25924 tablet_replica.cc:330] T f617495c5471477a84a6dc0ba50d8236 P 53981e25a74a4a30b8e62a0476c02c95: stopping tablet replica
I20260807 10:36:36.120493 25924 raft_consensus.cc:2229] T f617495c5471477a84a6dc0ba50d8236 P 53981e25a74a4a30b8e62a0476c02c95 [term 1 LEADER]: Raft consensus shutting down.
I20260807 10:36:36.121397 25924 raft_consensus.cc:2258] T f617495c5471477a84a6dc0ba50d8236 P 53981e25a74a4a30b8e62a0476c02c95 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:36:36.122543 25925 tablet_replica.cc:330] T f617495c5471477a84a6dc0ba50d8236 P d4a71f9c7b6c48e59c3eed29e77e0c06: stopping tablet replica
I20260807 10:36:36.122994 25925 raft_consensus.cc:2229] T f617495c5471477a84a6dc0ba50d8236 P d4a71f9c7b6c48e59c3eed29e77e0c06 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 10:36:36.123579 25925 raft_consensus.cc:2258] T f617495c5471477a84a6dc0ba50d8236 P d4a71f9c7b6c48e59c3eed29e77e0c06 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:36:36.123982 25924 ts_tablet_manager.cc:1905] T f617495c5471477a84a6dc0ba50d8236 P 53981e25a74a4a30b8e62a0476c02c95: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 10:36:36.125510 25925 ts_tablet_manager.cc:1905] T f617495c5471477a84a6dc0ba50d8236 P d4a71f9c7b6c48e59c3eed29e77e0c06: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 07 10:36:36 dist-test-slave-0b58 krb5kdc[25372](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786098993, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.171.65@KRBTEST.COM
I20260807 10:36:36.131356 25924 ts_tablet_manager.cc:1918] T f617495c5471477a84a6dc0ba50d8236 P 53981e25a74a4a30b8e62a0476c02c95: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 10:36:36.131557 25924 log.cc:1196] T f617495c5471477a84a6dc0ba50d8236 P 53981e25a74a4a30b8e62a0476c02c95: Deleting WAL directory at /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786098956060137-21165-0/minicluster-data/ts-1/wal/wals/f617495c5471477a84a6dc0ba50d8236
I20260807 10:36:36.132213 25924 ts_tablet_manager.cc:1939] T f617495c5471477a84a6dc0ba50d8236 P 53981e25a74a4a30b8e62a0476c02c95: Deleting consensus metadata
I20260807 10:36:36.133126 25925 ts_tablet_manager.cc:1918] T f617495c5471477a84a6dc0ba50d8236 P d4a71f9c7b6c48e59c3eed29e77e0c06: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 10:36:36.133366 25925 log.cc:1196] T f617495c5471477a84a6dc0ba50d8236 P d4a71f9c7b6c48e59c3eed29e77e0c06: Deleting WAL directory at /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786098956060137-21165-0/minicluster-data/ts-0/wal/wals/f617495c5471477a84a6dc0ba50d8236
I20260807 10:36:36.133996 25925 ts_tablet_manager.cc:1939] T f617495c5471477a84a6dc0ba50d8236 P d4a71f9c7b6c48e59c3eed29e77e0c06: Deleting consensus metadata
I20260807 10:36:36.134059 25403 catalog_manager.cc:4841] TS 53981e25a74a4a30b8e62a0476c02c95 (127.20.171.66:42911): tablet f617495c5471477a84a6dc0ba50d8236 (table test-table [id=7511e4860baf4e72bd12a36332bc6d46]) successfully deleted
I20260807 10:36:36.135480 25897 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:36.092316 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41184 (local address 127.20.171.65:39113)
0807 10:36:36.092483 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:36.092489 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:36.115821 (+ 23332us) server_negotiation.cc:407] Connection header received
0807 10:36:36.116321 (+ 500us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:36.116328 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:36.116413 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:36.116488 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:36:36.118261 (+ 1773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:36.119442 (+ 1181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:36.121267 (+ 1825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:36.122000 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:36.122129 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:36.127611 (+ 5482us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:36:36.127625 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:36:36.127640 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:36:36.127676 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:36:36.131591 (+ 3915us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:36.132503 (+ 912us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:36.132512 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:36.132515 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:36.132676 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:36.133160 (+ 484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:36.133165 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:36.133168 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:36.133725 (+ 557us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:36:36.134054 (+ 329us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:36.134698 (+ 644us) server_negotiation.cc:299] Negotiation successful
0807 10:36:36.134925 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260807 10:36:36.135700 25402 catalog_manager.cc:4841] TS d4a71f9c7b6c48e59c3eed29e77e0c06 (127.20.171.65:39113): tablet f617495c5471477a84a6dc0ba50d8236 (table test-table [id=7511e4860baf4e72bd12a36332bc6d46]) successfully deleted
I20260807 10:36:36.136119 25603 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:36:36.224818 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 25479
I20260807 10:36:36.247995 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 25614
Aug 07 10:36:36 dist-test-slave-0b58 krb5kdc[25372](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786098993, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.171.66@KRBTEST.COM
I20260807 10:36:36.265947 25894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:36.248942 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47352 (local address 127.20.171.66:42911)
0807 10:36:36.249165 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:36.249172 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:36.249195 (+ 23us) server_negotiation.cc:407] Connection header received
0807 10:36:36.249260 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:36.249265 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:36.249363 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:36.249483 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:36:36.250578 (+ 1095us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:36.251771 (+ 1193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:36.253049 (+ 1278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:36.253729 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:36.253849 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:36.258479 (+ 4630us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:36:36.258498 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:36:36.258518 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:36:36.258560 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:36:36.262618 (+ 4058us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:36.263462 (+ 844us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:36.263471 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:36.263475 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:36.263644 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:36.264163 (+ 519us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:36.264170 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:36.264175 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:36.264649 (+ 474us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:36:36.264998 (+ 349us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:36.265279 (+ 281us) server_negotiation.cc:299] Negotiation successful
0807 10:36:36.265531 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260807 10:36:36.266707 25740 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:36:36.376147 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 25614
I20260807 10:36:36.397886 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 25750
Aug 07 10:36:36 dist-test-slave-0b58 krb5kdc[25372](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786098993, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.171.67@KRBTEST.COM
I20260807 10:36:36.412799 25899 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:36.398715 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47750 (local address 127.20.171.67:45425)
0807 10:36:36.398897 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:36.398901 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:36.398918 (+ 17us) server_negotiation.cc:407] Connection header received
0807 10:36:36.399071 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:36.399075 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:36.399134 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:36.399214 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:36:36.400513 (+ 1299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:36.401283 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:36.402494 (+ 1211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:36.402889 (+ 395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:36.403022 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:36.407374 (+ 4352us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:36:36.407389 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:36:36.407404 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:36:36.407438 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:36:36.410131 (+ 2693us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:36.410759 (+ 628us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:36.410766 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:36.410768 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:36.410898 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:36.411257 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:36.411262 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:36.411265 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:36.411618 (+ 353us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:36:36.411928 (+ 310us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:36.412229 (+ 301us) server_negotiation.cc:299] Negotiation successful
0807 10:36:36.412485 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260807 10:36:36.413455 25877 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:36:36.499402 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 25750
I20260807 10:36:36.519970 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 25385
I20260807 10:36:36.521140 25448 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:36:36.629490 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 25385
2026-08-07T10:36:36Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (4109 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-08-07T10:36:36Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T10:36:36Z Disabled control of system clock
I20260807 10:36:36.705790 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786098956060137-21165-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786098956060137-21165-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786098956060137-21165-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.171.126:46241
--webserver_interface=127.20.171.126
--webserver_port=0
--builtin_ntp_servers=127.20.171.84:37661
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.171.126:46241
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260807 10:36:37.017601 25935 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:36:37.017851 25935 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:36:37.017930 25935 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:36:37.024413 25935 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 10:36:37.024519 25935 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:36:37.024556 25935 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:36:37.024603 25935 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 10:36:37.024645 25935 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 10:36:37.033417 25935 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.171.84:37661
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786098956060137-21165-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786098956060137-21165-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.171.126:46241
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.171.126:46241
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.171.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786098956060137-21165-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:36:37.034473 25935 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:36:37.036053 25935 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:36:37.047420 25943 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:36:37.047636 25941 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:36:37.047880 25940 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:36:37.048470 25935 server_base.cc:1034] running on GCE node
I20260807 10:36:37.049166 25935 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:36:37.050401 25935 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:36:37.051622 25935 hybrid_clock.cc:648] HybridClock initialized: now 1786098997051584 us; error 45 us; skew 500 ppm
I20260807 10:36:37.051944 25935 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 10:36:37.054134 25935 webserver.cc:460] Webserver started at http://127.20.171.126:34905/ using document root <none> and password file <none>
I20260807 10:36:37.054785 25935 fs_manager.cc:359] Metadata directory not provided
I20260807 10:36:37.054908 25935 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:36:37.055224 25935 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:36:37.057888 25935 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786098956060137-21165-0/minicluster-data/master-0/data/instance:
uuid: "cdbd36fb7d554a3cbd3e59d5bc3597c0"
format_stamp: "Formatted at 2026-08-07 10:36:37 on dist-test-slave-0b58"
server_key: "2dfbd1f94ee615ca4363993a6d99450c"
server_key_iv: "e7e16c26f431737da6b3cf78123a1d38"
server_key_version: "encryptionkey@0"
I20260807 10:36:37.058630 25935 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786098956060137-21165-0/minicluster-data/master-0/wal/instance:
uuid: "cdbd36fb7d554a3cbd3e59d5bc3597c0"
format_stamp: "Formatted at 2026-08-07 10:36:37 on dist-test-slave-0b58"
server_key: "2dfbd1f94ee615ca4363993a6d99450c"
server_key_iv: "e7e16c26f431737da6b3cf78123a1d38"
server_key_version: "encryptionkey@0"
I20260807 10:36:37.063108 25935 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.001s
I20260807 10:36:37.066351 25949 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:36:37.067478 25935 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260807 10:36:37.067646 25935 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786098956060137-21165-0/minicluster-data/master-0/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786098956060137-21165-0/minicluster-data/master-0/wal
uuid: "cdbd36fb7d554a3cbd3e59d5bc3597c0"
format_stamp: "Formatted at 2026-08-07 10:36:37 on dist-test-slave-0b58"
server_key: "2dfbd1f94ee615ca4363993a6d99450c"
server_key_iv: "e7e16c26f431737da6b3cf78123a1d38"
server_key_version: "encryptionkey@0"
I20260807 10:36:37.067850 25935 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786098956060137-21165-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786098956060137-21165-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786098956060137-21165-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:36:37.073304 25935 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:36:37.074041 25935 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:36:37.074332 25935 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:36:37.092263 25935 rpc_server.cc:307] RPC server started. Bound to: 127.20.171.126:46241
I20260807 10:36:37.092377 26003 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.171.126:46241 every 8 connection(s)
I20260807 10:36:37.093505 25935 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
I20260807 10:36:37.097084 26004 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:36:37.103621 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 25935
I20260807 10:36:37.103806 21165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786098956060137-21165-0/minicluster-data/master-0/wal/instance
I20260807 10:36:37.104466 21165 external_mini_cluster.cc:1428] Setting key 07d1fbd364cc3fe06949b31047b36f26
I20260807 10:36:37.107610 26004 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cdbd36fb7d554a3cbd3e59d5bc3597c0: Bootstrap starting.
I20260807 10:36:37.111505 26004 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cdbd36fb7d554a3cbd3e59d5bc3597c0: Neither blocks nor log segments found. Creating new log.
I20260807 10:36:37.112962 26004 log.cc:824] T 00000000000000000000000000000000 P cdbd36fb7d554a3cbd3e59d5bc3597c0: Log is configured to *not* fsync() on all Append() calls
I20260807 10:36:37.113809 26007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:37.106360 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38618 (local address 127.20.171.126:46241)
0807 10:36:37.107439 (+ 1079us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:37.107452 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:37.107500 (+ 48us) server_negotiation.cc:407] Connection header received
0807 10:36:37.109876 (+ 2376us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:37.109906 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:37.110385 (+ 479us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:37.110784 (+ 399us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:36:37.111814 (+ 1030us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:36:37.111822 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:36:37.111844 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:36:37.111864 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:36:37.111963 (+ 99us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:36:37.111988 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:36:37.112198 (+ 210us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:37.112343 (+ 145us) server_negotiation.cc:299] Negotiation successful
0807 10:36:37.112595 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":564,"thread_start_us":335,"threads_started":1}
I20260807 10:36:37.115933 26004 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cdbd36fb7d554a3cbd3e59d5bc3597c0: No bootstrap required, opened a new log
I20260807 10:36:37.123003 26004 raft_consensus.cc:348] T 00000000000000000000000000000000 P cdbd36fb7d554a3cbd3e59d5bc3597c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cdbd36fb7d554a3cbd3e59d5bc3597c0" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 46241 } }
I20260807 10:36:37.123356 26004 raft_consensus.cc:374] T 00000000000000000000000000000000 P cdbd36fb7d554a3cbd3e59d5bc3597c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:36:37.123421 26004 raft_consensus.cc:729] T 00000000000000000000000000000000 P cdbd36fb7d554a3cbd3e59d5bc3597c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cdbd36fb7d554a3cbd3e59d5bc3597c0, State: Initialized, Role: FOLLOWER
I20260807 10:36:37.123849 26004 consensus_queue.cc:260] T 00000000000000000000000000000000 P cdbd36fb7d554a3cbd3e59d5bc3597c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cdbd36fb7d554a3cbd3e59d5bc3597c0" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 46241 } }
I20260807 10:36:37.124027 26004 raft_consensus.cc:388] T 00000000000000000000000000000000 P cdbd36fb7d554a3cbd3e59d5bc3597c0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 10:36:37.124112 26004 raft_consensus.cc:482] T 00000000000000000000000000000000 P cdbd36fb7d554a3cbd3e59d5bc3597c0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 10:36:37.124228 26004 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cdbd36fb7d554a3cbd3e59d5bc3597c0 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:36:37.126196 26004 raft_consensus.cc:504] T 00000000000000000000000000000000 P cdbd36fb7d554a3cbd3e59d5bc3597c0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cdbd36fb7d554a3cbd3e59d5bc3597c0" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 46241 } }
I20260807 10:36:37.126614 26004 leader_election.cc:302] T 00000000000000000000000000000000 P cdbd36fb7d554a3cbd3e59d5bc3597c0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cdbd36fb7d554a3cbd3e59d5bc3597c0; no voters:
I20260807 10:36:37.127141 26004 leader_election.cc:288] T 00000000000000000000000000000000 P cdbd36fb7d554a3cbd3e59d5bc3597c0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 10:36:37.127249 26009 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cdbd36fb7d554a3cbd3e59d5bc3597c0 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:36:37.128008 26009 raft_consensus.cc:686] T 00000000000000000000000000000000 P cdbd36fb7d554a3cbd3e59d5bc3597c0 [term 1 LEADER]: Becoming Leader. State: Replica: cdbd36fb7d554a3cbd3e59d5bc3597c0, State: Running, Role: LEADER
I20260807 10:36:37.128674 26009 consensus_queue.cc:237] T 00000000000000000000000000000000 P cdbd36fb7d554a3cbd3e59d5bc3597c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cdbd36fb7d554a3cbd3e59d5bc3597c0" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 46241 } }
I20260807 10:36:37.129382 26004 sys_catalog.cc:564] T 00000000000000000000000000000000 P cdbd36fb7d554a3cbd3e59d5bc3597c0 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 10:36:37.131542 26010 sys_catalog.cc:455] T 00000000000000000000000000000000 P cdbd36fb7d554a3cbd3e59d5bc3597c0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cdbd36fb7d554a3cbd3e59d5bc3597c0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cdbd36fb7d554a3cbd3e59d5bc3597c0" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 46241 } } }
I20260807 10:36:37.131735 26011 sys_catalog.cc:455] T 00000000000000000000000000000000 P cdbd36fb7d554a3cbd3e59d5bc3597c0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader cdbd36fb7d554a3cbd3e59d5bc3597c0. Latest consensus state: current_term: 1 leader_uuid: "cdbd36fb7d554a3cbd3e59d5bc3597c0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cdbd36fb7d554a3cbd3e59d5bc3597c0" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 46241 } } }
I20260807 10:36:37.131973 26010 sys_catalog.cc:458] T 00000000000000000000000000000000 P cdbd36fb7d554a3cbd3e59d5bc3597c0 [sys.catalog]: This master's current role is: LEADER
I20260807 10:36:37.132062 26011 sys_catalog.cc:458] T 00000000000000000000000000000000 P cdbd36fb7d554a3cbd3e59d5bc3597c0 [sys.catalog]: This master's current role is: LEADER
I20260807 10:36:37.134550 26018 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 10:36:37.138896 26018 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 10:36:37.146536 26018 catalog_manager.cc:1347] Generated new cluster ID: 1b3dd34ce27f49998b76e942e66e294f
I20260807 10:36:37.146637 26018 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 10:36:37.178423 26018 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 10:36:37.178866 26018 catalog_manager.cc:1504] Loading token signing keys...
I20260807 10:36:37.192788 26018 catalog_manager.cc:5868] T 00000000000000000000000000000000 P cdbd36fb7d554a3cbd3e59d5bc3597c0: Generated new TSK 0
I20260807 10:36:37.193586 26018 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 10:36:37.198793 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786098956060137-21165-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786098956060137-21165-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786098956060137-21165-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786098956060137-21165-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.171.65:0
--local_ip_for_outbound_sockets=127.20.171.65
--webserver_interface=127.20.171.65
--webserver_port=0
--tserver_master_addrs=127.20.171.126:46241
--builtin_ntp_servers=127.20.171.84:37661
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260807 10:36:37.532418 26028 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:36:37.532689 26028 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:36:37.532788 26028 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:36:37.539870 26028 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:36:37.539959 26028 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:36:37.540066 26028 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.171.65
I20260807 10:36:37.548817 26028 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.171.84:37661
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786098956060137-21165-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786098956060137-21165-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.171.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786098956060137-21165-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.171.65
--webserver_port=0
--tserver_master_addrs=127.20.171.126:46241
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.171.65
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786098956060137-21165-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:36:37.549913 26028 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:36:37.551558 26028 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:36:37.564003 26034 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:36:37.563918 26033 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:36:37.564244 26036 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:36:37.565083 26028 server_base.cc:1034] running on GCE node
I20260807 10:36:37.565646 26028 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:36:37.566614 26028 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:36:37.567855 26028 hybrid_clock.cc:648] HybridClock initialized: now 1786098997567805 us; error 36 us; skew 500 ppm
I20260807 10:36:37.568172 26028 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 10:36:37.570330 26028 webserver.cc:460] Webserver started at http://127.20.171.65:40659/ using document root <none> and password file <none>
I20260807 10:36:37.571043 26028 fs_manager.cc:359] Metadata directory not provided
I20260807 10:36:37.571178 26028 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:36:37.571496 26028 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:36:37.574316 26028 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786098956060137-21165-0/minicluster-data/ts-0/data/instance:
uuid: "385549fdcfb3458d969928cbe118a868"
format_stamp: "Formatted at 2026-08-07 10:36:37 on dist-test-slave-0b58"
server_key: "f398b7e5e1fe52141e6983d0902b76a1"
server_key_iv: "ecd833dd91d3cea6d2eae8e7f440646b"
server_key_version: "encryptionkey@0"
I20260807 10:36:37.575080 26028 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786098956060137-21165-0/minicluster-data/ts-0/wal/instance:
uuid: "385549fdcfb3458d969928cbe118a868"
format_stamp: "Formatted at 2026-08-07 10:36:37 on dist-test-slave-0b58"
server_key: "f398b7e5e1fe52141e6983d0902b76a1"
server_key_iv: "ecd833dd91d3cea6d2eae8e7f440646b"
server_key_version: "encryptionkey@0"
I20260807 10:36:37.580154 26028 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.003s
I20260807 10:36:37.583511 26042 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:36:37.584877 26028 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 10:36:37.585047 26028 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786098956060137-21165-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786098956060137-21165-0/minicluster-data/ts-0/wal
uuid: "385549fdcfb3458d969928cbe118a868"
format_stamp: "Formatted at 2026-08-07 10:36:37 on dist-test-slave-0b58"
server_key: "f398b7e5e1fe52141e6983d0902b76a1"
server_key_iv: "ecd833dd91d3cea6d2eae8e7f440646b"
server_key_version: "encryptionkey@0"
I20260807 10:36:37.585258 26028 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786098956060137-21165-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786098956060137-21165-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786098956060137-21165-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:36:37.590847 26028 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:36:37.591574 26028 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:36:37.591841 26028 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:36:37.592846 26028 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:36:37.594251 26028 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:36:37.594386 26028 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:36:37.594511 26028 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:36:37.594609 26028 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:36:37.626457 26028 rpc_server.cc:307] RPC server started. Bound to: 127.20.171.65:42463
I20260807 10:36:37.626538 26155 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.171.65:42463 every 8 connection(s)
I20260807 10:36:37.627755 26028 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786098956060137-21165-0/minicluster-data/ts-0/data/info.pb
I20260807 10:36:37.635196 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 26028
I20260807 10:36:37.635406 21165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786098956060137-21165-0/minicluster-data/ts-0/wal/instance
I20260807 10:36:37.635824 26158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:37.630283 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.65:54537 (local address 127.20.171.126:46241)
0807 10:36:37.630732 (+ 449us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:37.630737 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:37.631726 (+ 989us) server_negotiation.cc:407] Connection header received
0807 10:36:37.633591 (+ 1865us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:37.633596 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:37.633672 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:37.633785 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:36:37.635100 (+ 1315us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:36:37.635105 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:36:37.635108 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:36:37.635125 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:36:37.635171 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:36:37.635183 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:36:37.635320 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:37.635542 (+ 222us) server_negotiation.cc:299] Negotiation successful
0807 10:36:37.635615 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":305,"thread_start_us":217,"threads_started":1}
I20260807 10:36:37.636222 21165 external_mini_cluster.cc:1428] Setting key d9b29dcfcbd4783e3443a9faba015c8b
I20260807 10:36:37.636940 26159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:37.630729 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:46241 (local address 127.20.171.65:54537)
0807 10:36:37.631578 (+ 849us) negotiation.cc:107] Waiting for socket to connect
0807 10:36:37.631621 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0807 10:36:37.633338 (+ 1717us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:36:37.633988 (+ 650us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:36:37.633995 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:36:37.634070 (+ 75us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:36:37.634738 (+ 668us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 10:36:37.634741 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:36:37.634790 (+ 49us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 10:36:37.634897 (+ 107us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:36:37.635293 (+ 396us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:36:37.635306 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:36:37.635315 (+ 9us) client_negotiation.cc:769] Sending connection context
0807 10:36:37.635606 (+ 291us) client_negotiation.cc:240] Negotiation successful
0807 10:36:37.635836 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":469,"thread_start_us":253,"threads_started":1}
I20260807 10:36:37.638260 26156 heartbeater.cc:347] Connected to a master server at 127.20.171.126:46241
I20260807 10:36:37.638517 26156 heartbeater.cc:464] Registering TS with master...
I20260807 10:36:37.639002 26156 heartbeater.cc:511] Master 127.20.171.126:46241 requested a full tablet report, sending...
I20260807 10:36:37.640462 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786098956060137-21165-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786098956060137-21165-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786098956060137-21165-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786098956060137-21165-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.171.66:0
--local_ip_for_outbound_sockets=127.20.171.66
--webserver_interface=127.20.171.66
--webserver_port=0
--tserver_master_addrs=127.20.171.126:46241
--builtin_ntp_servers=127.20.171.84:37661
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260807 10:36:37.640879 25967 ts_manager.cc:194] Registered new tserver with Master: 385549fdcfb3458d969928cbe118a868 (127.20.171.65:42463)
W20260807 10:36:37.954437 26160 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:36:37.954689 26160 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:36:37.954807 26160 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:36:37.961194 26160 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:36:37.961324 26160 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:36:37.961580 26160 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.171.66
I20260807 10:36:37.970395 26160 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.171.84:37661
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786098956060137-21165-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786098956060137-21165-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.171.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786098956060137-21165-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.171.66
--webserver_port=0
--tserver_master_addrs=127.20.171.126:46241
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.171.66
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786098956060137-21165-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:36:37.971724 26160 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:36:37.973599 26160 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:36:37.985764 26165 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:36:37.985802 26166 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:36:37.985806 26168 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:36:37.986963 26160 server_base.cc:1034] running on GCE node
I20260807 10:36:37.987558 26160 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:36:37.988560 26160 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:36:37.989776 26160 hybrid_clock.cc:648] HybridClock initialized: now 1786098997989748 us; error 45 us; skew 500 ppm
I20260807 10:36:37.990269 26160 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 10:36:37.992622 26160 webserver.cc:460] Webserver started at http://127.20.171.66:45111/ using document root <none> and password file <none>
I20260807 10:36:37.993278 26160 fs_manager.cc:359] Metadata directory not provided
I20260807 10:36:37.993428 26160 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:36:37.993743 26160 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:36:37.996344 26160 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786098956060137-21165-0/minicluster-data/ts-1/data/instance:
uuid: "a084a0e037ec4182ac0c6cd43cd3825a"
format_stamp: "Formatted at 2026-08-07 10:36:37 on dist-test-slave-0b58"
server_key: "00021d60eace196cc1ddbcdf8ae894fe"
server_key_iv: "7fa445346945b789b60c3a121a0a033a"
server_key_version: "encryptionkey@0"
I20260807 10:36:37.997157 26160 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786098956060137-21165-0/minicluster-data/ts-1/wal/instance:
uuid: "a084a0e037ec4182ac0c6cd43cd3825a"
format_stamp: "Formatted at 2026-08-07 10:36:37 on dist-test-slave-0b58"
server_key: "00021d60eace196cc1ddbcdf8ae894fe"
server_key_iv: "7fa445346945b789b60c3a121a0a033a"
server_key_version: "encryptionkey@0"
I20260807 10:36:38.002024 26160 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.001s
I20260807 10:36:38.005384 26174 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:36:38.006633 26160 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260807 10:36:38.006814 26160 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786098956060137-21165-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786098956060137-21165-0/minicluster-data/ts-1/wal
uuid: "a084a0e037ec4182ac0c6cd43cd3825a"
format_stamp: "Formatted at 2026-08-07 10:36:37 on dist-test-slave-0b58"
server_key: "00021d60eace196cc1ddbcdf8ae894fe"
server_key_iv: "7fa445346945b789b60c3a121a0a033a"
server_key_version: "encryptionkey@0"
I20260807 10:36:38.007027 26160 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786098956060137-21165-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786098956060137-21165-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786098956060137-21165-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:36:38.012521 26160 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:36:38.013271 26160 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:36:38.013548 26160 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:36:38.014416 26160 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:36:38.015663 26160 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:36:38.015785 26160 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:36:38.015908 26160 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:36:38.015990 26160 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:36:38.048873 26160 rpc_server.cc:307] RPC server started. Bound to: 127.20.171.66:36665
I20260807 10:36:38.048921 26288 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.171.66:36665 every 8 connection(s)
I20260807 10:36:38.050225 26160 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786098956060137-21165-0/minicluster-data/ts-1/data/info.pb
I20260807 10:36:38.053097 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 26160
I20260807 10:36:38.053256 21165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786098956060137-21165-0/minicluster-data/ts-1/wal/instance
I20260807 10:36:38.053727 21165 external_mini_cluster.cc:1428] Setting key 2a28374ac0e43346ebf796f5a0c2bed4
I20260807 10:36:38.056519 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786098956060137-21165-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786098956060137-21165-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786098956060137-21165-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786098956060137-21165-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.171.67:0
--local_ip_for_outbound_sockets=127.20.171.67
--webserver_interface=127.20.171.67
--webserver_port=0
--tserver_master_addrs=127.20.171.126:46241
--builtin_ntp_servers=127.20.171.84:37661
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260807 10:36:38.058475 26158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:38.052671 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.66:43217 (local address 127.20.171.126:46241)
0807 10:36:38.052910 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:38.052918 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:38.054409 (+ 1491us) server_negotiation.cc:407] Connection header received
0807 10:36:38.056147 (+ 1738us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:38.056155 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:38.056229 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:38.056386 (+ 157us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:36:38.057634 (+ 1248us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:36:38.057642 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:36:38.057650 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:36:38.057673 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:36:38.057719 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:36:38.057737 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:36:38.057877 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:38.058040 (+ 163us) server_negotiation.cc:299] Negotiation successful
0807 10:36:38.058106 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260807 10:36:38.059209 26291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:38.053225 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:46241 (local address 127.20.171.66:43217)
0807 10:36:38.054248 (+ 1023us) negotiation.cc:107] Waiting for socket to connect
0807 10:36:38.054296 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0807 10:36:38.055905 (+ 1609us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:36:38.056550 (+ 645us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:36:38.056556 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:36:38.056658 (+ 102us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:36:38.057326 (+ 668us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 10:36:38.057328 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:36:38.057364 (+ 36us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 10:36:38.057450 (+ 86us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:36:38.057848 (+ 398us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:36:38.057856 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:36:38.057861 (+ 5us) client_negotiation.cc:769] Sending connection context
0807 10:36:38.058064 (+ 203us) client_negotiation.cc:240] Negotiation successful
0807 10:36:38.058237 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":550,"thread_start_us":336,"threads_started":1}
I20260807 10:36:38.060499 26289 heartbeater.cc:347] Connected to a master server at 127.20.171.126:46241
I20260807 10:36:38.060801 26289 heartbeater.cc:464] Registering TS with master...
I20260807 10:36:38.061331 26289 heartbeater.cc:511] Master 127.20.171.126:46241 requested a full tablet report, sending...
I20260807 10:36:38.062619 25967 ts_manager.cc:194] Registered new tserver with Master: a084a0e037ec4182ac0c6cd43cd3825a (127.20.171.66:36665)
W20260807 10:36:38.383309 26292 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:36:38.383567 26292 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:36:38.383729 26292 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:36:38.390767 26292 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:36:38.390857 26292 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:36:38.391032 26292 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.171.67
I20260807 10:36:38.399638 26292 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.171.84:37661
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786098956060137-21165-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786098956060137-21165-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.171.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786098956060137-21165-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.171.67
--webserver_port=0
--tserver_master_addrs=127.20.171.126:46241
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.171.67
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786098956060137-21165-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:36:38.400851 26292 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:36:38.402597 26292 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:36:38.415827 26300 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:36:38.415782 26298 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:36:38.416353 26297 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:36:38.416646 26292 server_base.cc:1034] running on GCE node
I20260807 10:36:38.417237 26292 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:36:38.418079 26292 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:36:38.419271 26292 hybrid_clock.cc:648] HybridClock initialized: now 1786098998419234 us; error 27 us; skew 500 ppm
I20260807 10:36:38.419538 26292 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 10:36:38.421679 26292 webserver.cc:460] Webserver started at http://127.20.171.67:34857/ using document root <none> and password file <none>
I20260807 10:36:38.422284 26292 fs_manager.cc:359] Metadata directory not provided
I20260807 10:36:38.422369 26292 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:36:38.422639 26292 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:36:38.425379 26292 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786098956060137-21165-0/minicluster-data/ts-2/data/instance:
uuid: "bc38b39020884b1d9d4b81e8b0a72c32"
format_stamp: "Formatted at 2026-08-07 10:36:38 on dist-test-slave-0b58"
server_key: "7badc33158381927890c56b5d577d556"
server_key_iv: "98fef05ff3a35a5bea11d8dd674582dd"
server_key_version: "encryptionkey@0"
I20260807 10:36:38.426087 26292 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786098956060137-21165-0/minicluster-data/ts-2/wal/instance:
uuid: "bc38b39020884b1d9d4b81e8b0a72c32"
format_stamp: "Formatted at 2026-08-07 10:36:38 on dist-test-slave-0b58"
server_key: "7badc33158381927890c56b5d577d556"
server_key_iv: "98fef05ff3a35a5bea11d8dd674582dd"
server_key_version: "encryptionkey@0"
I20260807 10:36:38.431262 26292 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260807 10:36:38.434710 26306 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:36:38.435928 26292 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 10:36:38.436039 26292 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786098956060137-21165-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786098956060137-21165-0/minicluster-data/ts-2/wal
uuid: "bc38b39020884b1d9d4b81e8b0a72c32"
format_stamp: "Formatted at 2026-08-07 10:36:38 on dist-test-slave-0b58"
server_key: "7badc33158381927890c56b5d577d556"
server_key_iv: "98fef05ff3a35a5bea11d8dd674582dd"
server_key_version: "encryptionkey@0"
I20260807 10:36:38.436199 26292 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786098956060137-21165-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786098956060137-21165-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786098956060137-21165-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:36:38.441175 26292 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:36:38.441883 26292 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:36:38.442102 26292 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:36:38.442909 26292 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:36:38.444232 26292 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:36:38.444355 26292 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:36:38.444435 26292 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:36:38.444489 26292 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:36:38.477486 26292 rpc_server.cc:307] RPC server started. Bound to: 127.20.171.67:44061
I20260807 10:36:38.477583 26419 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.171.67:44061 every 8 connection(s)
I20260807 10:36:38.478865 26292 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786098956060137-21165-0/minicluster-data/ts-2/data/info.pb
I20260807 10:36:38.480511 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 26292
I20260807 10:36:38.480664 21165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786098956060137-21165-0/minicluster-data/ts-2/wal/instance
I20260807 10:36:38.481194 21165 external_mini_cluster.cc:1428] Setting key 5187e91b7212330da3267c9fff5dff7c
I20260807 10:36:38.486986 26158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:38.481585 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.67:48351 (local address 127.20.171.126:46241)
0807 10:36:38.481802 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:38.481808 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:38.483333 (+ 1525us) server_negotiation.cc:407] Connection header received
0807 10:36:38.485067 (+ 1734us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:38.485071 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:38.485122 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:38.485203 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:36:38.486406 (+ 1203us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:36:38.486410 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:36:38.486413 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:36:38.486428 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:36:38.486460 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:36:38.486472 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:36:38.486560 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:38.486735 (+ 175us) server_negotiation.cc:299] Negotiation successful
0807 10:36:38.486783 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260807 10:36:38.487841 26422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:38.482067 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:46241 (local address 127.20.171.67:48351)
0807 10:36:38.483166 (+ 1099us) negotiation.cc:107] Waiting for socket to connect
0807 10:36:38.483218 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0807 10:36:38.484841 (+ 1623us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:36:38.485393 (+ 552us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:36:38.485400 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:36:38.485479 (+ 79us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:36:38.486123 (+ 644us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 10:36:38.486126 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:36:38.486175 (+ 49us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 10:36:38.486256 (+ 81us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:36:38.486556 (+ 300us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:36:38.486564 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:36:38.486569 (+ 5us) client_negotiation.cc:769] Sending connection context
0807 10:36:38.486778 (+ 209us) client_negotiation.cc:240] Negotiation successful
0807 10:36:38.486952 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":597,"thread_start_us":359,"threads_started":1}
I20260807 10:36:38.489135 26420 heartbeater.cc:347] Connected to a master server at 127.20.171.126:46241
I20260807 10:36:38.489483 26420 heartbeater.cc:464] Registering TS with master...
I20260807 10:36:38.490103 26420 heartbeater.cc:511] Master 127.20.171.126:46241 requested a full tablet report, sending...
I20260807 10:36:38.491431 25967 ts_manager.cc:194] Registered new tserver with Master: bc38b39020884b1d9d4b81e8b0a72c32 (127.20.171.67:44061)
I20260807 10:36:38.496459 21165 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 10:36:38.503175 26158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:38.500818 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38620 (local address 127.20.171.126:46241)
0807 10:36:38.500973 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:38.500977 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:38.501500 (+ 523us) server_negotiation.cc:407] Connection header received
0807 10:36:38.501616 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:38.501619 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:38.501667 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:38.501742 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:36:38.502654 (+ 912us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:36:38.502658 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:36:38.502661 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:36:38.502673 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:36:38.502701 (+ 28us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:36:38.502713 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:36:38.502802 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:38.502837 (+ 35us) server_negotiation.cc:299] Negotiation successful
0807 10:36:38.502879 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260807 10:36:38.507184 25967 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38620:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 10:36:38.515369 25967 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 10:36:38.544873 26437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:38.527016 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.65:42463 (local address 127.0.0.1:46964)
0807 10:36:38.536190 (+ 9174us) negotiation.cc:107] Waiting for socket to connect
0807 10:36:38.536237 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0807 10:36:38.537052 (+ 815us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:36:38.541716 (+ 4664us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:36:38.541724 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:36:38.541816 (+ 92us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:36:38.542759 (+ 943us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 10:36:38.542765 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:36:38.542804 (+ 39us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 10:36:38.542925 (+ 121us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:36:38.543887 (+ 962us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:36:38.543902 (+ 15us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:36:38.543914 (+ 12us) client_negotiation.cc:769] Sending connection context
0807 10:36:38.544136 (+ 222us) client_negotiation.cc:240] Negotiation successful
0807 10:36:38.544288 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8940,"threads_started":1}
I20260807 10:36:38.544896 26436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:38.527618 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34120 (local address 127.20.171.67:44061)
0807 10:36:38.540522 (+ 12904us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:38.540530 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:38.540566 (+ 36us) server_negotiation.cc:407] Connection header received
0807 10:36:38.540638 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:38.540646 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:38.540851 (+ 205us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:38.540991 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:36:38.543478 (+ 2487us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:36:38.543493 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:36:38.543514 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:36:38.543541 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:36:38.543625 (+ 84us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:36:38.543650 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:36:38.543884 (+ 234us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:38.544183 (+ 299us) server_negotiation.cc:299] Negotiation successful
0807 10:36:38.544335 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12738,"thread_start_us":12674,"threads_started":1}
I20260807 10:36:38.546665 26434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:38.527248 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46964 (local address 127.20.171.65:42463)
0807 10:36:38.539939 (+ 12691us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:38.539948 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:38.539976 (+ 28us) server_negotiation.cc:407] Connection header received
0807 10:36:38.540050 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:38.540061 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:38.540667 (+ 606us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:38.540851 (+ 184us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:36:38.543506 (+ 2655us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:36:38.543520 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:36:38.543538 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:36:38.543565 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:36:38.543639 (+ 74us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:36:38.543666 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:36:38.543822 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:38.546211 (+ 2389us) server_negotiation.cc:299] Negotiation successful
0807 10:36:38.546317 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12517,"thread_start_us":12588,"threads_started":1}
I20260807 10:36:38.546047 26435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:38.527467 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.67:44061 (local address 127.0.0.1:34120)
0807 10:36:38.539646 (+ 12179us) negotiation.cc:107] Waiting for socket to connect
0807 10:36:38.539668 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0807 10:36:38.539774 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:36:38.542020 (+ 2246us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:36:38.542027 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:36:38.542053 (+ 26us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:36:38.543204 (+ 1151us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 10:36:38.543210 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:36:38.543229 (+ 19us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 10:36:38.543277 (+ 48us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:36:38.543961 (+ 684us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:36:38.543969 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:36:38.543978 (+ 9us) client_negotiation.cc:769] Sending connection context
0807 10:36:38.545441 (+ 1463us) client_negotiation.cc:240] Negotiation successful
0807 10:36:38.545518 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11994,"spinlock_wait_cycles":7424,"thread_start_us":11975,"threads_started":1}
I20260807 10:36:38.550273 26438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:38.530062 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49614 (local address 127.20.171.66:36665)
0807 10:36:38.546258 (+ 16196us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:38.546267 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:38.547001 (+ 734us) server_negotiation.cc:407] Connection header received
0807 10:36:38.547244 (+ 243us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:38.547252 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:38.547462 (+ 210us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:38.547573 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:36:38.549453 (+ 1880us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:36:38.549462 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:36:38.549474 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:36:38.549501 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:36:38.549558 (+ 57us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:36:38.549577 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:36:38.549753 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:38.549820 (+ 67us) server_negotiation.cc:299] Negotiation successful
0807 10:36:38.549922 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15992,"thread_start_us":16191,"threads_started":1}
I20260807 10:36:38.550318 26433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:38.529392 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.66:36665 (local address 127.0.0.1:49614)
0807 10:36:38.546877 (+ 17485us) negotiation.cc:107] Waiting for socket to connect
0807 10:36:38.546898 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0807 10:36:38.547093 (+ 195us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:36:38.548418 (+ 1325us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:36:38.548422 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:36:38.548444 (+ 22us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:36:38.549212 (+ 768us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 10:36:38.549218 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:36:38.549234 (+ 16us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 10:36:38.549284 (+ 50us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:36:38.549696 (+ 412us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:36:38.549700 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:36:38.549705 (+ 5us) client_negotiation.cc:769] Sending connection context
0807 10:36:38.549834 (+ 129us) client_negotiation.cc:240] Negotiation successful
0807 10:36:38.549896 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":17349,"thread_start_us":6416,"threads_started":1}
I20260807 10:36:38.551079 26354 tablet_service.cc:1467] Processing CreateTablet for tablet bd14a687859744899326191888b67869 (DEFAULT_TABLE table=test-table [id=d34694402f9d4e60828dd3372e119742]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:36:38.551141 26090 tablet_service.cc:1467] Processing CreateTablet for tablet bd14a687859744899326191888b67869 (DEFAULT_TABLE table=test-table [id=d34694402f9d4e60828dd3372e119742]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:36:38.552810 26090 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bd14a687859744899326191888b67869. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:36:38.552898 26354 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bd14a687859744899326191888b67869. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:36:38.554365 26223 tablet_service.cc:1467] Processing CreateTablet for tablet bd14a687859744899326191888b67869 (DEFAULT_TABLE table=test-table [id=d34694402f9d4e60828dd3372e119742]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:36:38.555722 26223 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bd14a687859744899326191888b67869. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:36:38.564056 26439 tablet_bootstrap.cc:492] T bd14a687859744899326191888b67869 P bc38b39020884b1d9d4b81e8b0a72c32: Bootstrap starting.
I20260807 10:36:38.567145 26440 tablet_bootstrap.cc:492] T bd14a687859744899326191888b67869 P 385549fdcfb3458d969928cbe118a868: Bootstrap starting.
I20260807 10:36:38.568104 26439 tablet_bootstrap.cc:654] T bd14a687859744899326191888b67869 P bc38b39020884b1d9d4b81e8b0a72c32: Neither blocks nor log segments found. Creating new log.
I20260807 10:36:38.569463 26439 log.cc:824] T bd14a687859744899326191888b67869 P bc38b39020884b1d9d4b81e8b0a72c32: Log is configured to *not* fsync() on all Append() calls
I20260807 10:36:38.569527 26441 tablet_bootstrap.cc:492] T bd14a687859744899326191888b67869 P a084a0e037ec4182ac0c6cd43cd3825a: Bootstrap starting.
I20260807 10:36:38.570904 26440 tablet_bootstrap.cc:654] T bd14a687859744899326191888b67869 P 385549fdcfb3458d969928cbe118a868: Neither blocks nor log segments found. Creating new log.
I20260807 10:36:38.572183 26440 log.cc:824] T bd14a687859744899326191888b67869 P 385549fdcfb3458d969928cbe118a868: Log is configured to *not* fsync() on all Append() calls
I20260807 10:36:38.572710 26441 tablet_bootstrap.cc:654] T bd14a687859744899326191888b67869 P a084a0e037ec4182ac0c6cd43cd3825a: Neither blocks nor log segments found. Creating new log.
I20260807 10:36:38.573230 26439 tablet_bootstrap.cc:492] T bd14a687859744899326191888b67869 P bc38b39020884b1d9d4b81e8b0a72c32: No bootstrap required, opened a new log
I20260807 10:36:38.573580 26439 ts_tablet_manager.cc:1397] T bd14a687859744899326191888b67869 P bc38b39020884b1d9d4b81e8b0a72c32: Time spent bootstrapping tablet: real 0.010s user 0.006s sys 0.002s
I20260807 10:36:38.573948 26441 log.cc:824] T bd14a687859744899326191888b67869 P a084a0e037ec4182ac0c6cd43cd3825a: Log is configured to *not* fsync() on all Append() calls
I20260807 10:36:38.575911 26440 tablet_bootstrap.cc:492] T bd14a687859744899326191888b67869 P 385549fdcfb3458d969928cbe118a868: No bootstrap required, opened a new log
I20260807 10:36:38.576193 26440 ts_tablet_manager.cc:1397] T bd14a687859744899326191888b67869 P 385549fdcfb3458d969928cbe118a868: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20260807 10:36:38.580835 26441 tablet_bootstrap.cc:492] T bd14a687859744899326191888b67869 P a084a0e037ec4182ac0c6cd43cd3825a: No bootstrap required, opened a new log
I20260807 10:36:38.581101 26441 ts_tablet_manager.cc:1397] T bd14a687859744899326191888b67869 P a084a0e037ec4182ac0c6cd43cd3825a: Time spent bootstrapping tablet: real 0.012s user 0.011s sys 0.000s
I20260807 10:36:38.584565 26439 raft_consensus.cc:348] T bd14a687859744899326191888b67869 P bc38b39020884b1d9d4b81e8b0a72c32 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "385549fdcfb3458d969928cbe118a868" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 42463 } } peers { permanent_uuid: "bc38b39020884b1d9d4b81e8b0a72c32" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 44061 } } peers { permanent_uuid: "a084a0e037ec4182ac0c6cd43cd3825a" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 36665 } }
I20260807 10:36:38.585103 26439 raft_consensus.cc:374] T bd14a687859744899326191888b67869 P bc38b39020884b1d9d4b81e8b0a72c32 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:36:38.585206 26439 raft_consensus.cc:729] T bd14a687859744899326191888b67869 P bc38b39020884b1d9d4b81e8b0a72c32 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc38b39020884b1d9d4b81e8b0a72c32, State: Initialized, Role: FOLLOWER
I20260807 10:36:38.585830 26439 consensus_queue.cc:260] T bd14a687859744899326191888b67869 P bc38b39020884b1d9d4b81e8b0a72c32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "385549fdcfb3458d969928cbe118a868" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 42463 } } peers { permanent_uuid: "bc38b39020884b1d9d4b81e8b0a72c32" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 44061 } } peers { permanent_uuid: "a084a0e037ec4182ac0c6cd43cd3825a" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 36665 } }
I20260807 10:36:38.586984 26420 heartbeater.cc:503] Master 127.20.171.126:46241 was elected leader, sending a full tablet report...
I20260807 10:36:38.586871 26440 raft_consensus.cc:348] T bd14a687859744899326191888b67869 P 385549fdcfb3458d969928cbe118a868 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "385549fdcfb3458d969928cbe118a868" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 42463 } } peers { permanent_uuid: "bc38b39020884b1d9d4b81e8b0a72c32" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 44061 } } peers { permanent_uuid: "a084a0e037ec4182ac0c6cd43cd3825a" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 36665 } }
I20260807 10:36:38.587302 26440 raft_consensus.cc:374] T bd14a687859744899326191888b67869 P 385549fdcfb3458d969928cbe118a868 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:36:38.587415 26440 raft_consensus.cc:729] T bd14a687859744899326191888b67869 P 385549fdcfb3458d969928cbe118a868 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 385549fdcfb3458d969928cbe118a868, State: Initialized, Role: FOLLOWER
I20260807 10:36:38.587769 26439 ts_tablet_manager.cc:1428] T bd14a687859744899326191888b67869 P bc38b39020884b1d9d4b81e8b0a72c32: Time spent starting tablet: real 0.014s user 0.004s sys 0.008s
I20260807 10:36:38.588094 26440 consensus_queue.cc:260] T bd14a687859744899326191888b67869 P 385549fdcfb3458d969928cbe118a868 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "385549fdcfb3458d969928cbe118a868" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 42463 } } peers { permanent_uuid: "bc38b39020884b1d9d4b81e8b0a72c32" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 44061 } } peers { permanent_uuid: "a084a0e037ec4182ac0c6cd43cd3825a" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 36665 } }
I20260807 10:36:38.589607 26156 heartbeater.cc:503] Master 127.20.171.126:46241 was elected leader, sending a full tablet report...
I20260807 10:36:38.590235 26440 ts_tablet_manager.cc:1428] T bd14a687859744899326191888b67869 P 385549fdcfb3458d969928cbe118a868: Time spent starting tablet: real 0.014s user 0.010s sys 0.003s
I20260807 10:36:38.590832 26441 raft_consensus.cc:348] T bd14a687859744899326191888b67869 P a084a0e037ec4182ac0c6cd43cd3825a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "385549fdcfb3458d969928cbe118a868" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 42463 } } peers { permanent_uuid: "bc38b39020884b1d9d4b81e8b0a72c32" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 44061 } } peers { permanent_uuid: "a084a0e037ec4182ac0c6cd43cd3825a" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 36665 } }
I20260807 10:36:38.591328 26441 raft_consensus.cc:374] T bd14a687859744899326191888b67869 P a084a0e037ec4182ac0c6cd43cd3825a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:36:38.591437 26441 raft_consensus.cc:729] T bd14a687859744899326191888b67869 P a084a0e037ec4182ac0c6cd43cd3825a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a084a0e037ec4182ac0c6cd43cd3825a, State: Initialized, Role: FOLLOWER
I20260807 10:36:38.592052 26441 consensus_queue.cc:260] T bd14a687859744899326191888b67869 P a084a0e037ec4182ac0c6cd43cd3825a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "385549fdcfb3458d969928cbe118a868" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 42463 } } peers { permanent_uuid: "bc38b39020884b1d9d4b81e8b0a72c32" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 44061 } } peers { permanent_uuid: "a084a0e037ec4182ac0c6cd43cd3825a" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 36665 } }
I20260807 10:36:38.593231 26289 heartbeater.cc:503] Master 127.20.171.126:46241 was elected leader, sending a full tablet report...
I20260807 10:36:38.593799 26441 ts_tablet_manager.cc:1428] T bd14a687859744899326191888b67869 P a084a0e037ec4182ac0c6cd43cd3825a: Time spent starting tablet: real 0.013s user 0.011s sys 0.000s
W20260807 10:36:38.629998 26157 tablet.cc:2369] T bd14a687859744899326191888b67869 P 385549fdcfb3458d969928cbe118a868: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 10:36:38.633131 26445 raft_consensus.cc:482] T bd14a687859744899326191888b67869 P bc38b39020884b1d9d4b81e8b0a72c32 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 10:36:38.633411 26445 raft_consensus.cc:504] T bd14a687859744899326191888b67869 P bc38b39020884b1d9d4b81e8b0a72c32 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "385549fdcfb3458d969928cbe118a868" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 42463 } } peers { permanent_uuid: "bc38b39020884b1d9d4b81e8b0a72c32" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 44061 } } peers { permanent_uuid: "a084a0e037ec4182ac0c6cd43cd3825a" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 36665 } }
I20260807 10:36:38.635054 26445 leader_election.cc:288] T bd14a687859744899326191888b67869 P bc38b39020884b1d9d4b81e8b0a72c32 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 385549fdcfb3458d969928cbe118a868 (127.20.171.65:42463), a084a0e037ec4182ac0c6cd43cd3825a (127.20.171.66:36665)
I20260807 10:36:38.638168 26422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:38.635275 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.65:42463 (local address 127.20.171.67:34765)
0807 10:36:38.635755 (+ 480us) negotiation.cc:107] Waiting for socket to connect
0807 10:36:38.635773 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 10:36:38.635880 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:36:38.636554 (+ 674us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:36:38.636558 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:36:38.636583 (+ 25us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:36:38.637325 (+ 742us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 10:36:38.637329 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:36:38.637347 (+ 18us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 10:36:38.637394 (+ 47us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:36:38.637752 (+ 358us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:36:38.637757 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:36:38.637762 (+ 5us) client_negotiation.cc:769] Sending connection context
0807 10:36:38.637869 (+ 107us) client_negotiation.cc:240] Negotiation successful
0807 10:36:38.637923 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":343}
I20260807 10:36:38.638190 26434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:38.636076 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.67:34765 (local address 127.20.171.65:42463)
0807 10:36:38.636239 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:38.636245 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:38.636263 (+ 18us) server_negotiation.cc:407] Connection header received
0807 10:36:38.636340 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:38.636345 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:38.636397 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:38.636489 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:36:38.637534 (+ 1045us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:36:38.637541 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:36:38.637547 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:36:38.637569 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:36:38.637612 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:36:38.637629 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:36:38.637782 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:38.637866 (+ 84us) server_negotiation.cc:299] Negotiation successful
0807 10:36:38.637930 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260807 10:36:38.638854 26438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:38.635655 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.67:33119 (local address 127.20.171.66:36665)
0807 10:36:38.635884 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:38.635893 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:38.636519 (+ 626us) server_negotiation.cc:407] Connection header received
0807 10:36:38.636778 (+ 259us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:38.636784 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:38.636842 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:38.636951 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:36:38.637881 (+ 930us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:36:38.637888 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:36:38.637894 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:36:38.637914 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:36:38.637953 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:36:38.637971 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:36:38.638069 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:38.638535 (+ 466us) server_negotiation.cc:299] Negotiation successful
0807 10:36:38.638601 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260807 10:36:38.639040 26448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:38.635560 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.66:36665 (local address 127.20.171.67:33119)
0807 10:36:38.636405 (+ 845us) negotiation.cc:107] Waiting for socket to connect
0807 10:36:38.636419 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 10:36:38.636594 (+ 175us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:36:38.636977 (+ 383us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:36:38.636982 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:36:38.637005 (+ 23us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:36:38.637677 (+ 672us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 10:36:38.637680 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:36:38.637694 (+ 14us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 10:36:38.637730 (+ 36us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:36:38.638160 (+ 430us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:36:38.638163 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:36:38.638165 (+ 2us) client_negotiation.cc:769] Sending connection context
0807 10:36:38.638546 (+ 381us) client_negotiation.cc:240] Negotiation successful
0807 10:36:38.638601 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":746,"thread_start_us":514,"threads_started":1}
I20260807 10:36:38.639137 26110 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd14a687859744899326191888b67869" candidate_uuid: "bc38b39020884b1d9d4b81e8b0a72c32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "385549fdcfb3458d969928cbe118a868" is_pre_election: true
I20260807 10:36:38.639742 26110 raft_consensus.cc:2454] T bd14a687859744899326191888b67869 P 385549fdcfb3458d969928cbe118a868 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc38b39020884b1d9d4b81e8b0a72c32 in term 0.
I20260807 10:36:38.640062 26243 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd14a687859744899326191888b67869" candidate_uuid: "bc38b39020884b1d9d4b81e8b0a72c32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a084a0e037ec4182ac0c6cd43cd3825a" is_pre_election: true
I20260807 10:36:38.640514 26307 leader_election.cc:302] T bd14a687859744899326191888b67869 P bc38b39020884b1d9d4b81e8b0a72c32 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 385549fdcfb3458d969928cbe118a868, bc38b39020884b1d9d4b81e8b0a72c32; no voters:
I20260807 10:36:38.640642 26243 raft_consensus.cc:2454] T bd14a687859744899326191888b67869 P a084a0e037ec4182ac0c6cd43cd3825a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc38b39020884b1d9d4b81e8b0a72c32 in term 0.
I20260807 10:36:38.640964 26445 raft_consensus.cc:2781] T bd14a687859744899326191888b67869 P bc38b39020884b1d9d4b81e8b0a72c32 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 10:36:38.641109 26445 raft_consensus.cc:482] T bd14a687859744899326191888b67869 P bc38b39020884b1d9d4b81e8b0a72c32 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 10:36:38.641233 26445 raft_consensus.cc:3037] T bd14a687859744899326191888b67869 P bc38b39020884b1d9d4b81e8b0a72c32 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:36:38.643502 26445 raft_consensus.cc:504] T bd14a687859744899326191888b67869 P bc38b39020884b1d9d4b81e8b0a72c32 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "385549fdcfb3458d969928cbe118a868" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 42463 } } peers { permanent_uuid: "bc38b39020884b1d9d4b81e8b0a72c32" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 44061 } } peers { permanent_uuid: "a084a0e037ec4182ac0c6cd43cd3825a" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 36665 } }
I20260807 10:36:38.644065 26445 leader_election.cc:288] T bd14a687859744899326191888b67869 P bc38b39020884b1d9d4b81e8b0a72c32 [CANDIDATE]: Term 1 election: Requested vote from peers 385549fdcfb3458d969928cbe118a868 (127.20.171.65:42463), a084a0e037ec4182ac0c6cd43cd3825a (127.20.171.66:36665)
I20260807 10:36:38.644565 26243 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd14a687859744899326191888b67869" candidate_uuid: "bc38b39020884b1d9d4b81e8b0a72c32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a084a0e037ec4182ac0c6cd43cd3825a"
I20260807 10:36:38.644784 26243 raft_consensus.cc:3037] T bd14a687859744899326191888b67869 P a084a0e037ec4182ac0c6cd43cd3825a [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:36:38.644940 26110 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd14a687859744899326191888b67869" candidate_uuid: "bc38b39020884b1d9d4b81e8b0a72c32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "385549fdcfb3458d969928cbe118a868"
I20260807 10:36:38.645171 26110 raft_consensus.cc:3037] T bd14a687859744899326191888b67869 P 385549fdcfb3458d969928cbe118a868 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:36:38.648284 26243 raft_consensus.cc:2454] T bd14a687859744899326191888b67869 P a084a0e037ec4182ac0c6cd43cd3825a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc38b39020884b1d9d4b81e8b0a72c32 in term 1.
I20260807 10:36:38.648428 26110 raft_consensus.cc:2454] T bd14a687859744899326191888b67869 P 385549fdcfb3458d969928cbe118a868 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc38b39020884b1d9d4b81e8b0a72c32 in term 1.
I20260807 10:36:38.648721 26308 leader_election.cc:302] T bd14a687859744899326191888b67869 P bc38b39020884b1d9d4b81e8b0a72c32 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a084a0e037ec4182ac0c6cd43cd3825a, bc38b39020884b1d9d4b81e8b0a72c32; no voters:
I20260807 10:36:38.649055 26445 raft_consensus.cc:2781] T bd14a687859744899326191888b67869 P bc38b39020884b1d9d4b81e8b0a72c32 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:36:38.649466 26445 raft_consensus.cc:686] T bd14a687859744899326191888b67869 P bc38b39020884b1d9d4b81e8b0a72c32 [term 1 LEADER]: Becoming Leader. State: Replica: bc38b39020884b1d9d4b81e8b0a72c32, State: Running, Role: LEADER
I20260807 10:36:38.649997 26445 consensus_queue.cc:237] T bd14a687859744899326191888b67869 P bc38b39020884b1d9d4b81e8b0a72c32 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "385549fdcfb3458d969928cbe118a868" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 42463 } } peers { permanent_uuid: "bc38b39020884b1d9d4b81e8b0a72c32" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 44061 } } peers { permanent_uuid: "a084a0e037ec4182ac0c6cd43cd3825a" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 36665 } }
I20260807 10:36:38.654489 25966 catalog_manager.cc:5495] T bd14a687859744899326191888b67869 P bc38b39020884b1d9d4b81e8b0a72c32 reported cstate change: term changed from 0 to 1, leader changed from <none> to bc38b39020884b1d9d4b81e8b0a72c32 (127.20.171.67). New cstate: current_term: 1 leader_uuid: "bc38b39020884b1d9d4b81e8b0a72c32" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "385549fdcfb3458d969928cbe118a868" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 42463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc38b39020884b1d9d4b81e8b0a72c32" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 44061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a084a0e037ec4182ac0c6cd43cd3825a" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 36665 } health_report { overall_health: UNKNOWN } } }
I20260807 10:36:38.695983 26436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:38.693904 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34128 (local address 127.20.171.67:44061)
0807 10:36:38.694091 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:38.694095 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:38.694316 (+ 221us) server_negotiation.cc:407] Connection header received
0807 10:36:38.694463 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:38.694466 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:38.694543 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:38.694617 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:36:38.695427 (+ 810us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:36:38.695431 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:36:38.695434 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:36:38.695448 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:36:38.695478 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:36:38.695490 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:36:38.695583 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:38.695646 (+ 63us) server_negotiation.cc:299] Negotiation successful
0807 10:36:38.695698 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260807 10:36:38.704151 26243 raft_consensus.cc:1261] T bd14a687859744899326191888b67869 P a084a0e037ec4182ac0c6cd43cd3825a [term 1 FOLLOWER]: Refusing update from remote peer bc38b39020884b1d9d4b81e8b0a72c32: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 10:36:38.704151 26110 raft_consensus.cc:1261] T bd14a687859744899326191888b67869 P 385549fdcfb3458d969928cbe118a868 [term 1 FOLLOWER]: Refusing update from remote peer bc38b39020884b1d9d4b81e8b0a72c32: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 10:36:38.705147 26449 consensus_queue.cc:1035] T bd14a687859744899326191888b67869 P bc38b39020884b1d9d4b81e8b0a72c32 [LEADER]: Connected to new peer: Peer: permanent_uuid: "385549fdcfb3458d969928cbe118a868" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 42463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 10:36:38.705565 26445 consensus_queue.cc:1035] T bd14a687859744899326191888b67869 P bc38b39020884b1d9d4b81e8b0a72c32 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a084a0e037ec4182ac0c6cd43cd3825a" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 36665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 10:36:38.717161 26452 mvcc.cc:205] Tried to move back new op lower bound from 7315861498681298944 to 7315861498474504192. Current Snapshot: MvccSnapshot[applied={T|T < 7315861498681298944}]
I20260807 10:36:38.722443 26453 mvcc.cc:205] Tried to move back new op lower bound from 7315861498681298944 to 7315861498474504192. Current Snapshot: MvccSnapshot[applied={T|T < 7315861498681298944}]
I20260807 10:36:38.731458 25966 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:38620:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 10:36:38.731767 25966 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:38620:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 10:36:38.735585 25966 catalog_manager.cc:5782] T 00000000000000000000000000000000 P cdbd36fb7d554a3cbd3e59d5bc3597c0: Sending DeleteTablet for 3 replicas of tablet bd14a687859744899326191888b67869
I20260807 10:36:38.736778 26354 tablet_service.cc:1514] Processing DeleteTablet for tablet bd14a687859744899326191888b67869 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:36:38 UTC) from {username='slave'} at 127.0.0.1:34120
I20260807 10:36:38.736780 26090 tablet_service.cc:1514] Processing DeleteTablet for tablet bd14a687859744899326191888b67869 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:36:38 UTC) from {username='slave'} at 127.0.0.1:46964
I20260807 10:36:38.737226 26223 tablet_service.cc:1514] Processing DeleteTablet for tablet bd14a687859744899326191888b67869 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:36:38 UTC) from {username='slave'} at 127.0.0.1:49614
I20260807 10:36:38.739940 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 26028
I20260807 10:36:38.747530 26463 tablet_replica.cc:330] T bd14a687859744899326191888b67869 P a084a0e037ec4182ac0c6cd43cd3825a: stopping tablet replica
I20260807 10:36:38.748073 26463 raft_consensus.cc:2229] T bd14a687859744899326191888b67869 P a084a0e037ec4182ac0c6cd43cd3825a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 10:36:38.748656 26463 raft_consensus.cc:2258] T bd14a687859744899326191888b67869 P a084a0e037ec4182ac0c6cd43cd3825a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:36:38.753547 26463 ts_tablet_manager.cc:1905] T bd14a687859744899326191888b67869 P a084a0e037ec4182ac0c6cd43cd3825a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 10:36:38.755913 26461 tablet_replica.cc:330] T bd14a687859744899326191888b67869 P bc38b39020884b1d9d4b81e8b0a72c32: stopping tablet replica
I20260807 10:36:38.756441 26461 raft_consensus.cc:2229] T bd14a687859744899326191888b67869 P bc38b39020884b1d9d4b81e8b0a72c32 [term 1 LEADER]: Raft consensus shutting down.
I20260807 10:36:38.757046 26434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:38.742174 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46978 (local address 127.20.171.65:42463)
0807 10:36:38.742429 (+ 255us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:38.742438 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:38.754423 (+ 11985us) server_negotiation.cc:407] Connection header received
0807 10:36:38.754836 (+ 413us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:38.754841 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:38.754939 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:38.755009 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:36:38.756178 (+ 1169us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:36:38.756184 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:36:38.756188 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:36:38.756208 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:36:38.756260 (+ 52us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:36:38.756303 (+ 43us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:36:38.756402 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:38.756643 (+ 241us) server_negotiation.cc:299] Negotiation successful
0807 10:36:38.756719 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":101}
I20260807 10:36:38.757954 26461 raft_consensus.cc:2258] T bd14a687859744899326191888b67869 P bc38b39020884b1d9d4b81e8b0a72c32 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:36:38.758132 26151 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:36:38.761646 26461 ts_tablet_manager.cc:1905] T bd14a687859744899326191888b67869 P bc38b39020884b1d9d4b81e8b0a72c32: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 10:36:38.771879 26461 ts_tablet_manager.cc:1918] T bd14a687859744899326191888b67869 P bc38b39020884b1d9d4b81e8b0a72c32: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 10:36:38.772068 26461 log.cc:1196] T bd14a687859744899326191888b67869 P bc38b39020884b1d9d4b81e8b0a72c32: Deleting WAL directory at /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786098956060137-21165-0/minicluster-data/ts-2/wal/wals/bd14a687859744899326191888b67869
I20260807 10:36:38.772496 26463 ts_tablet_manager.cc:1918] T bd14a687859744899326191888b67869 P a084a0e037ec4182ac0c6cd43cd3825a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 10:36:38.772683 26463 log.cc:1196] T bd14a687859744899326191888b67869 P a084a0e037ec4182ac0c6cd43cd3825a: Deleting WAL directory at /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786098956060137-21165-0/minicluster-data/ts-1/wal/wals/bd14a687859744899326191888b67869
I20260807 10:36:38.772734 26461 ts_tablet_manager.cc:1939] T bd14a687859744899326191888b67869 P bc38b39020884b1d9d4b81e8b0a72c32: Deleting consensus metadata
I20260807 10:36:38.773223 26463 ts_tablet_manager.cc:1939] T bd14a687859744899326191888b67869 P a084a0e037ec4182ac0c6cd43cd3825a: Deleting consensus metadata
I20260807 10:36:38.774451 25953 catalog_manager.cc:4841] TS bc38b39020884b1d9d4b81e8b0a72c32 (127.20.171.67:44061): tablet bd14a687859744899326191888b67869 (table test-table [id=d34694402f9d4e60828dd3372e119742]) successfully deleted
I20260807 10:36:38.774940 25951 catalog_manager.cc:4841] TS a084a0e037ec4182ac0c6cd43cd3825a (127.20.171.66:36665): tablet bd14a687859744899326191888b67869 (table test-table [id=d34694402f9d4e60828dd3372e119742]) successfully deleted
I20260807 10:36:38.858471 26462 tablet_replica.cc:330] T bd14a687859744899326191888b67869 P 385549fdcfb3458d969928cbe118a868: stopping tablet replica
I20260807 10:36:38.858530 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 26028
I20260807 10:36:38.881779 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 26160
W20260807 10:36:38.881779 25950 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.20.171.65:42463 (error 108)
I20260807 10:36:38.883939 26433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:38.883414 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.65:42463 (local address 127.0.0.1:46988)
0807 10:36:38.883621 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0807 10:36:38.883765 (+ 144us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.65:42463: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":73}
W20260807 10:36:38.884400 25950 catalog_manager.cc:4584] TS 385549fdcfb3458d969928cbe118a868 (127.20.171.65:42463): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet bd14a687859744899326191888b67869: Network error: Client connection negotiation failed: client connection to 127.20.171.65:42463: connect: Connection refused (error 111)
I20260807 10:36:38.885285 26438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:38.882979 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49628 (local address 127.20.171.66:36665)
0807 10:36:38.883157 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:38.883163 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:38.883183 (+ 20us) server_negotiation.cc:407] Connection header received
0807 10:36:38.883258 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:38.883264 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:38.883373 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:38.883501 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:36:38.884618 (+ 1117us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:36:38.884624 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:36:38.884628 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:36:38.884649 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:36:38.884687 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:36:38.884703 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:36:38.884848 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:38.884952 (+ 104us) server_negotiation.cc:299] Negotiation successful
0807 10:36:38.884999 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260807 10:36:38.885824 26284 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:36:38.937960 26433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:38.937511 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.65:42463 (local address 127.0.0.1:46990)
0807 10:36:38.937718 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0807 10:36:38.937811 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.65:42463: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":76}
I20260807 10:36:38.939333 26433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:38.938774 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.65:42463 (local address 127.0.0.1:47004)
0807 10:36:38.938976 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0807 10:36:38.939124 (+ 148us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.65:42463: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":70}
I20260807 10:36:38.993383 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 26160
I20260807 10:36:39.000317 26433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:38.999675 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.65:42463 (local address 127.0.0.1:47012)
0807 10:36:38.999921 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0807 10:36:39.000086 (+ 165us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.65:42463: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":81}
I20260807 10:36:39.001564 26433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:39.001145 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.65:42463 (local address 127.0.0.1:47016)
0807 10:36:39.001325 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0807 10:36:39.001414 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.65:42463: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
I20260807 10:36:39.013437 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 26292
I20260807 10:36:39.016238 26436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:39.014258 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34142 (local address 127.20.171.67:44061)
0807 10:36:39.014434 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:39.014439 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:39.014461 (+ 22us) server_negotiation.cc:407] Connection header received
0807 10:36:39.014566 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:39.014573 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:39.014641 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:39.014752 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:36:39.015569 (+ 817us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:36:39.015574 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:36:39.015578 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:36:39.015594 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:36:39.015630 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:36:39.015642 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:36:39.015772 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:39.015893 (+ 121us) server_negotiation.cc:299] Negotiation successful
0807 10:36:39.015954 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260807 10:36:39.016984 26415 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:36:39.082268 26433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:39.081731 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.65:42463 (local address 127.0.0.1:47020)
0807 10:36:39.081972 (+ 241us) negotiation.cc:107] Waiting for socket to connect
0807 10:36:39.082087 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.65:42463: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":81}
I20260807 10:36:39.083405 26433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:39.082948 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.65:42463 (local address 127.0.0.1:47032)
0807 10:36:39.083177 (+ 229us) negotiation.cc:107] Waiting for socket to connect
0807 10:36:39.083262 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.65:42463: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":104}
I20260807 10:36:39.145128 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 26292
I20260807 10:36:39.167291 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 25935
I20260807 10:36:39.168533 25999 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:36:39.275260 26433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:39.274574 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.65:42463 (local address 127.0.0.1:47034)
0807 10:36:39.274853 (+ 279us) negotiation.cc:107] Waiting for socket to connect
0807 10:36:39.274973 (+ 120us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.65:42463: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
I20260807 10:36:39.275285 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 25935
2026-08-07T10:36:39Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (2644 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260807 10:36:39.320369 21165 mini_oidc.cc:152] Starting JWKS server
I20260807 10:36:39.323058 21165 webserver.cc:460] Webserver started at https://127.0.0.1:46437/ using document root <none> and password file <none>
I20260807 10:36:39.323385 21165 mini_oidc.cc:189] Starting OIDC Discovery server
I20260807 10:36:39.323942 21165 webserver.cc:460] Webserver started at http://127.0.0.1:43339/ using document root <none> and password file <none>
2026-08-07T10:36:39Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T10:36:39Z Disabled control of system clock
I20260807 10:36:39.357497 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786098956060137-21165-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786098956060137-21165-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786098956060137-21165-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.171.126:41497
--webserver_interface=127.20.171.126
--webserver_port=0
--builtin_ntp_servers=127.20.171.84:33459
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.171.126:41497
--enable_jwt_token_auth=true
--jwks_url=https://localhost:46437/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786098956060137-21165-0/testchainca.cert with env {}
W20260807 10:36:39.702046 26475 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:36:39.702351 26475 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:36:39.702533 26475 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:36:39.709587 26475 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 10:36:39.709703 26475 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:36:39.709818 26475 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:36:39.709928 26475 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 10:36:39.710012 26475 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260807 10:36:39.710125 26475 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260807 10:36:39.710207 26475 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:46437/jwks.json
I20260807 10:36:39.719803 26475 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.171.84:33459
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786098956060137-21165-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786098956060137-21165-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.171.126:41497
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.171.126:41497
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:46437/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.171.126
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786098956060137-21165-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786098956060137-21165-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:36:39.721141 26475 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:36:39.722467 26475 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:36:39.734177 26480 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:36:39.734236 26483 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:36:39.734289 26481 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:36:39.735059 26475 server_base.cc:1034] running on GCE node
I20260807 10:36:39.735754 26475 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:36:39.737015 26475 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:36:39.738202 26475 hybrid_clock.cc:648] HybridClock initialized: now 1786098999738152 us; error 50 us; skew 500 ppm
I20260807 10:36:39.738492 26475 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 10:36:39.740705 26475 webserver.cc:460] Webserver started at http://127.20.171.126:33855/ using document root <none> and password file <none>
I20260807 10:36:39.741313 26475 fs_manager.cc:359] Metadata directory not provided
I20260807 10:36:39.741415 26475 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:36:39.741669 26475 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:36:39.744422 26475 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786098956060137-21165-0/minicluster-data/master-0/data/instance:
uuid: "465befe1d3884ef0b52f794c2a877d68"
format_stamp: "Formatted at 2026-08-07 10:36:39 on dist-test-slave-0b58"
server_key: "c75d9834b5da057fdb2e37c90f61815d"
server_key_iv: "b5b7bb3bc984f35c794ad76a26e8a318"
server_key_version: "encryptionkey@0"
I20260807 10:36:39.745126 26475 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786098956060137-21165-0/minicluster-data/master-0/wal/instance:
uuid: "465befe1d3884ef0b52f794c2a877d68"
format_stamp: "Formatted at 2026-08-07 10:36:39 on dist-test-slave-0b58"
server_key: "c75d9834b5da057fdb2e37c90f61815d"
server_key_iv: "b5b7bb3bc984f35c794ad76a26e8a318"
server_key_version: "encryptionkey@0"
I20260807 10:36:39.749883 26475 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260807 10:36:39.753120 26489 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:36:39.754411 26475 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260807 10:36:39.754546 26475 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786098956060137-21165-0/minicluster-data/master-0/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786098956060137-21165-0/minicluster-data/master-0/wal
uuid: "465befe1d3884ef0b52f794c2a877d68"
format_stamp: "Formatted at 2026-08-07 10:36:39 on dist-test-slave-0b58"
server_key: "c75d9834b5da057fdb2e37c90f61815d"
server_key_iv: "b5b7bb3bc984f35c794ad76a26e8a318"
server_key_version: "encryptionkey@0"
I20260807 10:36:39.754717 26475 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786098956060137-21165-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786098956060137-21165-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786098956060137-21165-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:36:39.778568 26475 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:36:39.779313 26475 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:36:39.779663 26475 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:36:39.798275 26475 rpc_server.cc:307] RPC server started. Bound to: 127.20.171.126:41497
I20260807 10:36:39.798309 26542 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.171.126:41497 every 8 connection(s)
I20260807 10:36:39.799573 26475 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
I20260807 10:36:39.803143 26543 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:36:39.805907 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 26475
I20260807 10:36:39.806143 21165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786098956060137-21165-0/minicluster-data/master-0/wal/instance
I20260807 10:36:39.807015 21165 external_mini_cluster.cc:1428] Setting key ed77b21e9ff02f55f1041de3254bab77
I20260807 10:36:39.815119 26543 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 465befe1d3884ef0b52f794c2a877d68: Bootstrap starting.
I20260807 10:36:39.818179 26543 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 465befe1d3884ef0b52f794c2a877d68: Neither blocks nor log segments found. Creating new log.
I20260807 10:36:39.819146 26543 log.cc:824] T 00000000000000000000000000000000 P 465befe1d3884ef0b52f794c2a877d68: Log is configured to *not* fsync() on all Append() calls
I20260807 10:36:39.821604 26543 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 465befe1d3884ef0b52f794c2a877d68: No bootstrap required, opened a new log
I20260807 10:36:39.826282 26546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:39.809051 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33316 (local address 127.20.171.126:41497)
0807 10:36:39.809975 (+ 924us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:39.809985 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:39.810024 (+ 39us) server_negotiation.cc:407] Connection header received
0807 10:36:39.811661 (+ 1637us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:39.811680 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:39.812101 (+ 421us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:39.812585 (+ 484us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:36:39.813201 (+ 616us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:39.814444 (+ 1243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:39.815912 (+ 1468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:39.816614 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:39.816822 (+ 208us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:39.824076 (+ 7254us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:36:39.824082 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:36:39.824094 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:36:39.824673 (+ 579us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:36:39.824750 (+ 77us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:36:39.824770 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:36:39.824894 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:39.825109 (+ 215us) server_negotiation.cc:299] Negotiation successful
0807 10:36:39.825394 (+ 285us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":538,"thread_start_us":315,"threads_started":1}
I20260807 10:36:39.829955 21165 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 10:36:39.829775 26543 raft_consensus.cc:348] T 00000000000000000000000000000000 P 465befe1d3884ef0b52f794c2a877d68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "465befe1d3884ef0b52f794c2a877d68" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 41497 } }
I20260807 10:36:39.830124 26543 raft_consensus.cc:374] T 00000000000000000000000000000000 P 465befe1d3884ef0b52f794c2a877d68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:36:39.830245 26543 raft_consensus.cc:729] T 00000000000000000000000000000000 P 465befe1d3884ef0b52f794c2a877d68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 465befe1d3884ef0b52f794c2a877d68, State: Initialized, Role: FOLLOWER
I20260807 10:36:39.830811 26543 consensus_queue.cc:260] T 00000000000000000000000000000000 P 465befe1d3884ef0b52f794c2a877d68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "465befe1d3884ef0b52f794c2a877d68" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 41497 } }
I20260807 10:36:39.831035 26543 raft_consensus.cc:388] T 00000000000000000000000000000000 P 465befe1d3884ef0b52f794c2a877d68 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 10:36:39.831174 26543 raft_consensus.cc:482] T 00000000000000000000000000000000 P 465befe1d3884ef0b52f794c2a877d68 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 10:36:39.831327 26543 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 465befe1d3884ef0b52f794c2a877d68 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:36:39.833786 26543 raft_consensus.cc:504] T 00000000000000000000000000000000 P 465befe1d3884ef0b52f794c2a877d68 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "465befe1d3884ef0b52f794c2a877d68" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 41497 } }
I20260807 10:36:39.834239 26543 leader_election.cc:302] T 00000000000000000000000000000000 P 465befe1d3884ef0b52f794c2a877d68 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 465befe1d3884ef0b52f794c2a877d68; no voters:
I20260807 10:36:39.834797 26543 leader_election.cc:288] T 00000000000000000000000000000000 P 465befe1d3884ef0b52f794c2a877d68 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 10:36:39.834924 26548 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 465befe1d3884ef0b52f794c2a877d68 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:36:39.835590 26548 raft_consensus.cc:686] T 00000000000000000000000000000000 P 465befe1d3884ef0b52f794c2a877d68 [term 1 LEADER]: Becoming Leader. State: Replica: 465befe1d3884ef0b52f794c2a877d68, State: Running, Role: LEADER
I20260807 10:36:39.836135 26548 consensus_queue.cc:237] T 00000000000000000000000000000000 P 465befe1d3884ef0b52f794c2a877d68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "465befe1d3884ef0b52f794c2a877d68" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 41497 } }
I20260807 10:36:39.836764 26543 sys_catalog.cc:564] T 00000000000000000000000000000000 P 465befe1d3884ef0b52f794c2a877d68 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 10:36:39.838642 26550 sys_catalog.cc:455] T 00000000000000000000000000000000 P 465befe1d3884ef0b52f794c2a877d68 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 465befe1d3884ef0b52f794c2a877d68. Latest consensus state: current_term: 1 leader_uuid: "465befe1d3884ef0b52f794c2a877d68" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "465befe1d3884ef0b52f794c2a877d68" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 41497 } } }
I20260807 10:36:39.839030 26550 sys_catalog.cc:458] T 00000000000000000000000000000000 P 465befe1d3884ef0b52f794c2a877d68 [sys.catalog]: This master's current role is: LEADER
I20260807 10:36:39.840019 26549 sys_catalog.cc:455] T 00000000000000000000000000000000 P 465befe1d3884ef0b52f794c2a877d68 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "465befe1d3884ef0b52f794c2a877d68" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "465befe1d3884ef0b52f794c2a877d68" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 41497 } } }
I20260807 10:36:39.840487 26549 sys_catalog.cc:458] T 00000000000000000000000000000000 P 465befe1d3884ef0b52f794c2a877d68 [sys.catalog]: This master's current role is: LEADER
I20260807 10:36:39.841580 26555 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 10:36:39.847184 26555 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 10:36:39.855266 26555 catalog_manager.cc:1347] Generated new cluster ID: 8a808d3eb27644ca918e9c7888ee17db
I20260807 10:36:39.855389 26555 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 10:36:39.883502 26555 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 10:36:39.885109 26555 catalog_manager.cc:1504] Loading token signing keys...
I20260807 10:36:39.894771 26555 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 465befe1d3884ef0b52f794c2a877d68: Generated new TSK 0
I20260807 10:36:39.895539 26555 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260807 10:36:39.930356 26573 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260807 10:36:39.930547 26573 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260807 10:36:39.931671 26546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:39.910643 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33318 (local address 127.20.171.126:41497)
0807 10:36:39.910843 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:39.910850 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:39.911447 (+ 597us) server_negotiation.cc:407] Connection header received
0807 10:36:39.911809 (+ 362us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:39.911813 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:39.911878 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:39.911989 (+ 111us) server_negotiation.cc:226] Negotiated authn=JWT
0807 10:36:39.912675 (+ 686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:39.913373 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:39.915292 (+ 1919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:39.915651 (+ 359us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:39.915736 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:39.916293 (+ 557us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0807 10:36:39.931034 (+ 14741us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:46437/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0807 10:36:39.931380 (+ 346us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:33318: Failed to load JWKS: Error downloading JWKS from 'https://localhost:46437/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":58}
W20260807 10:36:39.931785 26546 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:33318: Failed to load JWKS: Error downloading JWKS from 'https://localhost:46437/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
W20260807 10:36:39.933228 26572 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:36:39.910656 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:41497 (local address 127.0.0.1:33318)
0807 10:36:39.911325 (+ 669us) negotiation.cc:107] Waiting for socket to connect
0807 10:36:39.911343 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 10:36:39.911533 (+ 190us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:36:39.912051 (+ 518us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:36:39.912057 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:36:39.912071 (+ 14us) client_negotiation.cc:189] Negotiated authn=JWT
0807 10:36:39.912527 (+ 456us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:39.912541 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:39.913534 (+ 993us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:39.913540 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:39.915170 (+ 1630us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:39.915183 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:39.915789 (+ 606us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:39.915794 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:39.915971 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:39.916032 (+ 61us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0807 10:36:39.931303 (+ 15271us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:46437/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0807 10:36:39.931541 (+ 238us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.20.171.126:41497: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:46437/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":490,"thread_start_us":331,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.20.171.126:41497: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:46437/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260807 10:36:39.935420 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 26475
I20260807 10:36:39.936466 26537 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:36:40.029492 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 26475
2026-08-07T10:36:40Z chronyd exiting
I20260807 10:36:40.083847 21165 test_util.cc:175] -----------------------------------------------
I20260807 10:36:40.083978 21165 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786098956060137-21165-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (768 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260807 10:36:40.087762 21165 mini_oidc.cc:152] Starting JWKS server
I20260807 10:36:40.089915 21165 webserver.cc:460] Webserver started at https://127.0.0.1:40199/ using document root <none> and password file <none>
I20260807 10:36:40.090140 21165 mini_oidc.cc:189] Starting OIDC Discovery server
I20260807 10:36:40.090782 21165 webserver.cc:460] Webserver started at http://127.0.0.1:33719/ using document root <none> and password file <none>
2026-08-07T10:36:40Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T10:36:40Z Disabled control of system clock
I20260807 10:36:40.124796 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786098956060137-21165-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786098956060137-21165-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786098956060137-21165-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.171.126:34523
--webserver_interface=127.20.171.126
--webserver_port=0
--builtin_ntp_servers=127.20.171.84:36539
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.171.126:34523
--enable_jwt_token_auth=true
--jwks_url=https://localhost:40199/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786098956060137-21165-0/testchainca.cert with env {}
W20260807 10:36:40.446058 26580 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:36:40.446429 26580 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:36:40.446599 26580 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:36:40.453518 26580 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 10:36:40.453685 26580 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:36:40.453783 26580 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:36:40.453881 26580 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 10:36:40.453961 26580 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260807 10:36:40.454044 26580 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260807 10:36:40.454135 26580 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:40199/jwks.json
I20260807 10:36:40.463146 26580 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.171.84:36539
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786098956060137-21165-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786098956060137-21165-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.171.126:34523
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.171.126:34523
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:40199/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.171.126
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786098956060137-21165-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786098956060137-21165-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:36:40.464417 26580 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:36:40.465694 26580 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:36:40.476835 26585 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:36:40.476879 26586 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:36:40.476980 26588 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:36:40.477746 26580 server_base.cc:1034] running on GCE node
I20260807 10:36:40.478428 26580 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:36:40.479712 26580 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:36:40.480926 26580 hybrid_clock.cc:648] HybridClock initialized: now 1786099000480876 us; error 37 us; skew 500 ppm
I20260807 10:36:40.481258 26580 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 10:36:40.483541 26580 webserver.cc:460] Webserver started at http://127.20.171.126:34967/ using document root <none> and password file <none>
I20260807 10:36:40.484282 26580 fs_manager.cc:359] Metadata directory not provided
I20260807 10:36:40.484445 26580 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:36:40.484772 26580 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:36:40.487481 26580 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786098956060137-21165-0/minicluster-data/master-0/data/instance:
uuid: "54de6308477e4440aeb12feb839eb39a"
format_stamp: "Formatted at 2026-08-07 10:36:40 on dist-test-slave-0b58"
server_key: "93ce74d551c4ed6a2757e48a2122f169"
server_key_iv: "183b2991d12ec0ad00942f95196a6a59"
server_key_version: "encryptionkey@0"
I20260807 10:36:40.488317 26580 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786098956060137-21165-0/minicluster-data/master-0/wal/instance:
uuid: "54de6308477e4440aeb12feb839eb39a"
format_stamp: "Formatted at 2026-08-07 10:36:40 on dist-test-slave-0b58"
server_key: "93ce74d551c4ed6a2757e48a2122f169"
server_key_iv: "183b2991d12ec0ad00942f95196a6a59"
server_key_version: "encryptionkey@0"
I20260807 10:36:40.493078 26580 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260807 10:36:40.496295 26594 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:36:40.497452 26580 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260807 10:36:40.497650 26580 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786098956060137-21165-0/minicluster-data/master-0/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786098956060137-21165-0/minicluster-data/master-0/wal
uuid: "54de6308477e4440aeb12feb839eb39a"
format_stamp: "Formatted at 2026-08-07 10:36:40 on dist-test-slave-0b58"
server_key: "93ce74d551c4ed6a2757e48a2122f169"
server_key_iv: "183b2991d12ec0ad00942f95196a6a59"
server_key_version: "encryptionkey@0"
I20260807 10:36:40.497857 26580 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786098956060137-21165-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786098956060137-21165-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786098956060137-21165-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:36:40.511014 26580 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:36:40.511751 26580 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:36:40.512044 26580 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:36:40.538010 26580 rpc_server.cc:307] RPC server started. Bound to: 127.20.171.126:34523
I20260807 10:36:40.538046 26645 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.171.126:34523 every 8 connection(s)
I20260807 10:36:40.539373 26580 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
I20260807 10:36:40.542914 26646 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:36:40.547302 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 26580
I20260807 10:36:40.547500 21165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786098956060137-21165-0/minicluster-data/master-0/wal/instance
I20260807 10:36:40.548199 21165 external_mini_cluster.cc:1428] Setting key b9e45eff7beec7400d7dcea00b08db43
I20260807 10:36:40.553849 26646 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 54de6308477e4440aeb12feb839eb39a: Bootstrap starting.
I20260807 10:36:40.557287 26646 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 54de6308477e4440aeb12feb839eb39a: Neither blocks nor log segments found. Creating new log.
I20260807 10:36:40.558421 26646 log.cc:824] T 00000000000000000000000000000000 P 54de6308477e4440aeb12feb839eb39a: Log is configured to *not* fsync() on all Append() calls
I20260807 10:36:40.561486 26646 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 54de6308477e4440aeb12feb839eb39a: No bootstrap required, opened a new log
I20260807 10:36:40.561736 26649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:40.550097 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45050 (local address 127.20.171.126:34523)
0807 10:36:40.551129 (+ 1032us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:40.551142 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:40.551190 (+ 48us) server_negotiation.cc:407] Connection header received
0807 10:36:40.552941 (+ 1751us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:40.552960 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:40.553363 (+ 403us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:40.553665 (+ 302us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:36:40.554306 (+ 641us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:40.555550 (+ 1244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:40.557413 (+ 1863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:40.558067 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:40.558196 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:40.559465 (+ 1269us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:36:40.559479 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:36:40.559502 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:36:40.560113 (+ 611us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:36:40.560183 (+ 70us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:36:40.560207 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:36:40.560344 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:40.560534 (+ 190us) server_negotiation.cc:299] Negotiation successful
0807 10:36:40.560815 (+ 281us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":639,"thread_start_us":404,"threads_started":1}
I20260807 10:36:40.565376 21165 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 10:36:40.569504 26646 raft_consensus.cc:348] T 00000000000000000000000000000000 P 54de6308477e4440aeb12feb839eb39a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "54de6308477e4440aeb12feb839eb39a" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 34523 } }
I20260807 10:36:40.569856 26646 raft_consensus.cc:374] T 00000000000000000000000000000000 P 54de6308477e4440aeb12feb839eb39a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:36:40.569972 26646 raft_consensus.cc:729] T 00000000000000000000000000000000 P 54de6308477e4440aeb12feb839eb39a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54de6308477e4440aeb12feb839eb39a, State: Initialized, Role: FOLLOWER
I20260807 10:36:40.570537 26646 consensus_queue.cc:260] T 00000000000000000000000000000000 P 54de6308477e4440aeb12feb839eb39a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "54de6308477e4440aeb12feb839eb39a" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 34523 } }
I20260807 10:36:40.570770 26646 raft_consensus.cc:388] T 00000000000000000000000000000000 P 54de6308477e4440aeb12feb839eb39a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 10:36:40.570909 26646 raft_consensus.cc:482] T 00000000000000000000000000000000 P 54de6308477e4440aeb12feb839eb39a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 10:36:40.571072 26646 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 54de6308477e4440aeb12feb839eb39a [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:36:40.573395 26646 raft_consensus.cc:504] T 00000000000000000000000000000000 P 54de6308477e4440aeb12feb839eb39a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "54de6308477e4440aeb12feb839eb39a" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 34523 } }
I20260807 10:36:40.573897 26646 leader_election.cc:302] T 00000000000000000000000000000000 P 54de6308477e4440aeb12feb839eb39a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 54de6308477e4440aeb12feb839eb39a; no voters:
I20260807 10:36:40.574534 26646 leader_election.cc:288] T 00000000000000000000000000000000 P 54de6308477e4440aeb12feb839eb39a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 10:36:40.574630 26651 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 54de6308477e4440aeb12feb839eb39a [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:36:40.575525 26651 raft_consensus.cc:686] T 00000000000000000000000000000000 P 54de6308477e4440aeb12feb839eb39a [term 1 LEADER]: Becoming Leader. State: Replica: 54de6308477e4440aeb12feb839eb39a, State: Running, Role: LEADER
I20260807 10:36:40.576073 26651 consensus_queue.cc:237] T 00000000000000000000000000000000 P 54de6308477e4440aeb12feb839eb39a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "54de6308477e4440aeb12feb839eb39a" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 34523 } }
I20260807 10:36:40.576982 26646 sys_catalog.cc:564] T 00000000000000000000000000000000 P 54de6308477e4440aeb12feb839eb39a [sys.catalog]: configured and running, proceeding with master startup.
I20260807 10:36:40.578821 26652 sys_catalog.cc:455] T 00000000000000000000000000000000 P 54de6308477e4440aeb12feb839eb39a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "54de6308477e4440aeb12feb839eb39a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "54de6308477e4440aeb12feb839eb39a" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 34523 } } }
I20260807 10:36:40.579960 26652 sys_catalog.cc:458] T 00000000000000000000000000000000 P 54de6308477e4440aeb12feb839eb39a [sys.catalog]: This master's current role is: LEADER
I20260807 10:36:40.579828 26653 sys_catalog.cc:455] T 00000000000000000000000000000000 P 54de6308477e4440aeb12feb839eb39a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 54de6308477e4440aeb12feb839eb39a. Latest consensus state: current_term: 1 leader_uuid: "54de6308477e4440aeb12feb839eb39a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "54de6308477e4440aeb12feb839eb39a" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 34523 } } }
I20260807 10:36:40.581137 26653 sys_catalog.cc:458] T 00000000000000000000000000000000 P 54de6308477e4440aeb12feb839eb39a [sys.catalog]: This master's current role is: LEADER
I20260807 10:36:40.581225 26661 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 10:36:40.586364 26661 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 10:36:40.595222 26661 catalog_manager.cc:1347] Generated new cluster ID: 7b214536ba3b45e7a998fbb4f6148f24
I20260807 10:36:40.595327 26661 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 10:36:40.616179 26661 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 10:36:40.617885 26661 catalog_manager.cc:1504] Loading token signing keys...
I20260807 10:36:40.625535 26661 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 54de6308477e4440aeb12feb839eb39a: Generated new TSK 0
I20260807 10:36:40.626451 26661 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260807 10:36:40.660104 26677 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260807 10:36:40.660261 26677 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260807 10:36:40.661405 26649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:40.641516 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37936 (local address 127.20.171.126:34523)
0807 10:36:40.641706 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:40.641712 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:40.642279 (+ 567us) server_negotiation.cc:407] Connection header received
0807 10:36:40.642531 (+ 252us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:40.642537 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:40.642631 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:40.642810 (+ 179us) server_negotiation.cc:226] Negotiated authn=JWT
0807 10:36:40.643263 (+ 453us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:40.644374 (+ 1111us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:40.645759 (+ 1385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:40.646580 (+ 821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:40.646709 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:40.647199 (+ 490us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0807 10:36:40.660760 (+ 13561us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40199/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0807 10:36:40.661100 (+ 340us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:37936: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40199/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":64}
W20260807 10:36:40.661438 26676 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:36:40.641480 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:34523 (local address 127.0.0.1:37936)
0807 10:36:40.642172 (+ 692us) negotiation.cc:107] Waiting for socket to connect
0807 10:36:40.642195 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0807 10:36:40.642312 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:36:40.642808 (+ 496us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:36:40.642812 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:36:40.642821 (+ 9us) client_negotiation.cc:189] Negotiated authn=JWT
0807 10:36:40.643073 (+ 252us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:40.643081 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:40.644510 (+ 1429us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:40.644514 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:40.645584 (+ 1070us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:40.645596 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:40.646763 (+ 1167us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:40.646767 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:40.646901 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:40.646932 (+ 31us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0807 10:36:40.660962 (+ 14030us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40199/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0807 10:36:40.661153 (+ 191us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.20.171.126:34523: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40199/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":546,"thread_start_us":372,"threads_started":1}
W20260807 10:36:40.661518 26649 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:37936: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40199/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
I20260807 10:36:40.663404 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 26580
I20260807 10:36:40.664541 26641 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:36:40.754737 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 26580
2026-08-07T10:36:40Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (725 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260807 10:36:40.813431 21165 mini_oidc.cc:152] Starting JWKS server
I20260807 10:36:40.815382 21165 webserver.cc:460] Webserver started at https://127.0.0.1:39015/ using document root <none> and password file <none>
I20260807 10:36:40.815651 21165 mini_oidc.cc:189] Starting OIDC Discovery server
I20260807 10:36:40.816315 21165 webserver.cc:460] Webserver started at http://127.0.0.1:41209/ using document root <none> and password file <none>
2026-08-07T10:36:40Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T10:36:40Z Disabled control of system clock
I20260807 10:36:40.851315 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786098956060137-21165-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786098956060137-21165-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786098956060137-21165-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.171.126:37093
--webserver_interface=127.20.171.126
--webserver_port=0
--builtin_ntp_servers=127.20.171.84:36721
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.171.126:37093
--enable_jwt_token_auth=true
--jwks_url=https://localhost:39015/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260807 10:36:41.173802 26684 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:36:41.174178 26684 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:36:41.174326 26684 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:36:41.181409 26684 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 10:36:41.181551 26684 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:36:41.181638 26684 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:36:41.181746 26684 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 10:36:41.181818 26684 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260807 10:36:41.181900 26684 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260807 10:36:41.181972 26684 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:39015/jwks.json
I20260807 10:36:41.191200 26684 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.171.84:36721
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786098956060137-21165-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786098956060137-21165-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.171.126:37093
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.171.126:37093
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:39015/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.171.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786098956060137-21165-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:36:41.192550 26684 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:36:41.194401 26684 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:36:41.206029 26690 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:36:41.206013 26691 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:36:41.206557 26694 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:36:41.206974 26684 server_base.cc:1034] running on GCE node
I20260807 10:36:41.207792 26684 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:36:41.209118 26684 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:36:41.210318 26684 hybrid_clock.cc:648] HybridClock initialized: now 1786099001210264 us; error 45 us; skew 500 ppm
I20260807 10:36:41.210597 26684 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 10:36:41.212878 26684 webserver.cc:460] Webserver started at http://127.20.171.126:37415/ using document root <none> and password file <none>
I20260807 10:36:41.213511 26684 fs_manager.cc:359] Metadata directory not provided
I20260807 10:36:41.213598 26684 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:36:41.213963 26684 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:36:41.217028 26684 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786098956060137-21165-0/minicluster-data/master-0/data/instance:
uuid: "dd0a97d29f5a4da191406c0c3607eaf5"
format_stamp: "Formatted at 2026-08-07 10:36:41 on dist-test-slave-0b58"
server_key: "dafab68318499b0376fba4d5c251b71c"
server_key_iv: "2adbb787d1872a1ea95b43921919299b"
server_key_version: "encryptionkey@0"
I20260807 10:36:41.217855 26684 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786098956060137-21165-0/minicluster-data/master-0/wal/instance:
uuid: "dd0a97d29f5a4da191406c0c3607eaf5"
format_stamp: "Formatted at 2026-08-07 10:36:41 on dist-test-slave-0b58"
server_key: "dafab68318499b0376fba4d5c251b71c"
server_key_iv: "2adbb787d1872a1ea95b43921919299b"
server_key_version: "encryptionkey@0"
I20260807 10:36:41.222793 26684 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260807 10:36:41.226207 26701 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:36:41.227434 26684 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 10:36:41.227608 26684 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786098956060137-21165-0/minicluster-data/master-0/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786098956060137-21165-0/minicluster-data/master-0/wal
uuid: "dd0a97d29f5a4da191406c0c3607eaf5"
format_stamp: "Formatted at 2026-08-07 10:36:41 on dist-test-slave-0b58"
server_key: "dafab68318499b0376fba4d5c251b71c"
server_key_iv: "2adbb787d1872a1ea95b43921919299b"
server_key_version: "encryptionkey@0"
I20260807 10:36:41.227833 26684 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786098956060137-21165-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786098956060137-21165-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786098956060137-21165-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:36:41.251341 26684 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:36:41.252182 26684 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:36:41.252529 26684 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:36:41.271199 26684 rpc_server.cc:307] RPC server started. Bound to: 127.20.171.126:37093
I20260807 10:36:41.271260 26753 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.171.126:37093 every 8 connection(s)
I20260807 10:36:41.272535 26684 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
I20260807 10:36:41.276049 26754 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:36:41.281864 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 26684
I20260807 10:36:41.282104 21165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786098956060137-21165-0/minicluster-data/master-0/wal/instance
I20260807 10:36:41.282990 21165 external_mini_cluster.cc:1428] Setting key f0d09ca93263b1295cd18effe87b9d36
I20260807 10:36:41.287608 26754 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dd0a97d29f5a4da191406c0c3607eaf5: Bootstrap starting.
I20260807 10:36:41.290585 26754 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P dd0a97d29f5a4da191406c0c3607eaf5: Neither blocks nor log segments found. Creating new log.
I20260807 10:36:41.291522 26754 log.cc:824] T 00000000000000000000000000000000 P dd0a97d29f5a4da191406c0c3607eaf5: Log is configured to *not* fsync() on all Append() calls
I20260807 10:36:41.294461 26754 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dd0a97d29f5a4da191406c0c3607eaf5: No bootstrap required, opened a new log
I20260807 10:36:41.295893 26757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:41.285118 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38988 (local address 127.20.171.126:37093)
0807 10:36:41.286067 (+ 949us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:41.286077 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:41.286114 (+ 37us) server_negotiation.cc:407] Connection header received
0807 10:36:41.287848 (+ 1734us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:41.287869 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:41.288344 (+ 475us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:41.288702 (+ 358us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:36:41.289255 (+ 553us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:41.290421 (+ 1166us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:41.291665 (+ 1244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:41.292382 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:41.292607 (+ 225us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:41.293838 (+ 1231us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:36:41.293844 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:36:41.293857 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:36:41.294344 (+ 487us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:36:41.294417 (+ 73us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:36:41.294435 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:36:41.294563 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:41.294801 (+ 238us) server_negotiation.cc:299] Negotiation successful
0807 10:36:41.295072 (+ 271us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":569,"thread_start_us":340,"threads_started":1}
I20260807 10:36:41.299461 21165 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 10:36:41.302239 26754 raft_consensus.cc:348] T 00000000000000000000000000000000 P dd0a97d29f5a4da191406c0c3607eaf5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd0a97d29f5a4da191406c0c3607eaf5" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 37093 } }
I20260807 10:36:41.302645 26754 raft_consensus.cc:374] T 00000000000000000000000000000000 P dd0a97d29f5a4da191406c0c3607eaf5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:36:41.302757 26754 raft_consensus.cc:729] T 00000000000000000000000000000000 P dd0a97d29f5a4da191406c0c3607eaf5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd0a97d29f5a4da191406c0c3607eaf5, State: Initialized, Role: FOLLOWER
I20260807 10:36:41.303277 26754 consensus_queue.cc:260] T 00000000000000000000000000000000 P dd0a97d29f5a4da191406c0c3607eaf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd0a97d29f5a4da191406c0c3607eaf5" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 37093 } }
I20260807 10:36:41.303488 26754 raft_consensus.cc:388] T 00000000000000000000000000000000 P dd0a97d29f5a4da191406c0c3607eaf5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 10:36:41.303583 26754 raft_consensus.cc:482] T 00000000000000000000000000000000 P dd0a97d29f5a4da191406c0c3607eaf5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 10:36:41.303726 26754 raft_consensus.cc:3037] T 00000000000000000000000000000000 P dd0a97d29f5a4da191406c0c3607eaf5 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:36:41.305733 26754 raft_consensus.cc:504] T 00000000000000000000000000000000 P dd0a97d29f5a4da191406c0c3607eaf5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd0a97d29f5a4da191406c0c3607eaf5" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 37093 } }
I20260807 10:36:41.306166 26754 leader_election.cc:302] T 00000000000000000000000000000000 P dd0a97d29f5a4da191406c0c3607eaf5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: dd0a97d29f5a4da191406c0c3607eaf5; no voters:
I20260807 10:36:41.306733 26754 leader_election.cc:288] T 00000000000000000000000000000000 P dd0a97d29f5a4da191406c0c3607eaf5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 10:36:41.306953 26759 raft_consensus.cc:2781] T 00000000000000000000000000000000 P dd0a97d29f5a4da191406c0c3607eaf5 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:36:41.307744 26759 raft_consensus.cc:686] T 00000000000000000000000000000000 P dd0a97d29f5a4da191406c0c3607eaf5 [term 1 LEADER]: Becoming Leader. State: Replica: dd0a97d29f5a4da191406c0c3607eaf5, State: Running, Role: LEADER
I20260807 10:36:41.308384 26759 consensus_queue.cc:237] T 00000000000000000000000000000000 P dd0a97d29f5a4da191406c0c3607eaf5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd0a97d29f5a4da191406c0c3607eaf5" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 37093 } }
I20260807 10:36:41.309052 26754 sys_catalog.cc:564] T 00000000000000000000000000000000 P dd0a97d29f5a4da191406c0c3607eaf5 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 10:36:41.311481 26761 sys_catalog.cc:455] T 00000000000000000000000000000000 P dd0a97d29f5a4da191406c0c3607eaf5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader dd0a97d29f5a4da191406c0c3607eaf5. Latest consensus state: current_term: 1 leader_uuid: "dd0a97d29f5a4da191406c0c3607eaf5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd0a97d29f5a4da191406c0c3607eaf5" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 37093 } } }
I20260807 10:36:41.311844 26761 sys_catalog.cc:458] T 00000000000000000000000000000000 P dd0a97d29f5a4da191406c0c3607eaf5 [sys.catalog]: This master's current role is: LEADER
I20260807 10:36:41.311553 26760 sys_catalog.cc:455] T 00000000000000000000000000000000 P dd0a97d29f5a4da191406c0c3607eaf5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "dd0a97d29f5a4da191406c0c3607eaf5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd0a97d29f5a4da191406c0c3607eaf5" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 37093 } } }
I20260807 10:36:41.311964 26760 sys_catalog.cc:458] T 00000000000000000000000000000000 P dd0a97d29f5a4da191406c0c3607eaf5 [sys.catalog]: This master's current role is: LEADER
I20260807 10:36:41.316370 26766 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 10:36:41.321141 26766 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 10:36:41.329980 26766 catalog_manager.cc:1347] Generated new cluster ID: 9c10d94d00fa46e1961f790da711a9d4
I20260807 10:36:41.330091 26766 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 10:36:41.344239 26766 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 10:36:41.345600 26766 catalog_manager.cc:1504] Loading token signing keys...
I20260807 10:36:41.357868 26766 catalog_manager.cc:5868] T 00000000000000000000000000000000 P dd0a97d29f5a4da191406c0c3607eaf5: Generated new TSK 0
I20260807 10:36:41.358711 26766 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 10:36:41.387010 26757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:41.378787 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38994 (local address 127.20.171.126:37093)
0807 10:36:41.378982 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:41.378989 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:41.379549 (+ 560us) server_negotiation.cc:407] Connection header received
0807 10:36:41.379778 (+ 229us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:41.379783 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:41.379884 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:41.380045 (+ 161us) server_negotiation.cc:226] Negotiated authn=JWT
0807 10:36:41.380538 (+ 493us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:41.381586 (+ 1048us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:41.383018 (+ 1432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:41.383730 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:41.383860 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:41.384400 (+ 540us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0807 10:36:41.386279 (+ 1879us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39015/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0807 10:36:41.386652 (+ 373us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:38994: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39015/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":59}
W20260807 10:36:41.387213 26784 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:36:41.378779 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:37093 (local address 127.0.0.1:38994)
0807 10:36:41.379456 (+ 677us) negotiation.cc:107] Waiting for socket to connect
0807 10:36:41.379470 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 10:36:41.379586 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:36:41.380058 (+ 472us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:36:41.380061 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:36:41.380071 (+ 10us) client_negotiation.cc:189] Negotiated authn=JWT
0807 10:36:41.380398 (+ 327us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:41.380408 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:41.381713 (+ 1305us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:41.381716 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:41.382877 (+ 1161us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:41.382889 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:41.383900 (+ 1011us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:41.383904 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:41.384029 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:41.384098 (+ 69us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0807 10:36:41.386501 (+ 2403us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39015/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0807 10:36:41.386753 (+ 252us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.20.171.126:37093: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39015/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":543,"thread_start_us":376,"threads_started":1}
W20260807 10:36:41.387579 26757 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:38994: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39015/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
I20260807 10:36:41.388049 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 26684
I20260807 10:36:41.389215 26749 generic_service.cc:196] Checking for leaks (request via RPC)
E20260807 10:36:41.398434 26785 webserver.cc:533] Webserver: sslize failed:
E20260807 10:36:41.398550 26785 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260807 10:36:41.479874 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 26684
2026-08-07T10:36:41Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (725 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-08-07T10:36:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T10:36:41Z Disabled control of system clock
I20260807 10:36:41.576493 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786098956060137-21165-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786098956060137-21165-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786098956060137-21165-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.171.126:36917
--webserver_interface=127.20.171.126
--webserver_port=0
--builtin_ntp_servers=127.20.171.84:42329
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.171.126:36917
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786098956060137-21165-0/testchainca.cert with env {}
W20260807 10:36:41.906458 26790 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:36:41.906751 26790 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:36:41.906906 26790 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:36:41.914096 26790 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 10:36:41.914204 26790 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:36:41.914299 26790 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:36:41.914397 26790 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 10:36:41.914458 26790 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260807 10:36:41.914565 26790 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260807 10:36:41.914623 26790 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260807 10:36:41.924278 26790 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.171.84:42329
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786098956060137-21165-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786098956060137-21165-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.171.126:36917
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.171.126:36917
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.171.126
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786098956060137-21165-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786098956060137-21165-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:36:41.925611 26790 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:36:41.926919 26790 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:36:41.938954 26798 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:36:41.939018 26795 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:36:41.938992 26796 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:36:41.939880 26790 server_base.cc:1034] running on GCE node
I20260807 10:36:41.940706 26790 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:36:41.942031 26790 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:36:41.943260 26790 hybrid_clock.cc:648] HybridClock initialized: now 1786099001943196 us; error 41 us; skew 500 ppm
I20260807 10:36:41.943627 26790 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 10:36:41.946445 26790 webserver.cc:460] Webserver started at http://127.20.171.126:34943/ using document root <none> and password file <none>
I20260807 10:36:41.947193 26790 fs_manager.cc:359] Metadata directory not provided
I20260807 10:36:41.947289 26790 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:36:41.947643 26790 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:36:41.950681 26790 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786098956060137-21165-0/minicluster-data/master-0/data/instance:
uuid: "b46d888122274b8e839e3373d852acac"
format_stamp: "Formatted at 2026-08-07 10:36:41 on dist-test-slave-0b58"
server_key: "81cb4b86e37165a35ece128bd8ca809f"
server_key_iv: "526d7f52890d5737d99e44aa34c0991d"
server_key_version: "encryptionkey@0"
I20260807 10:36:41.951516 26790 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786098956060137-21165-0/minicluster-data/master-0/wal/instance:
uuid: "b46d888122274b8e839e3373d852acac"
format_stamp: "Formatted at 2026-08-07 10:36:41 on dist-test-slave-0b58"
server_key: "81cb4b86e37165a35ece128bd8ca809f"
server_key_iv: "526d7f52890d5737d99e44aa34c0991d"
server_key_version: "encryptionkey@0"
I20260807 10:36:41.956588 26790 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260807 10:36:41.960129 26804 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:36:41.961560 26790 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260807 10:36:41.961782 26790 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786098956060137-21165-0/minicluster-data/master-0/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786098956060137-21165-0/minicluster-data/master-0/wal
uuid: "b46d888122274b8e839e3373d852acac"
format_stamp: "Formatted at 2026-08-07 10:36:41 on dist-test-slave-0b58"
server_key: "81cb4b86e37165a35ece128bd8ca809f"
server_key_iv: "526d7f52890d5737d99e44aa34c0991d"
server_key_version: "encryptionkey@0"
I20260807 10:36:41.962023 26790 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786098956060137-21165-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786098956060137-21165-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786098956060137-21165-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:36:41.983738 26790 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:36:41.984651 26790 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:36:41.984944 26790 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:36:42.004377 26790 rpc_server.cc:307] RPC server started. Bound to: 127.20.171.126:36917
I20260807 10:36:42.004396 26855 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.171.126:36917 every 8 connection(s)
I20260807 10:36:42.005722 26790 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
I20260807 10:36:42.009512 26856 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:36:42.009735 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 26790
I20260807 10:36:42.009924 21165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786098956060137-21165-0/minicluster-data/master-0/wal/instance
I20260807 10:36:42.010574 21165 external_mini_cluster.cc:1428] Setting key abe161acc95b4f8974e438a1f2e0aab5
I20260807 10:36:42.024233 26856 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b46d888122274b8e839e3373d852acac: Bootstrap starting.
I20260807 10:36:42.026329 26859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:42.012518 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59174 (local address 127.20.171.126:36917)
0807 10:36:42.013592 (+ 1074us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:42.013607 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:42.013658 (+ 51us) server_negotiation.cc:407] Connection header received
0807 10:36:42.016358 (+ 2700us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:42.016388 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:42.016997 (+ 609us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:42.017448 (+ 451us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:36:42.017956 (+ 508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:42.019772 (+ 1816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:42.021122 (+ 1350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:42.022214 (+ 1092us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:42.022380 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:42.023520 (+ 1140us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:36:42.023530 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:36:42.023547 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:36:42.024291 (+ 744us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:36:42.024390 (+ 99us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:36:42.024417 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:36:42.024536 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:42.024718 (+ 182us) server_negotiation.cc:299] Negotiation successful
0807 10:36:42.025026 (+ 308us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":542,"thread_start_us":317,"threads_started":1}
I20260807 10:36:42.028034 26856 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b46d888122274b8e839e3373d852acac: Neither blocks nor log segments found. Creating new log.
I20260807 10:36:42.029345 26856 log.cc:824] T 00000000000000000000000000000000 P b46d888122274b8e839e3373d852acac: Log is configured to *not* fsync() on all Append() calls
I20260807 10:36:42.030356 21165 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 10:36:42.032668 26856 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b46d888122274b8e839e3373d852acac: No bootstrap required, opened a new log
I20260807 10:36:42.040320 26856 raft_consensus.cc:348] T 00000000000000000000000000000000 P b46d888122274b8e839e3373d852acac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b46d888122274b8e839e3373d852acac" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 36917 } }
I20260807 10:36:42.040673 26856 raft_consensus.cc:374] T 00000000000000000000000000000000 P b46d888122274b8e839e3373d852acac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:36:42.040741 26856 raft_consensus.cc:729] T 00000000000000000000000000000000 P b46d888122274b8e839e3373d852acac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b46d888122274b8e839e3373d852acac, State: Initialized, Role: FOLLOWER
I20260807 10:36:42.041258 26856 consensus_queue.cc:260] T 00000000000000000000000000000000 P b46d888122274b8e839e3373d852acac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b46d888122274b8e839e3373d852acac" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 36917 } }
I20260807 10:36:42.041453 26856 raft_consensus.cc:388] T 00000000000000000000000000000000 P b46d888122274b8e839e3373d852acac [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 10:36:42.041551 26856 raft_consensus.cc:482] T 00000000000000000000000000000000 P b46d888122274b8e839e3373d852acac [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 10:36:42.041671 26856 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b46d888122274b8e839e3373d852acac [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:36:42.044034 26856 raft_consensus.cc:504] T 00000000000000000000000000000000 P b46d888122274b8e839e3373d852acac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b46d888122274b8e839e3373d852acac" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 36917 } }
I20260807 10:36:42.044566 26856 leader_election.cc:302] T 00000000000000000000000000000000 P b46d888122274b8e839e3373d852acac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b46d888122274b8e839e3373d852acac; no voters:
I20260807 10:36:42.045123 26856 leader_election.cc:288] T 00000000000000000000000000000000 P b46d888122274b8e839e3373d852acac [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 10:36:42.045272 26861 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b46d888122274b8e839e3373d852acac [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:36:42.046041 26861 raft_consensus.cc:686] T 00000000000000000000000000000000 P b46d888122274b8e839e3373d852acac [term 1 LEADER]: Becoming Leader. State: Replica: b46d888122274b8e839e3373d852acac, State: Running, Role: LEADER
I20260807 10:36:42.046617 26861 consensus_queue.cc:237] T 00000000000000000000000000000000 P b46d888122274b8e839e3373d852acac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b46d888122274b8e839e3373d852acac" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 36917 } }
I20260807 10:36:42.047392 26856 sys_catalog.cc:564] T 00000000000000000000000000000000 P b46d888122274b8e839e3373d852acac [sys.catalog]: configured and running, proceeding with master startup.
I20260807 10:36:42.050033 26862 sys_catalog.cc:455] T 00000000000000000000000000000000 P b46d888122274b8e839e3373d852acac [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b46d888122274b8e839e3373d852acac" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b46d888122274b8e839e3373d852acac" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 36917 } } }
I20260807 10:36:42.050407 26862 sys_catalog.cc:458] T 00000000000000000000000000000000 P b46d888122274b8e839e3373d852acac [sys.catalog]: This master's current role is: LEADER
I20260807 10:36:42.050113 26863 sys_catalog.cc:455] T 00000000000000000000000000000000 P b46d888122274b8e839e3373d852acac [sys.catalog]: SysCatalogTable state changed. Reason: New leader b46d888122274b8e839e3373d852acac. Latest consensus state: current_term: 1 leader_uuid: "b46d888122274b8e839e3373d852acac" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b46d888122274b8e839e3373d852acac" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 36917 } } }
I20260807 10:36:42.050527 26863 sys_catalog.cc:458] T 00000000000000000000000000000000 P b46d888122274b8e839e3373d852acac [sys.catalog]: This master's current role is: LEADER
I20260807 10:36:42.052004 26868 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 10:36:42.061198 26868 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 10:36:42.070259 26868 catalog_manager.cc:1347] Generated new cluster ID: 72192583b8904711a3b401224428be35
I20260807 10:36:42.070389 26868 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 10:36:42.119119 26868 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 10:36:42.121004 26868 catalog_manager.cc:1504] Loading token signing keys...
I20260807 10:36:42.128346 26868 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b46d888122274b8e839e3373d852acac: Generated new TSK 0
I20260807 10:36:42.129191 26868 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 10:36:42.627355 26859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:42.143600 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59188 (local address 127.20.171.126:36917)
0807 10:36:42.143857 (+ 257us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:42.143863 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:42.144209 (+ 346us) server_negotiation.cc:407] Connection header received
0807 10:36:42.144501 (+ 292us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:42.144505 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:42.144579 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:42.144710 (+ 131us) server_negotiation.cc:226] Negotiated authn=JWT
0807 10:36:42.145267 (+ 557us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:42.145981 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:42.148095 (+ 2114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:42.148733 (+ 638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:42.148901 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:42.149459 (+ 558us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0807 10:36:42.626639 (+477180us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0807 10:36:42.626994 (+ 355us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:59188: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":96}
W20260807 10:36:42.627511 26859 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:59188: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
W20260807 10:36:42.627635 26885 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:36:42.143420 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:36917 (local address 127.0.0.1:59188)
0807 10:36:42.144097 (+ 677us) negotiation.cc:107] Waiting for socket to connect
0807 10:36:42.144118 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0807 10:36:42.144291 (+ 173us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:36:42.144758 (+ 467us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:36:42.144764 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:36:42.144778 (+ 14us) client_negotiation.cc:189] Negotiated authn=JWT
0807 10:36:42.145071 (+ 293us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:42.145082 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:42.146144 (+ 1062us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:42.146151 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:42.147961 (+ 1810us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:42.147975 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:42.148945 (+ 970us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:42.148951 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:42.149162 (+ 211us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:42.149208 (+ 46us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0807 10:36:42.626952 (+477744us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0807 10:36:42.627229 (+ 277us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.20.171.126:36917: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":514,"thread_start_us":361,"threads_started":1}
I20260807 10:36:42.629897 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 26790
I20260807 10:36:42.631003 26851 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:36:42.734697 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 26790
2026-08-07T10:36:42Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (1236 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (415 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (414 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786098956060137-21165-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 10:36:43 dist-test-slave-0b58 krb5kdc[26900](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 10:36:43 dist-test-slave-0b58 krb5kdc[26900](info): set up 2 sockets
Aug 07 10:36:43 dist-test-slave-0b58 krb5kdc[26900](info): commencing operation
krb5kdc: starting...
W20260807 10:36:44.649648 21165 mini_kdc.cc:121] Time spent starting KDC: real 1.043s user 0.000s sys 0.032s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786098956060137-21165-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786098956060137-21165-0/krb5kdc/test-user.keytab.
Aug 07 10:36:44 dist-test-slave-0b58 krb5kdc[26900](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099004, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T10:36:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T10:36:44Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.171.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.171.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.171.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.126.keytab.
Entry for principal kudu/127.20.171.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.126.keytab.
I20260807 10:36:44.855396 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786098956060137-21165-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786098956060137-21165-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786098956060137-21165-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.171.126:33197
--webserver_interface=127.20.171.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.126.keytab
--principal=kudu/127.20.171.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.171.84:44995
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.171.126:33197
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786098956060137-21165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786098956060137-21165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786098956060137-21165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:36:45.167881 26914 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:36:45.168294 26914 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:36:45.168470 26914 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:36:45.176074 26914 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 10:36:45.176283 26914 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:36:45.176414 26914 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:36:45.176519 26914 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 10:36:45.176608 26914 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 10:36:45.186797 26914 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.171.84:44995
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786098956060137-21165-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786098956060137-21165-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.171.126:33197
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.126.keytab
--principal=kudu/127.20.171.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.171.126:33197
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.171.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786098956060137-21165-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:36:45.188154 26914 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:36:45.189481 26914 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:36:45.201208 26919 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:36:45.201221 26920 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:36:45.201460 26922 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:36:45.202294 26914 server_base.cc:1034] running on GCE node
I20260807 10:36:45.203096 26914 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:36:45.204463 26914 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:36:45.205703 26914 hybrid_clock.cc:648] HybridClock initialized: now 1786099005205635 us; error 43 us; skew 500 ppm
I20260807 10:36:45.206154 26914 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:36:45 dist-test-slave-0b58 krb5kdc[26900](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099005, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:36:45.212634 26914 init.cc:377] Logged in from keytab as kudu/127.20.171.126@KRBTEST.COM (short username kudu)
I20260807 10:36:45.214217 26914 webserver.cc:460] Webserver started at http://127.20.171.126:33815/ using document root <none> and password file <none>
I20260807 10:36:45.214879 26914 fs_manager.cc:359] Metadata directory not provided
I20260807 10:36:45.215022 26914 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:36:45.215346 26914 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:36:45.218312 26914 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786098956060137-21165-0/minicluster-data/master-0/data/instance:
uuid: "03f47afd8c074e9b83ef0e4842f89e7a"
format_stamp: "Formatted at 2026-08-07 10:36:45 on dist-test-slave-0b58"
server_key: "dd2b80fb25b4cf6611f70a45f373b2b1"
server_key_iv: "7e003c6d2def91fbef044675bb005759"
server_key_version: "encryptionkey@0"
I20260807 10:36:45.219189 26914 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786098956060137-21165-0/minicluster-data/master-0/wal/instance:
uuid: "03f47afd8c074e9b83ef0e4842f89e7a"
format_stamp: "Formatted at 2026-08-07 10:36:45 on dist-test-slave-0b58"
server_key: "dd2b80fb25b4cf6611f70a45f373b2b1"
server_key_iv: "7e003c6d2def91fbef044675bb005759"
server_key_version: "encryptionkey@0"
I20260807 10:36:45.224436 26914 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.005s
I20260807 10:36:45.227998 26929 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:36:45.229290 26914 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 10:36:45.229475 26914 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786098956060137-21165-0/minicluster-data/master-0/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786098956060137-21165-0/minicluster-data/master-0/wal
uuid: "03f47afd8c074e9b83ef0e4842f89e7a"
format_stamp: "Formatted at 2026-08-07 10:36:45 on dist-test-slave-0b58"
server_key: "dd2b80fb25b4cf6611f70a45f373b2b1"
server_key_iv: "7e003c6d2def91fbef044675bb005759"
server_key_version: "encryptionkey@0"
I20260807 10:36:45.229667 26914 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786098956060137-21165-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786098956060137-21165-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786098956060137-21165-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:36:45.246167 26914 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:36:45.250213 26914 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:36:45.250519 26914 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:36:45.269659 26914 rpc_server.cc:307] RPC server started. Bound to: 127.20.171.126:33197
I20260807 10:36:45.269709 26981 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.171.126:33197 every 8 connection(s)
I20260807 10:36:45.270967 26914 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
I20260807 10:36:45.272876 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 26914
I20260807 10:36:45.273102 21165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786098956060137-21165-0/minicluster-data/master-0/wal/instance
I20260807 10:36:45.273945 21165 external_mini_cluster.cc:1428] Setting key f701aad10f9ee54c3bdd206fd959989b
I20260807 10:36:45.275662 26982 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 07 10:36:45 dist-test-slave-0b58 krb5kdc[26900](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099004, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.171.126@KRBTEST.COM
I20260807 10:36:45.289676 26982 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 03f47afd8c074e9b83ef0e4842f89e7a: Bootstrap starting.
I20260807 10:36:45.292732 26982 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 03f47afd8c074e9b83ef0e4842f89e7a: Neither blocks nor log segments found. Creating new log.
I20260807 10:36:45.293793 26982 log.cc:824] T 00000000000000000000000000000000 P 03f47afd8c074e9b83ef0e4842f89e7a: Log is configured to *not* fsync() on all Append() calls
I20260807 10:36:45.296764 26982 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 03f47afd8c074e9b83ef0e4842f89e7a: No bootstrap required, opened a new log
I20260807 10:36:45.297195 26985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:45.276031 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50032 (local address 127.20.171.126:33197)
0807 10:36:45.276829 (+ 798us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:45.276839 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:45.276877 (+ 38us) server_negotiation.cc:407] Connection header received
0807 10:36:45.278483 (+ 1606us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:45.278502 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:45.278843 (+ 341us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:45.279136 (+ 293us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:36:45.280764 (+ 1628us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:45.282547 (+ 1783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:45.284446 (+ 1899us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:45.285061 (+ 615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:45.285220 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:45.289704 (+ 4484us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:36:45.289712 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:36:45.289724 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:36:45.289785 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:36:45.292996 (+ 3211us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:45.293708 (+ 712us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:45.293715 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:45.293721 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:45.294002 (+ 281us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:45.294381 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:45.294392 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:45.294394 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:45.294939 (+ 545us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:36:45.295254 (+ 315us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:45.295664 (+ 410us) server_negotiation.cc:299] Negotiation successful
0807 10:36:45.296071 (+ 407us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":597,"thread_start_us":407,"threads_started":1}
I20260807 10:36:45.304240 26982 raft_consensus.cc:348] T 00000000000000000000000000000000 P 03f47afd8c074e9b83ef0e4842f89e7a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03f47afd8c074e9b83ef0e4842f89e7a" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 33197 } }
I20260807 10:36:45.304629 26982 raft_consensus.cc:374] T 00000000000000000000000000000000 P 03f47afd8c074e9b83ef0e4842f89e7a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:36:45.304744 26982 raft_consensus.cc:729] T 00000000000000000000000000000000 P 03f47afd8c074e9b83ef0e4842f89e7a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03f47afd8c074e9b83ef0e4842f89e7a, State: Initialized, Role: FOLLOWER
I20260807 10:36:45.305289 26982 consensus_queue.cc:260] T 00000000000000000000000000000000 P 03f47afd8c074e9b83ef0e4842f89e7a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03f47afd8c074e9b83ef0e4842f89e7a" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 33197 } }
I20260807 10:36:45.305538 26982 raft_consensus.cc:388] T 00000000000000000000000000000000 P 03f47afd8c074e9b83ef0e4842f89e7a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 10:36:45.305728 26982 raft_consensus.cc:482] T 00000000000000000000000000000000 P 03f47afd8c074e9b83ef0e4842f89e7a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 10:36:45.305908 26982 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 03f47afd8c074e9b83ef0e4842f89e7a [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:36:45.308139 26982 raft_consensus.cc:504] T 00000000000000000000000000000000 P 03f47afd8c074e9b83ef0e4842f89e7a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03f47afd8c074e9b83ef0e4842f89e7a" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 33197 } }
I20260807 10:36:45.308678 26982 leader_election.cc:302] T 00000000000000000000000000000000 P 03f47afd8c074e9b83ef0e4842f89e7a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 03f47afd8c074e9b83ef0e4842f89e7a; no voters:
I20260807 10:36:45.309288 26982 leader_election.cc:288] T 00000000000000000000000000000000 P 03f47afd8c074e9b83ef0e4842f89e7a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 10:36:45.309432 26988 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 03f47afd8c074e9b83ef0e4842f89e7a [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:36:45.310866 26988 raft_consensus.cc:686] T 00000000000000000000000000000000 P 03f47afd8c074e9b83ef0e4842f89e7a [term 1 LEADER]: Becoming Leader. State: Replica: 03f47afd8c074e9b83ef0e4842f89e7a, State: Running, Role: LEADER
I20260807 10:36:45.311353 26982 sys_catalog.cc:564] T 00000000000000000000000000000000 P 03f47afd8c074e9b83ef0e4842f89e7a [sys.catalog]: configured and running, proceeding with master startup.
I20260807 10:36:45.311334 26988 consensus_queue.cc:237] T 00000000000000000000000000000000 P 03f47afd8c074e9b83ef0e4842f89e7a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03f47afd8c074e9b83ef0e4842f89e7a" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 33197 } }
I20260807 10:36:45.314473 26989 sys_catalog.cc:455] T 00000000000000000000000000000000 P 03f47afd8c074e9b83ef0e4842f89e7a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "03f47afd8c074e9b83ef0e4842f89e7a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03f47afd8c074e9b83ef0e4842f89e7a" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 33197 } } }
I20260807 10:36:45.314373 26990 sys_catalog.cc:455] T 00000000000000000000000000000000 P 03f47afd8c074e9b83ef0e4842f89e7a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 03f47afd8c074e9b83ef0e4842f89e7a. Latest consensus state: current_term: 1 leader_uuid: "03f47afd8c074e9b83ef0e4842f89e7a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03f47afd8c074e9b83ef0e4842f89e7a" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 33197 } } }
I20260807 10:36:45.314819 26989 sys_catalog.cc:458] T 00000000000000000000000000000000 P 03f47afd8c074e9b83ef0e4842f89e7a [sys.catalog]: This master's current role is: LEADER
I20260807 10:36:45.314819 26990 sys_catalog.cc:458] T 00000000000000000000000000000000 P 03f47afd8c074e9b83ef0e4842f89e7a [sys.catalog]: This master's current role is: LEADER
I20260807 10:36:45.318114 26996 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 10:36:45.322556 26996 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 10:36:45.330709 26996 catalog_manager.cc:1347] Generated new cluster ID: fa3142182f7a4331b66e7257b3e8ed81
I20260807 10:36:45.330915 26996 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 10:36:45.341831 26996 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 10:36:45.343068 26996 catalog_manager.cc:1504] Loading token signing keys...
I20260807 10:36:45.354017 26996 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 03f47afd8c074e9b83ef0e4842f89e7a: Generated new TSK 0
I20260807 10:36:45.354847 26996 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.171.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.171.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.171.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.65.keytab.
Entry for principal kudu/127.20.171.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.65.keytab.
I20260807 10:36:45.416092 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786098956060137-21165-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786098956060137-21165-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786098956060137-21165-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786098956060137-21165-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.171.65:0
--local_ip_for_outbound_sockets=127.20.171.65
--webserver_interface=127.20.171.65
--webserver_port=0
--tserver_master_addrs=127.20.171.126:33197
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.65.keytab
--principal=kudu/127.20.171.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.171.84:44995
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786098956060137-21165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786098956060137-21165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786098956060137-21165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:36:45.743606 27009 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:36:45.743860 27009 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:36:45.743953 27009 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:36:45.750969 27009 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:36:45.751066 27009 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:36:45.751179 27009 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.171.65
I20260807 10:36:45.761026 27009 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.171.84:44995
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786098956060137-21165-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786098956060137-21165-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.65.keytab
--principal=kudu/127.20.171.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.171.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786098956060137-21165-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.171.65
--webserver_port=0
--tserver_master_addrs=127.20.171.126:33197
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.171.65
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786098956060137-21165-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:36:45.762239 27009 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:36:45.763486 27009 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:36:45.776491 27017 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:36:45.776419 27015 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:36:45.776536 27014 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:36:45.777365 27009 server_base.cc:1034] running on GCE node
I20260807 10:36:45.777926 27009 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:36:45.778867 27009 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:36:45.780082 27009 hybrid_clock.cc:648] HybridClock initialized: now 1786099005780034 us; error 32 us; skew 500 ppm
I20260807 10:36:45.780445 27009 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:36:45 dist-test-slave-0b58 krb5kdc[26900](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099005, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:36:45.783541 27009 init.cc:377] Logged in from keytab as kudu/127.20.171.65@KRBTEST.COM (short username kudu)
I20260807 10:36:45.785058 27009 webserver.cc:460] Webserver started at http://127.20.171.65:38979/ using document root <none> and password file <none>
I20260807 10:36:45.785712 27009 fs_manager.cc:359] Metadata directory not provided
I20260807 10:36:45.785857 27009 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:36:45.786201 27009 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:36:45.789194 27009 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786098956060137-21165-0/minicluster-data/ts-0/data/instance:
uuid: "c0d97f967976429aa557a88824e682c5"
format_stamp: "Formatted at 2026-08-07 10:36:45 on dist-test-slave-0b58"
server_key: "0fdea4db94c66e684660640609298aa0"
server_key_iv: "3fdcf4a9d9f41c191c206c959924eb98"
server_key_version: "encryptionkey@0"
I20260807 10:36:45.789983 27009 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786098956060137-21165-0/minicluster-data/ts-0/wal/instance:
uuid: "c0d97f967976429aa557a88824e682c5"
format_stamp: "Formatted at 2026-08-07 10:36:45 on dist-test-slave-0b58"
server_key: "0fdea4db94c66e684660640609298aa0"
server_key_iv: "3fdcf4a9d9f41c191c206c959924eb98"
server_key_version: "encryptionkey@0"
I20260807 10:36:45.795110 27009 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260807 10:36:45.798466 27024 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:36:45.799837 27009 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.001s
I20260807 10:36:45.800037 27009 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786098956060137-21165-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786098956060137-21165-0/minicluster-data/ts-0/wal
uuid: "c0d97f967976429aa557a88824e682c5"
format_stamp: "Formatted at 2026-08-07 10:36:45 on dist-test-slave-0b58"
server_key: "0fdea4db94c66e684660640609298aa0"
server_key_iv: "3fdcf4a9d9f41c191c206c959924eb98"
server_key_version: "encryptionkey@0"
I20260807 10:36:45.800320 27009 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786098956060137-21165-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786098956060137-21165-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786098956060137-21165-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:36:45.813702 27009 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:36:45.817442 27009 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:36:45.817762 27009 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:36:45.818661 27009 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:36:45.819829 27009 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:36:45.819921 27009 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:36:45.820048 27009 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:36:45.820116 27009 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:36:45.853286 27009 rpc_server.cc:307] RPC server started. Bound to: 127.20.171.65:41689
I20260807 10:36:45.853404 27139 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.171.65:41689 every 8 connection(s)
I20260807 10:36:45.854661 27009 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786098956060137-21165-0/minicluster-data/ts-0/data/info.pb
I20260807 10:36:45.861785 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 27009
I20260807 10:36:45.862010 21165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786098956060137-21165-0/minicluster-data/ts-0/wal/instance
I20260807 10:36:45.862649 21165 external_mini_cluster.cc:1428] Setting key 25f48ef1beec44426c4a4e2c2303a08a
Aug 07 10:36:45 dist-test-slave-0b58 krb5kdc[26900](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099005, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.65@KRBTEST.COM for kudu/127.20.171.126@KRBTEST.COM
I20260807 10:36:45.876122 27142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:45.857229 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.65:55225 (local address 127.20.171.126:33197)
0807 10:36:45.857704 (+ 475us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:45.857710 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:45.858632 (+ 922us) server_negotiation.cc:407] Connection header received
0807 10:36:45.860247 (+ 1615us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:45.860251 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:45.860396 (+ 145us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:45.860494 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:36:45.862234 (+ 1740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:45.862968 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:45.865076 (+ 2108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:45.865471 (+ 395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:45.865573 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:45.869603 (+ 4030us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:36:45.869611 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:36:45.869618 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:36:45.869660 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:36:45.873235 (+ 3575us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:45.873954 (+ 719us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:45.873963 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:45.873968 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:45.874136 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:45.874545 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:45.874552 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:45.874557 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:45.874912 (+ 355us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:36:45.875064 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:45.875726 (+ 662us) server_negotiation.cc:299] Negotiation successful
0807 10:36:45.875877 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":307,"thread_start_us":199,"threads_started":1}
I20260807 10:36:45.877579 27143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:45.857760 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:33197 (local address 127.20.171.65:55225)
0807 10:36:45.858486 (+ 726us) negotiation.cc:107] Waiting for socket to connect
0807 10:36:45.858521 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0807 10:36:45.860000 (+ 1479us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:36:45.860697 (+ 697us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:36:45.860705 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:36:45.861213 (+ 508us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:36:45.862067 (+ 854us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:45.862093 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:45.863131 (+ 1038us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:45.863136 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:45.864913 (+ 1777us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:45.864931 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:45.865701 (+ 770us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:45.865710 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:45.866000 (+ 290us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:45.866798 (+ 798us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:36:45.866832 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:36:45.869403 (+ 2571us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:36:45.873391 (+ 3988us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:36:45.873398 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:36:45.873409 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:36:45.873837 (+ 428us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:36:45.874260 (+ 423us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:36:45.874264 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:36:45.874266 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:36:45.874442 (+ 176us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:36:45.875033 (+ 591us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:36:45.875038 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:36:45.875355 (+ 317us) client_negotiation.cc:769] Sending connection context
0807 10:36:45.875609 (+ 254us) client_negotiation.cc:240] Negotiation successful
0807 10:36:45.876171 (+ 562us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":490,"thread_start_us":284,"threads_started":1}
I20260807 10:36:45.879109 27140 heartbeater.cc:347] Connected to a master server at 127.20.171.126:33197
I20260807 10:36:45.879410 27140 heartbeater.cc:464] Registering TS with master...
I20260807 10:36:45.880074 27140 heartbeater.cc:511] Master 127.20.171.126:33197 requested a full tablet report, sending...
I20260807 10:36:45.882102 26946 ts_manager.cc:194] Registered new tserver with Master: c0d97f967976429aa557a88824e682c5 (127.20.171.65:41689)
I20260807 10:36:45.883558 26946 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.171.65@KRBTEST.COM'} at 127.20.171.65:55225
WARNING: no policy specified for kudu/127.20.171.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.171.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.171.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.66.keytab.
Entry for principal kudu/127.20.171.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.66.keytab.
I20260807 10:36:45.919894 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786098956060137-21165-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786098956060137-21165-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786098956060137-21165-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786098956060137-21165-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.171.66:0
--local_ip_for_outbound_sockets=127.20.171.66
--webserver_interface=127.20.171.66
--webserver_port=0
--tserver_master_addrs=127.20.171.126:33197
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.66.keytab
--principal=kudu/127.20.171.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.171.84:44995
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786098956060137-21165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786098956060137-21165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786098956060137-21165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:36:46.242502 27146 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:36:46.242791 27146 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:36:46.242993 27146 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:36:46.250037 27146 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:36:46.250169 27146 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:36:46.250367 27146 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.171.66
I20260807 10:36:46.259479 27146 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.171.84:44995
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786098956060137-21165-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786098956060137-21165-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.66.keytab
--principal=kudu/127.20.171.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.171.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786098956060137-21165-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.171.66
--webserver_port=0
--tserver_master_addrs=127.20.171.126:33197
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.171.66
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786098956060137-21165-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:36:46.260795 27146 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:36:46.262099 27146 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:36:46.274718 27151 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:36:46.274883 27152 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:36:46.275278 27154 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:36:46.275705 27146 server_base.cc:1034] running on GCE node
I20260807 10:36:46.276353 27146 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:36:46.277339 27146 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:36:46.278566 27146 hybrid_clock.cc:648] HybridClock initialized: now 1786099006278510 us; error 46 us; skew 500 ppm
I20260807 10:36:46.278873 27146 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:36:46 dist-test-slave-0b58 krb5kdc[26900](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099006, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:36:46.282232 27146 init.cc:377] Logged in from keytab as kudu/127.20.171.66@KRBTEST.COM (short username kudu)
I20260807 10:36:46.283717 27146 webserver.cc:460] Webserver started at http://127.20.171.66:34341/ using document root <none> and password file <none>
I20260807 10:36:46.284457 27146 fs_manager.cc:359] Metadata directory not provided
I20260807 10:36:46.284605 27146 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:36:46.284917 27146 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:36:46.287778 27146 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786098956060137-21165-0/minicluster-data/ts-1/data/instance:
uuid: "1fb3157d573f4c799bf9a5c01090383e"
format_stamp: "Formatted at 2026-08-07 10:36:46 on dist-test-slave-0b58"
server_key: "87b5526270d74c8ec7fcc4e0e304bffc"
server_key_iv: "decf5ba739b11e4c3b15847f07469191"
server_key_version: "encryptionkey@0"
I20260807 10:36:46.288578 27146 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786098956060137-21165-0/minicluster-data/ts-1/wal/instance:
uuid: "1fb3157d573f4c799bf9a5c01090383e"
format_stamp: "Formatted at 2026-08-07 10:36:46 on dist-test-slave-0b58"
server_key: "87b5526270d74c8ec7fcc4e0e304bffc"
server_key_iv: "decf5ba739b11e4c3b15847f07469191"
server_key_version: "encryptionkey@0"
I20260807 10:36:46.293581 27146 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.002s
I20260807 10:36:46.296828 27161 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:36:46.297945 27146 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.004s sys 0.000s
I20260807 10:36:46.298105 27146 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786098956060137-21165-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786098956060137-21165-0/minicluster-data/ts-1/wal
uuid: "1fb3157d573f4c799bf9a5c01090383e"
format_stamp: "Formatted at 2026-08-07 10:36:46 on dist-test-slave-0b58"
server_key: "87b5526270d74c8ec7fcc4e0e304bffc"
server_key_iv: "decf5ba739b11e4c3b15847f07469191"
server_key_version: "encryptionkey@0"
I20260807 10:36:46.298303 27146 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786098956060137-21165-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786098956060137-21165-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786098956060137-21165-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:36:46.318419 27146 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:36:46.322142 27146 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:36:46.322402 27146 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:36:46.323303 27146 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:36:46.324680 27146 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:36:46.324769 27146 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:36:46.324899 27146 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:36:46.324962 27146 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:36:46.356839 27146 rpc_server.cc:307] RPC server started. Bound to: 127.20.171.66:38883
I20260807 10:36:46.356904 27276 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.171.66:38883 every 8 connection(s)
I20260807 10:36:46.358165 27146 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786098956060137-21165-0/minicluster-data/ts-1/data/info.pb
I20260807 10:36:46.361910 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 27146
I20260807 10:36:46.362113 21165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786098956060137-21165-0/minicluster-data/ts-1/wal/instance
I20260807 10:36:46.362535 21165 external_mini_cluster.cc:1428] Setting key ad9f78485afd66a4edd6eecac92e95d6
Aug 07 10:36:46 dist-test-slave-0b58 krb5kdc[26900](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099006, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.66@KRBTEST.COM for kudu/127.20.171.126@KRBTEST.COM
I20260807 10:36:46.378155 27142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:46.360514 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.66:45325 (local address 127.20.171.126:33197)
0807 10:36:46.360679 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:46.360684 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:46.361761 (+ 1077us) server_negotiation.cc:407] Connection header received
0807 10:36:46.363806 (+ 2045us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:46.363812 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:46.363900 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:46.364008 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:36:46.365556 (+ 1548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:46.366319 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:46.367814 (+ 1495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:46.368305 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:46.368427 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:46.371591 (+ 3164us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:36:46.371598 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:36:46.371604 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:36:46.371663 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:36:46.374991 (+ 3328us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:46.375890 (+ 899us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:46.375894 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:46.375896 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:46.376030 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:46.376538 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:46.376541 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:46.376542 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:46.376794 (+ 252us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:36:46.376900 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:46.377745 (+ 845us) server_negotiation.cc:299] Negotiation successful
0807 10:36:46.377918 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260807 10:36:46.379617 27279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:46.360943 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:33197 (local address 127.20.171.66:45325)
0807 10:36:46.361605 (+ 662us) negotiation.cc:107] Waiting for socket to connect
0807 10:36:46.361640 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0807 10:36:46.363535 (+ 1895us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:36:46.364289 (+ 754us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:36:46.364302 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:36:46.364894 (+ 592us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:36:46.365388 (+ 494us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:46.365402 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:46.366481 (+ 1079us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:46.366486 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:46.367667 (+ 1181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:46.367678 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:46.368507 (+ 829us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:46.368513 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:46.368755 (+ 242us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:46.369402 (+ 647us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:36:46.369423 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:36:46.371370 (+ 1947us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:36:46.375124 (+ 3754us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:36:46.375134 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:36:46.375152 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:36:46.375783 (+ 631us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:36:46.376128 (+ 345us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:36:46.376135 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:36:46.376140 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:36:46.376437 (+ 297us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:36:46.376911 (+ 474us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:36:46.376922 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:36:46.377383 (+ 461us) client_negotiation.cc:769] Sending connection context
0807 10:36:46.377658 (+ 275us) client_negotiation.cc:240] Negotiation successful
0807 10:36:46.378177 (+ 519us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":457,"thread_start_us":272,"threads_started":1}
I20260807 10:36:46.381074 27277 heartbeater.cc:347] Connected to a master server at 127.20.171.126:33197
I20260807 10:36:46.381385 27277 heartbeater.cc:464] Registering TS with master...
I20260807 10:36:46.382036 27277 heartbeater.cc:511] Master 127.20.171.126:33197 requested a full tablet report, sending...
I20260807 10:36:46.383586 26946 ts_manager.cc:194] Registered new tserver with Master: 1fb3157d573f4c799bf9a5c01090383e (127.20.171.66:38883)
I20260807 10:36:46.384461 26946 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.171.66@KRBTEST.COM'} at 127.20.171.66:45325
WARNING: no policy specified for kudu/127.20.171.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.171.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.171.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.67.keytab.
Entry for principal kudu/127.20.171.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.67.keytab.
I20260807 10:36:46.420409 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786098956060137-21165-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786098956060137-21165-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786098956060137-21165-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786098956060137-21165-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.171.67:0
--local_ip_for_outbound_sockets=127.20.171.67
--webserver_interface=127.20.171.67
--webserver_port=0
--tserver_master_addrs=127.20.171.126:33197
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.67.keytab
--principal=kudu/127.20.171.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.171.84:44995
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786098956060137-21165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786098956060137-21165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786098956060137-21165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:36:46.736318 27282 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:36:46.736627 27282 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:36:46.736790 27282 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:36:46.743243 27282 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:36:46.743386 27282 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:36:46.743572 27282 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.171.67
I20260807 10:36:46.752746 27282 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.171.84:44995
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786098956060137-21165-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786098956060137-21165-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.67.keytab
--principal=kudu/127.20.171.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.171.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786098956060137-21165-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.171.67
--webserver_port=0
--tserver_master_addrs=127.20.171.126:33197
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.171.67
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786098956060137-21165-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:36:46.754076 27282 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:36:46.755373 27282 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:36:46.768561 27287 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:36:46.768603 27288 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:36:46.768621 27290 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:36:46.769549 27282 server_base.cc:1034] running on GCE node
I20260807 10:36:46.770184 27282 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:36:46.771111 27282 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:36:46.772358 27282 hybrid_clock.cc:648] HybridClock initialized: now 1786099006772320 us; error 52 us; skew 500 ppm
I20260807 10:36:46.772671 27282 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:36:46 dist-test-slave-0b58 krb5kdc[26900](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099006, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:36:46.775885 27282 init.cc:377] Logged in from keytab as kudu/127.20.171.67@KRBTEST.COM (short username kudu)
I20260807 10:36:46.777351 27282 webserver.cc:460] Webserver started at http://127.20.171.67:46809/ using document root <none> and password file <none>
I20260807 10:36:46.777976 27282 fs_manager.cc:359] Metadata directory not provided
I20260807 10:36:46.778074 27282 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:36:46.778344 27282 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:36:46.781221 27282 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786098956060137-21165-0/minicluster-data/ts-2/data/instance:
uuid: "4226fdbc581a40eab34b0253f3aa6355"
format_stamp: "Formatted at 2026-08-07 10:36:46 on dist-test-slave-0b58"
server_key: "c6963842187a2fdc5cc9113b0510c698"
server_key_iv: "46295fdad246689fcc75e1c6cda344c4"
server_key_version: "encryptionkey@0"
I20260807 10:36:46.782025 27282 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786098956060137-21165-0/minicluster-data/ts-2/wal/instance:
uuid: "4226fdbc581a40eab34b0253f3aa6355"
format_stamp: "Formatted at 2026-08-07 10:36:46 on dist-test-slave-0b58"
server_key: "c6963842187a2fdc5cc9113b0510c698"
server_key_iv: "46295fdad246689fcc75e1c6cda344c4"
server_key_version: "encryptionkey@0"
I20260807 10:36:46.787163 27282 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260807 10:36:46.790498 27297 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:36:46.791757 27282 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260807 10:36:46.791922 27282 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786098956060137-21165-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786098956060137-21165-0/minicluster-data/ts-2/wal
uuid: "4226fdbc581a40eab34b0253f3aa6355"
format_stamp: "Formatted at 2026-08-07 10:36:46 on dist-test-slave-0b58"
server_key: "c6963842187a2fdc5cc9113b0510c698"
server_key_iv: "46295fdad246689fcc75e1c6cda344c4"
server_key_version: "encryptionkey@0"
I20260807 10:36:46.792130 27282 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786098956060137-21165-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786098956060137-21165-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786098956060137-21165-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:36:46.827536 27282 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:36:46.831816 27282 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:36:46.832053 27282 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:36:46.833043 27282 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:36:46.834473 27282 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:36:46.834542 27282 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:36:46.834633 27282 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:36:46.834682 27282 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:36:46.867136 27282 rpc_server.cc:307] RPC server started. Bound to: 127.20.171.67:45407
I20260807 10:36:46.867228 27414 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.171.67:45407 every 8 connection(s)
I20260807 10:36:46.868466 27282 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786098956060137-21165-0/minicluster-data/ts-2/data/info.pb
I20260807 10:36:46.874300 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 27282
I20260807 10:36:46.874485 21165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786098956060137-21165-0/minicluster-data/ts-2/wal/instance
I20260807 10:36:46.874979 21165 external_mini_cluster.cc:1428] Setting key ecbc1268325005f676e33b112f3aecb2
Aug 07 10:36:46 dist-test-slave-0b58 krb5kdc[26900](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099006, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.67@KRBTEST.COM for kudu/127.20.171.126@KRBTEST.COM
I20260807 10:36:46.886462 27140 heartbeater.cc:503] Master 127.20.171.126:33197 was elected leader, sending a full tablet report...
I20260807 10:36:46.887538 27142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:46.871058 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.67:58103 (local address 127.20.171.126:33197)
0807 10:36:46.871264 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:46.871269 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:46.872388 (+ 1119us) server_negotiation.cc:407] Connection header received
0807 10:36:46.874300 (+ 1912us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:46.874305 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:46.874411 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:46.874544 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:36:46.876045 (+ 1501us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:46.876874 (+ 829us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:46.878405 (+ 1531us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:46.878781 (+ 376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:46.878908 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:46.882037 (+ 3129us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:36:46.882041 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:36:46.882044 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:36:46.882073 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:36:46.884497 (+ 2424us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:46.885178 (+ 681us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:46.885184 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:46.885188 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:46.885324 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:46.885762 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:46.885767 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:46.885783 (+ 16us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:46.886026 (+ 243us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:36:46.886202 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:46.886917 (+ 715us) server_negotiation.cc:299] Negotiation successful
0807 10:36:46.887137 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260807 10:36:46.888705 27417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:46.871525 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:33197 (local address 127.20.171.67:58103)
0807 10:36:46.872192 (+ 667us) negotiation.cc:107] Waiting for socket to connect
0807 10:36:46.872233 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0807 10:36:46.874004 (+ 1771us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:36:46.874777 (+ 773us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:36:46.874785 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:36:46.875331 (+ 546us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:36:46.875860 (+ 529us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:46.875878 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:46.877034 (+ 1156us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:46.877045 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:46.878265 (+ 1220us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:46.878277 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:46.879009 (+ 732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:46.879016 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:46.879234 (+ 218us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:46.879792 (+ 558us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:36:46.879814 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:36:46.881853 (+ 2039us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:36:46.884626 (+ 2773us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:36:46.884634 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:36:46.884648 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:36:46.885057 (+ 409us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:36:46.885436 (+ 379us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:36:46.885441 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:36:46.885444 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:36:46.885631 (+ 187us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:36:46.886159 (+ 528us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:36:46.886166 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:36:46.886503 (+ 337us) client_negotiation.cc:769] Sending connection context
0807 10:36:46.886821 (+ 318us) client_negotiation.cc:240] Negotiation successful
0807 10:36:46.887349 (+ 528us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":457,"thread_start_us":283,"threads_started":1}
I20260807 10:36:46.890157 27415 heartbeater.cc:347] Connected to a master server at 127.20.171.126:33197
I20260807 10:36:46.890435 27415 heartbeater.cc:464] Registering TS with master...
I20260807 10:36:46.891086 27415 heartbeater.cc:511] Master 127.20.171.126:33197 requested a full tablet report, sending...
I20260807 10:36:46.892395 26946 ts_manager.cc:194] Registered new tserver with Master: 4226fdbc581a40eab34b0253f3aa6355 (127.20.171.67:45407)
I20260807 10:36:46.893177 26946 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.171.67@KRBTEST.COM'} at 127.20.171.67:58103
I20260807 10:36:46.902050 21165 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786098956060137-21165-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786098956060137-21165-0/krb5kdc/test-admin.keytab.
Aug 07 10:36:46 dist-test-slave-0b58 krb5kdc[26900](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099006, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:36:46.933553 21165 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260807 10:36:46.938853 27422 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:36:46.936383 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40794 (local address 127.20.171.65:41689)
0807 10:36:46.937009 (+ 626us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:46.937017 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:46.937047 (+ 30us) server_negotiation.cc:407] Connection header received
0807 10:36:46.937121 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:46.937127 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:46.937321 (+ 194us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:46.937501 (+ 180us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:36:46.938374 (+ 873us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40794: BlockingRecv error: recv got EOF from 127.0.0.1:40794 (error 108)
Metrics: {"server-negotiator.queue_time_us":449,"thread_start_us":271,"threads_started":1}
W20260807 10:36:46.938911 21165 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786098956060137-21165-0/krb5kdc/krb5cc' of type FILE
Aug 07 10:36:46 dist-test-slave-0b58 krb5kdc[26900](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099006, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:36:46.940487 21165 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 07 10:36:46 dist-test-slave-0b58 krb5kdc[26900](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099006, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:36:46.941809 21165 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 07 10:36:46 dist-test-slave-0b58 krb5kdc[26900](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099006, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.171.65@KRBTEST.COM
I20260807 10:36:46.956218 27422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:46.943352 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40806 (local address 127.20.171.65:41689)
0807 10:36:46.943536 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:46.943543 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:46.943708 (+ 165us) server_negotiation.cc:407] Connection header received
0807 10:36:46.943840 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:46.943843 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:46.943897 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:46.943973 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:36:46.945109 (+ 1136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:46.946072 (+ 963us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:46.947235 (+ 1163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:46.947780 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:46.947872 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:46.951133 (+ 3261us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:36:46.951144 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:36:46.951158 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:36:46.951202 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:36:46.953824 (+ 2622us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:46.954434 (+ 610us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:46.954441 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:46.954443 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:46.954559 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:46.954881 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:46.954885 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:46.954887 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:46.955202 (+ 315us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:36:46.955419 (+ 217us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:46.955691 (+ 272us) server_negotiation.cc:299] Negotiation successful
0807 10:36:46.955963 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
W20260807 10:36:46.961725 27422 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:36:46.960028 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40810 (local address 127.20.171.65:41689)
0807 10:36:46.960224 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:46.960230 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:46.960533 (+ 303us) server_negotiation.cc:407] Connection header received
0807 10:36:46.960701 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:46.960710 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:46.960773 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:46.960867 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:36:46.961503 (+ 636us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40810: BlockingRecv error: recv got EOF from 127.0.0.1:40810 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
W20260807 10:36:46.961902 21165 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786098956060137-21165-0/krb5kdc/krb5cc' of type FILE
Aug 07 10:36:46 dist-test-slave-0b58 krb5kdc[26900](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099006, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:36:46.963387 21165 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 07 10:36:46 dist-test-slave-0b58 krb5kdc[26900](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099006, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:36:46.964721 21165 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 07 10:36:46 dist-test-slave-0b58 krb5kdc[26900](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099006, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.171.65@KRBTEST.COM
I20260807 10:36:46.977831 27422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:46.965789 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40822 (local address 127.20.171.65:41689)
0807 10:36:46.965964 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:46.965970 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:46.966265 (+ 295us) server_negotiation.cc:407] Connection header received
0807 10:36:46.966430 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:46.966434 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:46.966495 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:46.966590 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:36:46.967498 (+ 908us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:46.968171 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:46.969334 (+ 1163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:46.969732 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:46.969867 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:46.973030 (+ 3163us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:36:46.973035 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:36:46.973039 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:36:46.973080 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:36:46.975296 (+ 2216us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:46.975881 (+ 585us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:46.975887 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:46.975890 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:46.976011 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:46.976455 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:46.976459 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:46.976462 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:46.976741 (+ 279us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:36:46.977049 (+ 308us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:46.977337 (+ 288us) server_negotiation.cc:299] Negotiation successful
0807 10:36:46.977549 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
W20260807 10:36:46.981709 27422 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:36:46.980196 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40826 (local address 127.20.171.65:41689)
0807 10:36:46.980404 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:46.980409 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:46.980583 (+ 174us) server_negotiation.cc:407] Connection header received
0807 10:36:46.980692 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:46.980695 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:46.980755 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:46.980824 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:36:46.981473 (+ 649us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40826: BlockingRecv error: recv got EOF from 127.0.0.1:40826 (error 108)
Metrics: {"server-negotiator.queue_time_us":89}
W20260807 10:36:46.981838 21165 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786098956060137-21165-0/krb5kdc/krb5cc' of type FILE
Aug 07 10:36:46 dist-test-slave-0b58 krb5kdc[26900](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099006, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:36:46.983289 21165 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 07 10:36:46 dist-test-slave-0b58 krb5kdc[26900](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099006, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:36:46.984616 21165 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 07 10:36:46 dist-test-slave-0b58 krb5kdc[26900](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099006, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.171.65@KRBTEST.COM
I20260807 10:36:46.998337 27422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:46.985888 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40832 (local address 127.20.171.65:41689)
0807 10:36:46.986062 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:46.986065 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:46.986149 (+ 84us) server_negotiation.cc:407] Connection header received
0807 10:36:46.986296 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:46.986299 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:46.986348 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:46.986421 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:36:46.987277 (+ 856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:46.987981 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:46.989175 (+ 1194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:46.989584 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:46.989666 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:46.993481 (+ 3815us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:36:46.993485 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:36:46.993489 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:36:46.993517 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:36:46.995867 (+ 2350us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:46.996515 (+ 648us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:46.996521 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:46.996525 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:46.996652 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:46.997030 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:46.997035 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:46.997038 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:46.997310 (+ 272us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:36:46.997626 (+ 316us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:46.997861 (+ 235us) server_negotiation.cc:299] Negotiation successful
0807 10:36:46.998057 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260807 10:36:46.999940 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 27009
I20260807 10:36:47.012087 27422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:47.000782 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40838 (local address 127.20.171.65:41689)
0807 10:36:47.000952 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:47.000957 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:47.001159 (+ 202us) server_negotiation.cc:407] Connection header received
0807 10:36:47.001360 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:47.001369 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:47.001420 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:47.001529 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:36:47.002535 (+ 1006us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:47.003176 (+ 641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:47.004535 (+ 1359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:47.004998 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:47.005125 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:47.007180 (+ 2055us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:36:47.007190 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:36:47.007193 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:36:47.007221 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:36:47.009567 (+ 2346us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:47.010209 (+ 642us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:47.010215 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:47.010219 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:47.010344 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:47.010725 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:47.010729 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:47.010733 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:47.010972 (+ 239us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:36:47.011272 (+ 300us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:47.011584 (+ 312us) server_negotiation.cc:299] Negotiation successful
0807 10:36:47.011774 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260807 10:36:47.012748 27135 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:36:47.093225 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 27009
I20260807 10:36:47.112948 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 27146
Aug 07 10:36:47 dist-test-slave-0b58 krb5kdc[26900](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099006, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.171.66@KRBTEST.COM
I20260807 10:36:47.127565 27435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:47.113841 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47170 (local address 127.20.171.66:38883)
0807 10:36:47.114426 (+ 585us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:47.114433 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:47.114458 (+ 25us) server_negotiation.cc:407] Connection header received
0807 10:36:47.114518 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:47.114524 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:47.114723 (+ 199us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:47.114852 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:36:47.115755 (+ 903us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:47.116817 (+ 1062us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:47.117976 (+ 1159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:47.118502 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:47.118591 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:47.122276 (+ 3685us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:36:47.122287 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:36:47.122300 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:36:47.122337 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:36:47.125245 (+ 2908us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:47.125787 (+ 542us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:47.125793 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:47.125796 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:47.125911 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:47.126231 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:47.126234 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:47.126236 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:47.126569 (+ 333us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:36:47.126804 (+ 235us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:47.127041 (+ 237us) server_negotiation.cc:299] Negotiation successful
0807 10:36:47.127248 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":448,"thread_start_us":303,"threads_started":1}
I20260807 10:36:47.128866 27272 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:36:47.211931 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 27146
I20260807 10:36:47.231215 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 27282
Aug 07 10:36:47 dist-test-slave-0b58 krb5kdc[26900](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099006, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.171.67@KRBTEST.COM
I20260807 10:36:47.247035 27437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:47.232391 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52018 (local address 127.20.171.67:45407)
0807 10:36:47.233086 (+ 695us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:47.233093 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:47.233122 (+ 29us) server_negotiation.cc:407] Connection header received
0807 10:36:47.233199 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:47.233206 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:47.233461 (+ 255us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:47.233596 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:36:47.234655 (+ 1059us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:47.235632 (+ 977us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:47.236831 (+ 1199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:47.237343 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:47.237435 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:47.241398 (+ 3963us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:36:47.241409 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:36:47.241422 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:36:47.241456 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:36:47.244634 (+ 3178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:47.245245 (+ 611us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:47.245253 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:47.245255 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:47.245381 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:47.245695 (+ 314us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:47.245698 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:47.245700 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:47.246015 (+ 315us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:36:47.246325 (+ 310us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:47.246521 (+ 196us) server_negotiation.cc:299] Negotiation successful
0807 10:36:47.246737 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":478,"thread_start_us":331,"threads_started":1}
I20260807 10:36:47.248373 27410 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:36:47.329946 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 27282
I20260807 10:36:47.348768 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 26914
I20260807 10:36:47.349992 26977 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:36:47.452785 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 26914
2026-08-07T10:36:47Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (3892 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 10:36:47 dist-test-slave-0b58 krb5kdc[27442](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 10:36:47 dist-test-slave-0b58 krb5kdc[27442](info): set up 2 sockets
Aug 07 10:36:47 dist-test-slave-0b58 krb5kdc[27442](info): commencing operation
krb5kdc: starting...
W20260807 10:36:48.538105 21165 mini_kdc.cc:121] Time spent starting KDC: real 1.039s user 0.000s sys 0.033s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/krb5kdc/test-user.keytab.
Aug 07 10:36:48 dist-test-slave-0b58 krb5kdc[27442](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099008, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T10:36:48Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T10:36:48Z Disabled control of system clock
WARNING: no policy specified for oryx/127.20.171.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.20.171.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.20.171.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/krb5kdc/oryx_127.20.171.126.keytab.
Entry for principal oryx/127.20.171.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/krb5kdc/oryx_127.20.171.126.keytab.
I20260807 10:36:48.786072 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.171.126:45569
--webserver_interface=127.20.171.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/krb5kdc/oryx_127.20.171.126.keytab
--principal=oryx/127.20.171.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.171.84:36279
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.171.126:45569
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:36:49.109866 27455 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:36:49.110185 27455 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:36:49.110339 27455 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:36:49.117692 27455 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 10:36:49.117854 27455 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:36:49.117949 27455 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:36:49.118090 27455 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 10:36:49.118175 27455 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 10:36:49.128185 27455 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.171.84:36279
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.171.126:45569
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/krb5kdc/oryx_127.20.171.126.keytab
--principal=oryx/127.20.171.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.171.126:45569
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.171.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:36:49.129571 27455 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:36:49.130923 27455 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:36:49.142127 27460 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:36:49.142302 27461 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:36:49.142306 27463 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:36:49.143342 27455 server_base.cc:1034] running on GCE node
I20260807 10:36:49.144117 27455 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:36:49.145483 27455 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:36:49.146728 27455 hybrid_clock.cc:648] HybridClock initialized: now 1786099009146687 us; error 41 us; skew 500 ppm
I20260807 10:36:49.147195 27455 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:36:49 dist-test-slave-0b58 krb5kdc[27442](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099009, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.171.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:36:49.151726 27455 init.cc:377] Logged in from keytab as oryx/127.20.171.126@KRBTEST.COM (short username oryx)
I20260807 10:36:49.153630 27455 webserver.cc:460] Webserver started at http://127.20.171.126:46003/ using document root <none> and password file <none>
I20260807 10:36:49.154490 27455 fs_manager.cc:359] Metadata directory not provided
I20260807 10:36:49.154639 27455 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:36:49.154973 27455 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:36:49.158411 27455 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/master-0/data/instance:
uuid: "a3ba955fde1542b8a0187d9fd7a0052c"
format_stamp: "Formatted at 2026-08-07 10:36:49 on dist-test-slave-0b58"
server_key: "556676517900ffeaa0aac820aa17c7d0"
server_key_iv: "539ba7d13d57b4061dbd35ed0d25414e"
server_key_version: "encryptionkey@0"
I20260807 10:36:49.159189 27455 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/master-0/wal/instance:
uuid: "a3ba955fde1542b8a0187d9fd7a0052c"
format_stamp: "Formatted at 2026-08-07 10:36:49 on dist-test-slave-0b58"
server_key: "556676517900ffeaa0aac820aa17c7d0"
server_key_iv: "539ba7d13d57b4061dbd35ed0d25414e"
server_key_version: "encryptionkey@0"
I20260807 10:36:49.164065 27455 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260807 10:36:49.167793 27470 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:36:49.169210 27455 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260807 10:36:49.169402 27455 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/master-0/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/master-0/wal
uuid: "a3ba955fde1542b8a0187d9fd7a0052c"
format_stamp: "Formatted at 2026-08-07 10:36:49 on dist-test-slave-0b58"
server_key: "556676517900ffeaa0aac820aa17c7d0"
server_key_iv: "539ba7d13d57b4061dbd35ed0d25414e"
server_key_version: "encryptionkey@0"
I20260807 10:36:49.169592 27455 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:36:49.188462 27455 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:36:49.192718 27455 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:36:49.192993 27455 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:36:49.210888 27455 rpc_server.cc:307] RPC server started. Bound to: 127.20.171.126:45569
I20260807 10:36:49.210924 27524 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.171.126:45569 every 8 connection(s)
I20260807 10:36:49.212162 27455 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
I20260807 10:36:49.215858 27525 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:36:49.220152 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 27455
I20260807 10:36:49.220405 21165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/master-0/wal/instance
I20260807 10:36:49.221170 21165 external_mini_cluster.cc:1428] Setting key 7f4c5c7b532ad5c08a80e20a803dedfa
I20260807 10:36:49.227080 27525 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a3ba955fde1542b8a0187d9fd7a0052c: Bootstrap starting.
I20260807 10:36:49.230088 27525 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a3ba955fde1542b8a0187d9fd7a0052c: Neither blocks nor log segments found. Creating new log.
I20260807 10:36:49.231007 27525 log.cc:824] T 00000000000000000000000000000000 P a3ba955fde1542b8a0187d9fd7a0052c: Log is configured to *not* fsync() on all Append() calls
I20260807 10:36:49.234254 27525 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a3ba955fde1542b8a0187d9fd7a0052c: No bootstrap required, opened a new log
Aug 07 10:36:49 dist-test-slave-0b58 krb5kdc[27442](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099008, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.20.171.126@KRBTEST.COM
I20260807 10:36:49.241484 27525 raft_consensus.cc:348] T 00000000000000000000000000000000 P a3ba955fde1542b8a0187d9fd7a0052c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3ba955fde1542b8a0187d9fd7a0052c" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 45569 } }
I20260807 10:36:49.241851 27525 raft_consensus.cc:374] T 00000000000000000000000000000000 P a3ba955fde1542b8a0187d9fd7a0052c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:36:49.241977 27525 raft_consensus.cc:729] T 00000000000000000000000000000000 P a3ba955fde1542b8a0187d9fd7a0052c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ba955fde1542b8a0187d9fd7a0052c, State: Initialized, Role: FOLLOWER
I20260807 10:36:49.242563 27525 consensus_queue.cc:260] T 00000000000000000000000000000000 P a3ba955fde1542b8a0187d9fd7a0052c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3ba955fde1542b8a0187d9fd7a0052c" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 45569 } }
I20260807 10:36:49.242867 27525 raft_consensus.cc:388] T 00000000000000000000000000000000 P a3ba955fde1542b8a0187d9fd7a0052c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 10:36:49.243048 27525 raft_consensus.cc:482] T 00000000000000000000000000000000 P a3ba955fde1542b8a0187d9fd7a0052c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 10:36:49.243274 27525 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a3ba955fde1542b8a0187d9fd7a0052c [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:36:49.243424 27528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:49.223085 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53102 (local address 127.20.171.126:45569)
0807 10:36:49.223915 (+ 830us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:49.223927 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:49.223968 (+ 41us) server_negotiation.cc:407] Connection header received
0807 10:36:49.225850 (+ 1882us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:49.225870 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:49.226228 (+ 358us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:49.226577 (+ 349us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:36:49.228172 (+ 1595us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:49.229483 (+ 1311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:49.230730 (+ 1247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:49.231348 (+ 618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:49.231544 (+ 196us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:49.235980 (+ 4436us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:36:49.235987 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:36:49.236000 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:36:49.236041 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:36:49.239154 (+ 3113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:49.239860 (+ 706us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:49.239877 (+ 17us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:49.239882 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:49.240048 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:49.240461 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:49.240466 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:49.240475 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:49.240971 (+ 496us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:36:49.241254 (+ 283us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:49.241620 (+ 366us) server_negotiation.cc:299] Negotiation successful
0807 10:36:49.242231 (+ 611us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":619,"thread_start_us":364,"threads_started":1}
I20260807 10:36:49.246033 27525 raft_consensus.cc:504] T 00000000000000000000000000000000 P a3ba955fde1542b8a0187d9fd7a0052c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3ba955fde1542b8a0187d9fd7a0052c" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 45569 } }
I20260807 10:36:49.246539 27525 leader_election.cc:302] T 00000000000000000000000000000000 P a3ba955fde1542b8a0187d9fd7a0052c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a3ba955fde1542b8a0187d9fd7a0052c; no voters:
I20260807 10:36:49.247157 27525 leader_election.cc:288] T 00000000000000000000000000000000 P a3ba955fde1542b8a0187d9fd7a0052c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 10:36:49.247308 27530 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a3ba955fde1542b8a0187d9fd7a0052c [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:36:49.248066 27530 raft_consensus.cc:686] T 00000000000000000000000000000000 P a3ba955fde1542b8a0187d9fd7a0052c [term 1 LEADER]: Becoming Leader. State: Replica: a3ba955fde1542b8a0187d9fd7a0052c, State: Running, Role: LEADER
I20260807 10:36:49.248601 27530 consensus_queue.cc:237] T 00000000000000000000000000000000 P a3ba955fde1542b8a0187d9fd7a0052c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3ba955fde1542b8a0187d9fd7a0052c" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 45569 } }
I20260807 10:36:49.249181 27525 sys_catalog.cc:564] T 00000000000000000000000000000000 P a3ba955fde1542b8a0187d9fd7a0052c [sys.catalog]: configured and running, proceeding with master startup.
I20260807 10:36:49.251222 27532 sys_catalog.cc:455] T 00000000000000000000000000000000 P a3ba955fde1542b8a0187d9fd7a0052c [sys.catalog]: SysCatalogTable state changed. Reason: New leader a3ba955fde1542b8a0187d9fd7a0052c. Latest consensus state: current_term: 1 leader_uuid: "a3ba955fde1542b8a0187d9fd7a0052c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3ba955fde1542b8a0187d9fd7a0052c" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 45569 } } }
I20260807 10:36:49.251183 27531 sys_catalog.cc:455] T 00000000000000000000000000000000 P a3ba955fde1542b8a0187d9fd7a0052c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a3ba955fde1542b8a0187d9fd7a0052c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3ba955fde1542b8a0187d9fd7a0052c" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 45569 } } }
I20260807 10:36:49.251550 27532 sys_catalog.cc:458] T 00000000000000000000000000000000 P a3ba955fde1542b8a0187d9fd7a0052c [sys.catalog]: This master's current role is: LEADER
I20260807 10:36:49.251550 27531 sys_catalog.cc:458] T 00000000000000000000000000000000 P a3ba955fde1542b8a0187d9fd7a0052c [sys.catalog]: This master's current role is: LEADER
I20260807 10:36:49.253185 27536 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 10:36:49.257936 27536 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 10:36:49.267323 27536 catalog_manager.cc:1347] Generated new cluster ID: 7b9a4b9fc4a3418fa3f99e0b86b93379
I20260807 10:36:49.267463 27536 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 10:36:49.316110 27536 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 10:36:49.317513 27536 catalog_manager.cc:1504] Loading token signing keys...
I20260807 10:36:49.326226 27536 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a3ba955fde1542b8a0187d9fd7a0052c: Generated new TSK 0
I20260807 10:36:49.327076 27536 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.20.171.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.20.171.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.20.171.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/krb5kdc/oryx_127.20.171.65.keytab.
Entry for principal oryx/127.20.171.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/krb5kdc/oryx_127.20.171.65.keytab.
I20260807 10:36:49.391621 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.171.65:0
--local_ip_for_outbound_sockets=127.20.171.65
--webserver_interface=127.20.171.65
--webserver_port=0
--tserver_master_addrs=127.20.171.126:45569
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/krb5kdc/oryx_127.20.171.65.keytab
--principal=oryx/127.20.171.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.171.84:36279
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:36:49.735729 27551 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:36:49.736056 27551 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:36:49.736232 27551 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:36:49.743099 27551 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:36:49.743232 27551 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:36:49.743429 27551 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.171.65
I20260807 10:36:49.753043 27551 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.171.84:36279
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/krb5kdc/oryx_127.20.171.65.keytab
--principal=oryx/127.20.171.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.171.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.171.65
--webserver_port=0
--tserver_master_addrs=127.20.171.126:45569
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.171.65
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:36:49.754312 27551 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:36:49.755686 27551 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:36:49.768374 27556 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:36:49.768396 27557 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:36:49.768674 27559 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:36:49.769941 27551 server_base.cc:1034] running on GCE node
I20260807 10:36:49.770509 27551 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:36:49.771373 27551 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:36:49.772560 27551 hybrid_clock.cc:648] HybridClock initialized: now 1786099009772515 us; error 35 us; skew 500 ppm
I20260807 10:36:49.772871 27551 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:36:49 dist-test-slave-0b58 krb5kdc[27442](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099009, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.171.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:36:49.775908 27551 init.cc:377] Logged in from keytab as oryx/127.20.171.65@KRBTEST.COM (short username oryx)
I20260807 10:36:49.777395 27551 webserver.cc:460] Webserver started at http://127.20.171.65:33641/ using document root <none> and password file <none>
I20260807 10:36:49.778079 27551 fs_manager.cc:359] Metadata directory not provided
I20260807 10:36:49.778225 27551 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:36:49.778537 27551 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:36:49.781466 27551 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/ts-0/data/instance:
uuid: "c04827968c1b4c469f0b4cbf1bf63c3d"
format_stamp: "Formatted at 2026-08-07 10:36:49 on dist-test-slave-0b58"
server_key: "01b9da05c8605cb79c64bbfd536a1b73"
server_key_iv: "5ad478c8c92849b9b77b71ea3dba49cb"
server_key_version: "encryptionkey@0"
I20260807 10:36:49.782232 27551 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/ts-0/wal/instance:
uuid: "c04827968c1b4c469f0b4cbf1bf63c3d"
format_stamp: "Formatted at 2026-08-07 10:36:49 on dist-test-slave-0b58"
server_key: "01b9da05c8605cb79c64bbfd536a1b73"
server_key_iv: "5ad478c8c92849b9b77b71ea3dba49cb"
server_key_version: "encryptionkey@0"
I20260807 10:36:49.787307 27551 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260807 10:36:49.790748 27566 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:36:49.791997 27551 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.001s
I20260807 10:36:49.792158 27551 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/ts-0/wal
uuid: "c04827968c1b4c469f0b4cbf1bf63c3d"
format_stamp: "Formatted at 2026-08-07 10:36:49 on dist-test-slave-0b58"
server_key: "01b9da05c8605cb79c64bbfd536a1b73"
server_key_iv: "5ad478c8c92849b9b77b71ea3dba49cb"
server_key_version: "encryptionkey@0"
I20260807 10:36:49.792400 27551 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:36:49.810973 27551 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:36:49.814821 27551 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:36:49.815138 27551 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:36:49.816043 27551 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:36:49.817379 27551 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:36:49.817481 27551 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:36:49.817628 27551 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:36:49.817709 27551 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:36:49.850414 27551 rpc_server.cc:307] RPC server started. Bound to: 127.20.171.65:42425
I20260807 10:36:49.850462 27684 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.171.65:42425 every 8 connection(s)
I20260807 10:36:49.851686 27551 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/ts-0/data/info.pb
I20260807 10:36:49.857924 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 27551
I20260807 10:36:49.858129 21165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/ts-0/wal/instance
I20260807 10:36:49.858750 21165 external_mini_cluster.cc:1428] Setting key 2b93f02fe24a769db64e91d779403159
Aug 07 10:36:49 dist-test-slave-0b58 krb5kdc[27442](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099009, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.171.65@KRBTEST.COM for oryx/127.20.171.126@KRBTEST.COM
I20260807 10:36:49.871469 27687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:49.854280 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.65:33011 (local address 127.20.171.126:45569)
0807 10:36:49.854761 (+ 481us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:49.854766 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:49.855616 (+ 850us) server_negotiation.cc:407] Connection header received
0807 10:36:49.857483 (+ 1867us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:49.857488 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:49.857573 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:49.857712 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:36:49.859297 (+ 1585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:49.860105 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:49.861819 (+ 1714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:49.862200 (+ 381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:49.862338 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:49.865958 (+ 3620us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:36:49.865963 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:36:49.865966 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:36:49.865999 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:36:49.868556 (+ 2557us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:49.869277 (+ 721us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:49.869287 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:49.869289 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:49.869401 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:49.869824 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:49.869828 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:49.869833 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:49.870083 (+ 250us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:36:49.870231 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:49.870899 (+ 668us) server_negotiation.cc:299] Negotiation successful
0807 10:36:49.871114 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":372,"thread_start_us":273,"threads_started":1}
I20260807 10:36:49.872437 27688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:49.854650 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:45569 (local address 127.20.171.65:33011)
0807 10:36:49.855458 (+ 808us) negotiation.cc:107] Waiting for socket to connect
0807 10:36:49.855502 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0807 10:36:49.857175 (+ 1673us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:36:49.857986 (+ 811us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:36:49.857993 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:36:49.858547 (+ 554us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:36:49.859128 (+ 581us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:49.859145 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:49.860303 (+ 1158us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:49.860308 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:49.861661 (+ 1353us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:49.861672 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:49.862436 (+ 764us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:49.862443 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:49.862661 (+ 218us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:49.863351 (+ 690us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:36:49.863373 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:36:49.865744 (+ 2371us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:36:49.868695 (+ 2951us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:36:49.868704 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:36:49.868718 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:36:49.869143 (+ 425us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:36:49.869515 (+ 372us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:36:49.869519 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:36:49.869523 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:36:49.869704 (+ 181us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:36:49.870220 (+ 516us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:36:49.870227 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:36:49.870542 (+ 315us) client_negotiation.cc:769] Sending connection context
0807 10:36:49.870788 (+ 246us) client_negotiation.cc:240] Negotiation successful
0807 10:36:49.871288 (+ 500us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":595,"thread_start_us":361,"threads_started":1}
I20260807 10:36:49.874071 27685 heartbeater.cc:347] Connected to a master server at 127.20.171.126:45569
I20260807 10:36:49.874418 27685 heartbeater.cc:464] Registering TS with master...
I20260807 10:36:49.875140 27685 heartbeater.cc:511] Master 127.20.171.126:45569 requested a full tablet report, sending...
I20260807 10:36:49.877185 27487 ts_manager.cc:194] Registered new tserver with Master: c04827968c1b4c469f0b4cbf1bf63c3d (127.20.171.65:42425)
I20260807 10:36:49.878576 27487 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.20.171.65@KRBTEST.COM'} at 127.20.171.65:33011
WARNING: no policy specified for oryx/127.20.171.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.20.171.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.20.171.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/krb5kdc/oryx_127.20.171.66.keytab.
Entry for principal oryx/127.20.171.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/krb5kdc/oryx_127.20.171.66.keytab.
I20260807 10:36:49.915454 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.171.66:0
--local_ip_for_outbound_sockets=127.20.171.66
--webserver_interface=127.20.171.66
--webserver_port=0
--tserver_master_addrs=127.20.171.126:45569
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/krb5kdc/oryx_127.20.171.66.keytab
--principal=oryx/127.20.171.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.171.84:36279
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:36:50.241212 27691 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:36:50.241460 27691 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:36:50.241570 27691 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:36:50.248566 27691 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:36:50.248662 27691 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:36:50.248790 27691 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.171.66
I20260807 10:36:50.257917 27691 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.171.84:36279
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/krb5kdc/oryx_127.20.171.66.keytab
--principal=oryx/127.20.171.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.171.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.171.66
--webserver_port=0
--tserver_master_addrs=127.20.171.126:45569
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.171.66
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:36:50.259200 27691 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:36:50.260526 27691 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:36:50.273573 27696 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:36:50.273615 27697 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:36:50.273815 27699 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:36:50.274986 27691 server_base.cc:1034] running on GCE node
I20260807 10:36:50.275596 27691 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:36:50.276574 27691 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:36:50.277776 27691 hybrid_clock.cc:648] HybridClock initialized: now 1786099010277731 us; error 46 us; skew 500 ppm
I20260807 10:36:50.278088 27691 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:36:50 dist-test-slave-0b58 krb5kdc[27442](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099010, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.171.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:36:50.285490 27691 init.cc:377] Logged in from keytab as oryx/127.20.171.66@KRBTEST.COM (short username oryx)
I20260807 10:36:50.286900 27691 webserver.cc:460] Webserver started at http://127.20.171.66:45949/ using document root <none> and password file <none>
I20260807 10:36:50.287596 27691 fs_manager.cc:359] Metadata directory not provided
I20260807 10:36:50.287729 27691 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:36:50.288069 27691 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:36:50.291036 27691 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/ts-1/data/instance:
uuid: "13625247901b4ad7a38dae319a093281"
format_stamp: "Formatted at 2026-08-07 10:36:50 on dist-test-slave-0b58"
server_key: "5986b7a4081411273d5ee53b05f79545"
server_key_iv: "7867fdfc150b360238445bf7587bd3c9"
server_key_version: "encryptionkey@0"
I20260807 10:36:50.291843 27691 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/ts-1/wal/instance:
uuid: "13625247901b4ad7a38dae319a093281"
format_stamp: "Formatted at 2026-08-07 10:36:50 on dist-test-slave-0b58"
server_key: "5986b7a4081411273d5ee53b05f79545"
server_key_iv: "7867fdfc150b360238445bf7587bd3c9"
server_key_version: "encryptionkey@0"
I20260807 10:36:50.296983 27691 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260807 10:36:50.300335 27706 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:36:50.301546 27691 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260807 10:36:50.301720 27691 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/ts-1/wal
uuid: "13625247901b4ad7a38dae319a093281"
format_stamp: "Formatted at 2026-08-07 10:36:50 on dist-test-slave-0b58"
server_key: "5986b7a4081411273d5ee53b05f79545"
server_key_iv: "7867fdfc150b360238445bf7587bd3c9"
server_key_version: "encryptionkey@0"
I20260807 10:36:50.301925 27691 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:36:50.324105 27691 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:36:50.328450 27691 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:36:50.328698 27691 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:36:50.329645 27691 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:36:50.330929 27691 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:36:50.331002 27691 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:36:50.331096 27691 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:36:50.331137 27691 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:36:50.374495 27691 rpc_server.cc:307] RPC server started. Bound to: 127.20.171.66:45441
I20260807 10:36:50.374542 27821 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.171.66:45441 every 8 connection(s)
I20260807 10:36:50.375773 27691 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/ts-1/data/info.pb
I20260807 10:36:50.377280 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 27691
I20260807 10:36:50.377460 21165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/ts-1/wal/instance
I20260807 10:36:50.377942 21165 external_mini_cluster.cc:1428] Setting key 73ac9d8e223e3b0d1774cf112fddbf6f
Aug 07 10:36:50 dist-test-slave-0b58 krb5kdc[27442](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099010, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.171.66@KRBTEST.COM for oryx/127.20.171.126@KRBTEST.COM
I20260807 10:36:50.395967 27824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:50.378226 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.66:60987 (local address 127.20.171.126:45569)
0807 10:36:50.378686 (+ 460us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:50.378694 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:50.379795 (+ 1101us) server_negotiation.cc:407] Connection header received
0807 10:36:50.381811 (+ 2016us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:50.381818 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:50.381909 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:50.382025 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:36:50.383455 (+ 1430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:50.384201 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:50.385764 (+ 1563us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:50.386170 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:50.386318 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:50.389731 (+ 3413us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:36:50.389736 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:36:50.389739 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:36:50.389770 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:36:50.392888 (+ 3118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:50.393616 (+ 728us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:50.393628 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:50.393630 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:50.393757 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:50.394170 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:50.394176 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:50.394179 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:50.394460 (+ 281us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:36:50.394614 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:50.395324 (+ 710us) server_negotiation.cc:299] Negotiation successful
0807 10:36:50.395547 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":334,"thread_start_us":216,"threads_started":1}
I20260807 10:36:50.396975 27825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:50.378764 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:45569 (local address 127.20.171.66:60987)
0807 10:36:50.379622 (+ 858us) negotiation.cc:107] Waiting for socket to connect
0807 10:36:50.379671 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0807 10:36:50.381535 (+ 1864us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:36:50.382246 (+ 711us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:36:50.382254 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:36:50.382725 (+ 471us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:36:50.383291 (+ 566us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:50.383307 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:50.384380 (+ 1073us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:50.384386 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:50.385609 (+ 1223us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:50.385621 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:50.386426 (+ 805us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:50.386434 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:50.386655 (+ 221us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:50.387367 (+ 712us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:36:50.387388 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:36:50.389518 (+ 2130us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:36:50.393026 (+ 3508us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:36:50.393034 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:36:50.393049 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:36:50.393484 (+ 435us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:36:50.393867 (+ 383us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:36:50.393872 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:36:50.393875 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:36:50.394058 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:36:50.394586 (+ 528us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:36:50.394593 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:36:50.394952 (+ 359us) client_negotiation.cc:769] Sending connection context
0807 10:36:50.395216 (+ 264us) client_negotiation.cc:240] Negotiation successful
0807 10:36:50.395748 (+ 532us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":552,"thread_start_us":345,"threads_started":1}
I20260807 10:36:50.398454 27822 heartbeater.cc:347] Connected to a master server at 127.20.171.126:45569
I20260807 10:36:50.398772 27822 heartbeater.cc:464] Registering TS with master...
I20260807 10:36:50.399477 27822 heartbeater.cc:511] Master 127.20.171.126:45569 requested a full tablet report, sending...
I20260807 10:36:50.401051 27487 ts_manager.cc:194] Registered new tserver with Master: 13625247901b4ad7a38dae319a093281 (127.20.171.66:45441)
I20260807 10:36:50.401824 27487 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.20.171.66@KRBTEST.COM'} at 127.20.171.66:60987
WARNING: no policy specified for oryx/127.20.171.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.20.171.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.20.171.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/krb5kdc/oryx_127.20.171.67.keytab.
Entry for principal oryx/127.20.171.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/krb5kdc/oryx_127.20.171.67.keytab.
I20260807 10:36:50.436204 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.171.67:0
--local_ip_for_outbound_sockets=127.20.171.67
--webserver_interface=127.20.171.67
--webserver_port=0
--tserver_master_addrs=127.20.171.126:45569
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/krb5kdc/oryx_127.20.171.67.keytab
--principal=oryx/127.20.171.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.171.84:36279
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:36:50.765725 27828 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:36:50.765980 27828 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:36:50.766148 27828 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:36:50.773324 27828 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:36:50.773470 27828 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:36:50.773667 27828 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.171.67
I20260807 10:36:50.782555 27828 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.171.84:36279
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/krb5kdc/oryx_127.20.171.67.keytab
--principal=oryx/127.20.171.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.171.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.171.67
--webserver_port=0
--tserver_master_addrs=127.20.171.126:45569
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.171.67
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:36:50.783825 27828 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:36:50.785127 27828 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:36:50.798086 27833 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:36:50.798115 27836 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:36:50.798179 27834 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:36:50.799127 27828 server_base.cc:1034] running on GCE node
I20260807 10:36:50.799706 27828 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:36:50.800658 27828 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:36:50.801867 27828 hybrid_clock.cc:648] HybridClock initialized: now 1786099010801821 us; error 39 us; skew 500 ppm
I20260807 10:36:50.802170 27828 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:36:50 dist-test-slave-0b58 krb5kdc[27442](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099010, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.171.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:36:50.805575 27828 init.cc:377] Logged in from keytab as oryx/127.20.171.67@KRBTEST.COM (short username oryx)
I20260807 10:36:50.807124 27828 webserver.cc:460] Webserver started at http://127.20.171.67:39273/ using document root <none> and password file <none>
I20260807 10:36:50.807786 27828 fs_manager.cc:359] Metadata directory not provided
I20260807 10:36:50.807889 27828 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:36:50.808135 27828 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:36:50.811065 27828 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/ts-2/data/instance:
uuid: "0ee4d53fcb5c47acbc12ef3ba680766a"
format_stamp: "Formatted at 2026-08-07 10:36:50 on dist-test-slave-0b58"
server_key: "6074a662d2c90e3f16c2f30367a3f596"
server_key_iv: "4d389d7d8ac62d921c82ba571649f811"
server_key_version: "encryptionkey@0"
I20260807 10:36:50.811828 27828 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/ts-2/wal/instance:
uuid: "0ee4d53fcb5c47acbc12ef3ba680766a"
format_stamp: "Formatted at 2026-08-07 10:36:50 on dist-test-slave-0b58"
server_key: "6074a662d2c90e3f16c2f30367a3f596"
server_key_iv: "4d389d7d8ac62d921c82ba571649f811"
server_key_version: "encryptionkey@0"
I20260807 10:36:50.816880 27828 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260807 10:36:50.820152 27843 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:36:50.821554 27828 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.004s
I20260807 10:36:50.821728 27828 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/ts-2/wal
uuid: "0ee4d53fcb5c47acbc12ef3ba680766a"
format_stamp: "Formatted at 2026-08-07 10:36:50 on dist-test-slave-0b58"
server_key: "6074a662d2c90e3f16c2f30367a3f596"
server_key_iv: "4d389d7d8ac62d921c82ba571649f811"
server_key_version: "encryptionkey@0"
I20260807 10:36:50.821931 27828 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:36:50.836513 27828 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:36:50.840917 27828 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:36:50.841202 27828 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:36:50.842092 27828 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:36:50.843408 27828 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:36:50.843483 27828 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:36:50.843638 27828 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:36:50.843693 27828 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:36:50.876173 27828 rpc_server.cc:307] RPC server started. Bound to: 127.20.171.67:37807
I20260807 10:36:50.876224 27959 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.171.67:37807 every 8 connection(s)
I20260807 10:36:50.877511 27828 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/ts-2/data/info.pb
I20260807 10:36:50.881294 27685 heartbeater.cc:503] Master 127.20.171.126:45569 was elected leader, sending a full tablet report...
I20260807 10:36:50.881839 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 27828
I20260807 10:36:50.882014 21165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/ts-2/wal/instance
I20260807 10:36:50.882465 21165 external_mini_cluster.cc:1428] Setting key 4a5e8c48f8e324153ce8d9294d89dfbc
Aug 07 10:36:50 dist-test-slave-0b58 krb5kdc[27442](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099010, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.171.67@KRBTEST.COM for oryx/127.20.171.126@KRBTEST.COM
I20260807 10:36:50.896730 27824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:50.879944 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.67:43127 (local address 127.20.171.126:45569)
0807 10:36:50.880131 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:50.880135 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:50.881249 (+ 1114us) server_negotiation.cc:407] Connection header received
0807 10:36:50.883621 (+ 2372us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:50.883626 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:50.883737 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:50.883846 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:36:50.885507 (+ 1661us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:50.886272 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:50.887690 (+ 1418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:50.888039 (+ 349us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:50.888123 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:50.891350 (+ 3227us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:36:50.891354 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:36:50.891357 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:36:50.891385 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:36:50.893981 (+ 2596us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:50.894625 (+ 644us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:50.894629 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:50.894631 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:50.894742 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:50.895117 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:50.895120 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:50.895122 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:50.895379 (+ 257us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:36:50.895517 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:50.896133 (+ 616us) server_negotiation.cc:299] Negotiation successful
0807 10:36:50.896410 (+ 277us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260807 10:36:50.897881 27962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:50.880423 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:45569 (local address 127.20.171.67:43127)
0807 10:36:50.881089 (+ 666us) negotiation.cc:107] Waiting for socket to connect
0807 10:36:50.881131 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0807 10:36:50.883336 (+ 2205us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:36:50.884065 (+ 729us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:36:50.884073 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:36:50.884720 (+ 647us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:36:50.885325 (+ 605us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:50.885349 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:50.886407 (+ 1058us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:50.886411 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:50.887576 (+ 1165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:50.887587 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:50.888211 (+ 624us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:50.888215 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:50.888448 (+ 233us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:50.889123 (+ 675us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:36:50.889145 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:36:50.891167 (+ 2022us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:36:50.894095 (+ 2928us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:36:50.894101 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:36:50.894110 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:36:50.894521 (+ 411us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:36:50.894833 (+ 312us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:36:50.894836 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:36:50.894838 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:36:50.894993 (+ 155us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:36:50.895490 (+ 497us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:36:50.895495 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:36:50.895748 (+ 253us) client_negotiation.cc:769] Sending connection context
0807 10:36:50.895987 (+ 239us) client_negotiation.cc:240] Negotiation successful
0807 10:36:50.896562 (+ 575us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":441,"thread_start_us":256,"threads_started":1}
I20260807 10:36:50.899116 27960 heartbeater.cc:347] Connected to a master server at 127.20.171.126:45569
I20260807 10:36:50.899400 27960 heartbeater.cc:464] Registering TS with master...
I20260807 10:36:50.900094 27960 heartbeater.cc:511] Master 127.20.171.126:45569 requested a full tablet report, sending...
I20260807 10:36:50.901402 27487 ts_manager.cc:194] Registered new tserver with Master: 0ee4d53fcb5c47acbc12ef3ba680766a (127.20.171.67:37807)
I20260807 10:36:50.902138 27487 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.20.171.67@KRBTEST.COM'} at 127.20.171.67:43127
I20260807 10:36:50.909763 21165 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.20.171.125@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.20.171.125@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.20.171.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/krb5kdc/oryx_127.20.171.125.keytab.
Entry for principal oryx/127.20.171.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/krb5kdc/oryx_127.20.171.125.keytab.
I20260807 10:36:50.967221 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.171.125:41963
--webserver_interface=127.20.171.125
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/krb5kdc/oryx_127.20.171.125.keytab
--principal=oryx/127.20.171.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.171.84:36279
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.171.126:45569,127.20.171.125:41963
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:36:51.288370 27965 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:36:51.288690 27965 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:36:51.288837 27965 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:36:51.295290 27965 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 10:36:51.295405 27965 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:36:51.295496 27965 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:36:51.295570 27965 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 10:36:51.295625 27965 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 10:36:51.305121 27965 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.171.84:36279
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.20.171.126:45569,127.20.171.125:41963
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/krb5kdc/oryx_127.20.171.125.keytab
--principal=oryx/127.20.171.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.171.125:41963
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.20.171.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
W20260807 10:36:51.305526 27965 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.20.171.126:45569,127.20.171.125:41963'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260807 10:36:51.306746 27965 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:36:51.308039 27965 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:36:51.318766 27970 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:36:51.318848 27971 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:36:51.318874 27973 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:36:51.319960 27965 server_base.cc:1034] running on GCE node
I20260807 10:36:51.320735 27965 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:36:51.321945 27965 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:36:51.323144 27965 hybrid_clock.cc:648] HybridClock initialized: now 1786099011323088 us; error 34 us; skew 500 ppm
I20260807 10:36:51.323472 27965 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:36:51 dist-test-slave-0b58 krb5kdc[27442](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099011, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.171.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:36:51.326428 27965 init.cc:377] Logged in from keytab as oryx/127.20.171.125@KRBTEST.COM (short username oryx)
I20260807 10:36:51.327821 27965 webserver.cc:460] Webserver started at http://127.20.171.125:37043/ using document root <none> and password file <none>
I20260807 10:36:51.328511 27965 fs_manager.cc:359] Metadata directory not provided
I20260807 10:36:51.328631 27965 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:36:51.328930 27965 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:36:51.331565 27965 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/master-1/data/instance:
uuid: "9d9adcde3d254acda7f28fb66fbc417c"
format_stamp: "Formatted at 2026-08-07 10:36:51 on dist-test-slave-0b58"
server_key: "963656705dac945b93fde0b40ddb81e2"
server_key_iv: "9ae86cf0f31ffddff0e7108b0a91cd50"
server_key_version: "encryptionkey@0"
I20260807 10:36:51.332355 27965 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/master-1/wal/instance:
uuid: "9d9adcde3d254acda7f28fb66fbc417c"
format_stamp: "Formatted at 2026-08-07 10:36:51 on dist-test-slave-0b58"
server_key: "963656705dac945b93fde0b40ddb81e2"
server_key_iv: "9ae86cf0f31ffddff0e7108b0a91cd50"
server_key_version: "encryptionkey@0"
I20260807 10:36:51.337071 27965 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.001s
I20260807 10:36:51.340032 27980 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:36:51.341382 27965 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260807 10:36:51.341536 27965 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/master-1/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/master-1/wal
uuid: "9d9adcde3d254acda7f28fb66fbc417c"
format_stamp: "Formatted at 2026-08-07 10:36:51 on dist-test-slave-0b58"
server_key: "963656705dac945b93fde0b40ddb81e2"
server_key_iv: "9ae86cf0f31ffddff0e7108b0a91cd50"
server_key_version: "encryptionkey@0"
I20260807 10:36:51.341733 27965 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:36:51.354137 27965 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:36:51.357751 27965 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:36:51.358028 27965 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:36:51.376509 27965 rpc_server.cc:307] RPC server started. Bound to: 127.20.171.125:41963
I20260807 10:36:51.376519 28032 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.171.125:41963 every 8 connection(s)
I20260807 10:36:51.377873 27965 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/master-1/data/info.pb
I20260807 10:36:51.380347 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 27965
I20260807 10:36:51.381495 28033 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:36:51.391223 28033 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.171.126" port: 45569 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 10:36:51 dist-test-slave-0b58 krb5kdc[27442](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099008, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.20.171.125@KRBTEST.COM
Aug 07 10:36:51 dist-test-slave-0b58 krb5kdc[27442](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099011, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.171.125@KRBTEST.COM for oryx/127.20.171.126@KRBTEST.COM
I20260807 10:36:51.404341 28036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:51.382320 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41852 (local address 127.20.171.125:41963)
0807 10:36:51.383214 (+ 894us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:51.383225 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:51.383264 (+ 39us) server_negotiation.cc:407] Connection header received
0807 10:36:51.384947 (+ 1683us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:51.384967 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:51.385330 (+ 363us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:51.385621 (+ 291us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:36:51.387522 (+ 1901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:51.388870 (+ 1348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:51.390687 (+ 1817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:51.391402 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:51.391536 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:51.396496 (+ 4960us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:36:51.396503 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:36:51.396512 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:36:51.396566 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:36:51.399939 (+ 3373us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:51.400763 (+ 824us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:51.400768 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:51.400773 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:51.400928 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:51.401354 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:51.401357 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:51.401359 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:51.401875 (+ 516us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:36:51.402208 (+ 333us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:51.402666 (+ 458us) server_negotiation.cc:299] Negotiation successful
0807 10:36:51.403121 (+ 455us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":662,"thread_start_us":379,"threads_started":1}
I20260807 10:36:51.404414 27822 heartbeater.cc:503] Master 127.20.171.126:45569 was elected leader, sending a full tablet report...
I20260807 10:36:51.409639 27824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:51.393976 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37308 (local address 127.20.171.126:45569)
0807 10:36:51.394176 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:51.394184 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:51.394703 (+ 519us) server_negotiation.cc:407] Connection header received
0807 10:36:51.394913 (+ 210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:51.394917 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:51.394979 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:51.395093 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:36:51.396338 (+ 1245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:51.397027 (+ 689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:51.398871 (+ 1844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:51.399538 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:51.399666 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:51.403322 (+ 3656us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:36:51.403326 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:36:51.403329 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:36:51.403363 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:36:51.406696 (+ 3333us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:51.407544 (+ 848us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:51.407550 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:51.407554 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:51.407688 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:51.408096 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:51.408101 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:51.408104 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:51.408470 (+ 366us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:36:51.408614 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:51.409037 (+ 423us) server_negotiation.cc:299] Negotiation successful
0807 10:36:51.409249 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260807 10:36:51.409673 28037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:51.393910 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:45569 (local address 127.0.0.1:37308)
0807 10:36:51.394568 (+ 658us) negotiation.cc:107] Waiting for socket to connect
0807 10:36:51.394598 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0807 10:36:51.394770 (+ 172us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:36:51.395208 (+ 438us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:36:51.395212 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:36:51.395873 (+ 661us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:36:51.396099 (+ 226us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:51.396107 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:51.397166 (+ 1059us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:51.397173 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:51.398721 (+ 1548us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:51.398734 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:51.399715 (+ 981us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:51.399720 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:51.399844 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:51.400471 (+ 627us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:36:51.400493 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:36:51.403135 (+ 2642us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:36:51.406855 (+ 3720us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:36:51.406865 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:36:51.406870 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:36:51.407424 (+ 554us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:36:51.407833 (+ 409us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:36:51.407839 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:36:51.407843 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:36:51.407994 (+ 151us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:36:51.408614 (+ 620us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:36:51.408621 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:36:51.408769 (+ 148us) client_negotiation.cc:769] Sending connection context
0807 10:36:51.408950 (+ 181us) client_negotiation.cc:240] Negotiation successful
0807 10:36:51.409245 (+ 295us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":451,"thread_start_us":310,"threads_started":1}
I20260807 10:36:51.411352 28033 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.171.125" port: 41963 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 10:36:51 dist-test-slave-0b58 krb5kdc[27442](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099011, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.171.125@KRBTEST.COM for oryx/127.20.171.125@KRBTEST.COM
I20260807 10:36:51.421896 28037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:51.412102 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.125:41963 (local address 127.0.0.1:41856)
0807 10:36:51.412288 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0807 10:36:51.412306 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 10:36:51.412393 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:36:51.412616 (+ 223us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:36:51.412619 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:36:51.412891 (+ 272us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:36:51.413010 (+ 119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:51.413017 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:51.413926 (+ 909us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:51.413929 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:51.414792 (+ 863us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:51.414802 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:51.415368 (+ 566us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:51.415371 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:51.415499 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:51.415989 (+ 490us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:36:51.416003 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:36:51.417794 (+ 1791us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:36:51.420076 (+ 2282us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:36:51.420079 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:36:51.420081 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:36:51.420503 (+ 422us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:36:51.420805 (+ 302us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:36:51.420807 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:36:51.420809 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:36:51.420920 (+ 111us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:36:51.421322 (+ 402us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:36:51.421324 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:36:51.421435 (+ 111us) client_negotiation.cc:769] Sending connection context
0807 10:36:51.421521 (+ 86us) client_negotiation.cc:240] Negotiation successful
0807 10:36:51.421694 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":47}
I20260807 10:36:51.422071 28036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:51.412117 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41856 (local address 127.20.171.125:41963)
0807 10:36:51.412304 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:51.412311 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:51.412366 (+ 55us) server_negotiation.cc:407] Connection header received
0807 10:36:51.412468 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:51.412471 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:51.412518 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:51.412585 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:36:51.413127 (+ 542us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:51.413806 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:51.414899 (+ 1093us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:51.415258 (+ 359us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:51.415335 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:51.417940 (+ 2605us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:36:51.417945 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:36:51.417947 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:36:51.417972 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:36:51.419968 (+ 1996us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:51.420591 (+ 623us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:51.420595 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:51.420597 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:51.420715 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:51.421015 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:51.421018 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:51.421019 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:51.421237 (+ 218us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:36:51.421327 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:51.421603 (+ 276us) server_negotiation.cc:299] Negotiation successful
0807 10:36:51.421800 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":41,"server-negotiator.queue_time_us":54}
I20260807 10:36:51.426890 28033 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9d9adcde3d254acda7f28fb66fbc417c: Bootstrap starting.
I20260807 10:36:51.429857 28033 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9d9adcde3d254acda7f28fb66fbc417c: Neither blocks nor log segments found. Creating new log.
I20260807 10:36:51.430821 28033 log.cc:824] T 00000000000000000000000000000000 P 9d9adcde3d254acda7f28fb66fbc417c: Log is configured to *not* fsync() on all Append() calls
I20260807 10:36:51.433463 28033 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9d9adcde3d254acda7f28fb66fbc417c: No bootstrap required, opened a new log
I20260807 10:36:51.440212 28033 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9d9adcde3d254acda7f28fb66fbc417c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ba955fde1542b8a0187d9fd7a0052c" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 45569 } } peers { permanent_uuid: "9d9adcde3d254acda7f28fb66fbc417c" member_type: VOTER last_known_addr { host: "127.20.171.125" port: 41963 } }
I20260807 10:36:51.440608 28033 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9d9adcde3d254acda7f28fb66fbc417c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:36:51.440712 28033 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9d9adcde3d254acda7f28fb66fbc417c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d9adcde3d254acda7f28fb66fbc417c, State: Initialized, Role: FOLLOWER
I20260807 10:36:51.441282 28033 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9d9adcde3d254acda7f28fb66fbc417c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ba955fde1542b8a0187d9fd7a0052c" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 45569 } } peers { permanent_uuid: "9d9adcde3d254acda7f28fb66fbc417c" member_type: VOTER last_known_addr { host: "127.20.171.125" port: 41963 } }
I20260807 10:36:51.442111 28039 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9d9adcde3d254acda7f28fb66fbc417c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ba955fde1542b8a0187d9fd7a0052c" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 45569 } } peers { permanent_uuid: "9d9adcde3d254acda7f28fb66fbc417c" member_type: VOTER last_known_addr { host: "127.20.171.125" port: 41963 } } }
I20260807 10:36:51.442420 28039 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9d9adcde3d254acda7f28fb66fbc417c [sys.catalog]: This master's current role is: FOLLOWER
I20260807 10:36:51.443050 28033 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9d9adcde3d254acda7f28fb66fbc417c [sys.catalog]: configured and running, proceeding with master startup.
W20260807 10:36:51.451891 28050 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 9d9adcde3d254acda7f28fb66fbc417c: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 10:36:51.452016 28050 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 10:36:51.455292 27965 master_runner.cc:428] Detected that this master 9d9adcde3d254acda7f28fb66fbc417c is joining an existing cluster
I20260807 10:36:51.455391 27965 master_runner.cc:432] Initiating AddMaster RPC to add 127.20.171.125:41963
I20260807 10:36:51.479022 27824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:51.459306 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37318 (local address 127.20.171.126:45569)
0807 10:36:51.459559 (+ 253us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:51.459566 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:51.461687 (+ 2121us) server_negotiation.cc:407] Connection header received
0807 10:36:51.462254 (+ 567us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:51.462262 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:51.462351 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:51.462420 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:36:51.464019 (+ 1599us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:51.465238 (+ 1219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:51.467524 (+ 2286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:51.468213 (+ 689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:51.468358 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:51.471273 (+ 2915us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:36:51.471279 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:36:51.471283 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:36:51.471324 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:36:51.475588 (+ 4264us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:51.476620 (+ 1032us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:51.476625 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:51.476628 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:51.476782 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:51.477255 (+ 473us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:51.477260 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:51.477263 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:51.477648 (+ 385us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:36:51.477771 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:51.478420 (+ 649us) server_negotiation.cc:299] Negotiation successful
0807 10:36:51.478655 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260807 10:36:51.479877 28036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:51.461186 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41872 (local address 127.20.171.125:41963)
0807 10:36:51.464133 (+ 2947us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:51.464145 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:51.464163 (+ 18us) server_negotiation.cc:407] Connection header received
0807 10:36:51.464207 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:51.464214 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:51.464323 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:51.464412 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:36:51.465864 (+ 1452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:51.466983 (+ 1119us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:51.469268 (+ 2285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:51.470024 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:51.470131 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:51.472484 (+ 2353us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:36:51.472492 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:36:51.472498 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:36:51.472535 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:36:51.476516 (+ 3981us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:51.477284 (+ 768us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:51.477294 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:51.477300 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:51.477434 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:51.477847 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:51.477854 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:51.477859 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:51.478238 (+ 379us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:36:51.478456 (+ 218us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:51.478974 (+ 518us) server_negotiation.cc:299] Negotiation successful
0807 10:36:51.479407 (+ 433us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":25,"server-negotiator.queue_time_us":2801}
I20260807 10:36:51.480027 28057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:51.459246 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:45569 (local address 127.0.0.1:37318)
0807 10:36:51.460750 (+ 1504us) negotiation.cc:107] Waiting for socket to connect
0807 10:36:51.460772 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0807 10:36:51.462083 (+ 1311us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:36:51.462649 (+ 566us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:36:51.462657 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:36:51.463409 (+ 752us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:36:51.463828 (+ 419us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:51.463848 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:51.465438 (+ 1590us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:51.465443 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:51.467337 (+ 1894us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:51.467354 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:51.468648 (+ 1294us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:51.468655 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:51.468853 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:51.469627 (+ 774us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:36:51.469650 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:36:51.470827 (+ 1177us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:36:51.475761 (+ 4934us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:36:51.475767 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:36:51.475775 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:36:51.476479 (+ 704us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:36:51.476955 (+ 476us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:36:51.476962 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:36:51.476965 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:36:51.477128 (+ 163us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:36:51.477890 (+ 762us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:36:51.477896 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:36:51.478118 (+ 222us) client_negotiation.cc:769] Sending connection context
0807 10:36:51.479218 (+ 1100us) client_negotiation.cc:240] Negotiation successful
0807 10:36:51.479583 (+ 365us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1324,"mutex_wait_us":101,"thread_start_us":1178,"threads_started":1}
I20260807 10:36:51.481138 28058 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:51.461336 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.125:41963 (local address 127.0.0.1:41872)
0807 10:36:51.462123 (+ 787us) negotiation.cc:107] Waiting for socket to connect
0807 10:36:51.462141 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 10:36:51.462253 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:36:51.464572 (+ 2319us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:36:51.464579 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:36:51.465302 (+ 723us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:36:51.465713 (+ 411us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:51.465727 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:51.467203 (+ 1476us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:51.467210 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:51.469125 (+ 1915us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:51.469141 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:51.470419 (+ 1278us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:51.470429 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:51.470636 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:51.471213 (+ 577us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:36:51.471235 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:36:51.472310 (+ 1075us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:36:51.476646 (+ 4336us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:36:51.476652 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:36:51.476658 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:36:51.477180 (+ 522us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:36:51.477554 (+ 374us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:36:51.477560 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:36:51.477565 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:36:51.477742 (+ 177us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:36:51.478491 (+ 749us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:36:51.478495 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:36:51.478724 (+ 229us) client_negotiation.cc:769] Sending connection context
0807 10:36:51.480431 (+ 1707us) client_negotiation.cc:240] Negotiation successful
0807 10:36:51.480773 (+ 342us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":656,"mutex_wait_us":36,"thread_start_us":459,"threads_started":1}
WARNING: no policy specified for oryx/127.20.171.124@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.20.171.124@KRBTEST.COM" created.
Aug 07 10:36:51 dist-test-slave-0b58 krb5kdc[27442](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099009, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.171.126@KRBTEST.COM for oryx/127.20.171.125@KRBTEST.COM
I20260807 10:36:51.505717 28036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:51.487672 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41888 (local address 127.20.171.125:41963)
0807 10:36:51.487819 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:51.487825 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:51.488008 (+ 183us) server_negotiation.cc:407] Connection header received
0807 10:36:51.488385 (+ 377us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:51.488391 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:51.488497 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:51.488608 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:36:51.490095 (+ 1487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:51.491144 (+ 1049us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:51.492895 (+ 1751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:51.493585 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:51.493734 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:51.498200 (+ 4466us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:36:51.498209 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:36:51.498216 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:36:51.498264 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:36:51.502286 (+ 4022us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:51.503201 (+ 915us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:51.503209 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:51.503215 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:51.503411 (+ 196us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:51.503892 (+ 481us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:51.503901 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:51.503907 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:51.504418 (+ 511us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:36:51.504630 (+ 212us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:51.505114 (+ 484us) server_negotiation.cc:299] Negotiation successful
0807 10:36:51.505381 (+ 267us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260807 10:36:51.505913 28060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:51.487150 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.125:41963 (local address 127.0.0.1:41888)
0807 10:36:51.487879 (+ 729us) negotiation.cc:107] Waiting for socket to connect
0807 10:36:51.487920 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0807 10:36:51.488146 (+ 226us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:36:51.488695 (+ 549us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:36:51.488705 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:36:51.489561 (+ 856us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:36:51.489880 (+ 319us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:51.489891 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:51.491308 (+ 1417us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:51.491313 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:51.492753 (+ 1440us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:51.492767 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:51.493763 (+ 996us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:51.493768 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:51.494000 (+ 232us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:51.494780 (+ 780us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:36:51.494808 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:36:51.497968 (+ 3160us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:36:51.502433 (+ 4465us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:36:51.502445 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:36:51.502453 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:36:51.503050 (+ 597us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:36:51.503548 (+ 498us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:36:51.503553 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:36:51.503557 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:36:51.503745 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:36:51.504586 (+ 841us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:36:51.504593 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:36:51.504803 (+ 210us) client_negotiation.cc:769] Sending connection context
0807 10:36:51.504999 (+ 196us) client_negotiation.cc:240] Negotiation successful
0807 10:36:51.505497 (+ 498us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":472,"thread_start_us":290,"threads_started":1}
I20260807 10:36:51.508545 27487 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.20.171.125:41963: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "9d9adcde3d254acda7f28fb66fbc417c"
member_type: NON_VOTER
last_known_addr {
host: "127.20.171.125"
port: 41963
}
attrs {
promote: true
}
}
dest_uuid: "a3ba955fde1542b8a0187d9fd7a0052c"
cas_config_opid_index: -1
I20260807 10:36:51.510129 27487 consensus_queue.cc:237] T 00000000000000000000000000000000 P a3ba955fde1542b8a0187d9fd7a0052c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "a3ba955fde1542b8a0187d9fd7a0052c" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 45569 } } peers { permanent_uuid: "9d9adcde3d254acda7f28fb66fbc417c" member_type: NON_VOTER last_known_addr { host: "127.20.171.125" port: 41963 } attrs { promote: true } }
I20260807 10:36:51.522238 28007 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9d9adcde3d254acda7f28fb66fbc417c [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:36:51.523578 28063 raft_consensus.cc:2932] T 00000000000000000000000000000000 P a3ba955fde1542b8a0187d9fd7a0052c [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER 9d9adcde3d254acda7f28fb66fbc417c (127.20.171.125) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "a3ba955fde1542b8a0187d9fd7a0052c" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 45569 } } peers { permanent_uuid: "9d9adcde3d254acda7f28fb66fbc417c" member_type: NON_VOTER last_known_addr { host: "127.20.171.125" port: 41963 } attrs { promote: true } } }
I20260807 10:36:51.526400 28007 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 9d9adcde3d254acda7f28fb66fbc417c [term 1 FOLLOWER]: Refusing update from remote peer a3ba955fde1542b8a0187d9fd7a0052c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260807 10:36:51.527797 28064 consensus_queue.cc:1035] T 00000000000000000000000000000000 P a3ba955fde1542b8a0187d9fd7a0052c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d9adcde3d254acda7f28fb66fbc417c" member_type: NON_VOTER last_known_addr { host: "127.20.171.125" port: 41963 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 10:36:51.530447 28063 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.20.171.125:41963
I20260807 10:36:51.531047 28063 sys_catalog.cc:455] T 00000000000000000000000000000000 P a3ba955fde1542b8a0187d9fd7a0052c [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "a3ba955fde1542b8a0187d9fd7a0052c" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "a3ba955fde1542b8a0187d9fd7a0052c" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 45569 } } peers { permanent_uuid: "9d9adcde3d254acda7f28fb66fbc417c" member_type: NON_VOTER last_known_addr { host: "127.20.171.125" port: 41963 } attrs { promote: true } } }
I20260807 10:36:51.531368 28063 sys_catalog.cc:458] T 00000000000000000000000000000000 P a3ba955fde1542b8a0187d9fd7a0052c [sys.catalog]: This master's current role is: LEADER
I20260807 10:36:51.532719 27965 master.cc:537] Master@127.20.171.125:41963 shutting down...
W20260807 10:36:51.536222 27474 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
W20260807 10:36:51.538302 27474 consensus_peers.cc:487] T 00000000000000000000000000000000 P a3ba955fde1542b8a0187d9fd7a0052c -> Peer 9d9adcde3d254acda7f28fb66fbc417c (127.20.171.125:41963): Couldn't send request to peer 9d9adcde3d254acda7f28fb66fbc417c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.20.171.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/krb5kdc/oryx_127.20.171.124.keytab.
Entry for principal oryx/127.20.171.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/krb5kdc/oryx_127.20.171.124.keytab.
I20260807 10:36:51.540489 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.171.124:42363
--webserver_interface=127.20.171.124
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/krb5kdc/oryx_127.20.171.124.keytab
--principal=oryx/127.20.171.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.171.84:36279
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.171.126:45569,127.20.171.125:41963,127.20.171.124:42363
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 10:36:51.549512 27965 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 9d9adcde3d254acda7f28fb66fbc417c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 10:36:51.549911 27965 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 9d9adcde3d254acda7f28fb66fbc417c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:36:51.550112 27965 tablet_replica.cc:330] T 00000000000000000000000000000000 P 9d9adcde3d254acda7f28fb66fbc417c: stopping tablet replica
I20260807 10:36:51.557379 27965 master.cc:552] Master@127.20.171.125:41963 shutdown complete.
I20260807 10:36:51.557510 27965 master_runner.cc:305] Clearing existing system tablet
I20260807 10:36:51.558003 27965 fs_manager.cc:359] Metadata directory not provided
I20260807 10:36:51.558102 27965 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:36:51.561249 27965 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.003s
I20260807 10:36:51.565984 28070 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:36:51.566411 27965 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:36:51.566694 27965 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.002s sys 0.001s
I20260807 10:36:51.566789 27965 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/master-1/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/master-1/wal
uuid: "9d9adcde3d254acda7f28fb66fbc417c"
format_stamp: "Formatted at 2026-08-07 10:36:51 on dist-test-slave-0b58"
server_key: "963656705dac945b93fde0b40ddb81e2"
server_key_iv: "9ae86cf0f31ffddff0e7108b0a91cd50"
server_key_version: "encryptionkey@0"
I20260807 10:36:51.572415 27965 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 9d9adcde3d254acda7f28fb66fbc417c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 10:36:51.579427 27965 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 9d9adcde3d254acda7f28fb66fbc417c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260807 10:36:51.579599 27965 log.cc:1196] T 00000000000000000000000000000000 P 9d9adcde3d254acda7f28fb66fbc417c: Deleting WAL directory at /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260807 10:36:51.580036 27965 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 9d9adcde3d254acda7f28fb66fbc417c: Deleting consensus metadata
I20260807 10:36:51.580318 27965 master_runner.cc:315] Copying system tablet from 127.20.171.126:45569
I20260807 10:36:51.583053 27965 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 9d9adcde3d254acda7f28fb66fbc417c: tablet copy: Beginning tablet copy session from remote peer at address 127.20.171.126:45569
I20260807 10:36:51.608161 27824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:51.584156 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37324 (local address 127.20.171.126:45569)
0807 10:36:51.584395 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:51.584404 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:51.592851 (+ 8447us) server_negotiation.cc:407] Connection header received
0807 10:36:51.593040 (+ 189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:51.593045 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:51.593130 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:51.593242 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:36:51.594428 (+ 1186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:51.595604 (+ 1176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:51.597642 (+ 2038us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:51.598370 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:51.598517 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:51.600857 (+ 2340us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:36:51.600863 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:36:51.600867 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:36:51.600905 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:36:51.604719 (+ 3814us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:51.605630 (+ 911us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:51.605637 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:51.605642 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:51.605821 (+ 179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:51.606374 (+ 553us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:51.606382 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:51.606387 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:51.606821 (+ 434us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:36:51.606991 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:51.607562 (+ 571us) server_negotiation.cc:299] Negotiation successful
0807 10:36:51.607815 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260807 10:36:51.608218 28077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:51.584048 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:45569 (local address 127.0.0.1:37324)
0807 10:36:51.592703 (+ 8655us) negotiation.cc:107] Waiting for socket to connect
0807 10:36:51.592734 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0807 10:36:51.592900 (+ 166us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:36:51.593289 (+ 389us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:36:51.593294 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:36:51.593914 (+ 620us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:36:51.594230 (+ 316us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:51.594244 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:51.595778 (+ 1534us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:51.595784 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:51.597477 (+ 1693us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:51.597493 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:51.598578 (+ 1085us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:51.598585 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:51.598801 (+ 216us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:51.599510 (+ 709us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:36:51.599541 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:36:51.600632 (+ 1091us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:36:51.604979 (+ 4347us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:36:51.604985 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:36:51.604989 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:36:51.605485 (+ 496us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:36:51.605945 (+ 460us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:36:51.605950 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:36:51.605954 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:36:51.606157 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:36:51.606958 (+ 801us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:36:51.606964 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:36:51.607151 (+ 187us) client_negotiation.cc:769] Sending connection context
0807 10:36:51.607322 (+ 171us) client_negotiation.cc:240] Negotiation successful
0807 10:36:51.607694 (+ 372us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8506,"thread_start_us":8395,"threads_started":1}
I20260807 10:36:51.609571 27508 tablet_copy_service.cc:140] P a3ba955fde1542b8a0187d9fd7a0052c: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 9d9adcde3d254acda7f28fb66fbc417c ({username='oryx', principal='oryx/127.20.171.125@KRBTEST.COM'} at 127.0.0.1:37324)
I20260807 10:36:51.610002 27508 tablet_copy_service.cc:161] P a3ba955fde1542b8a0187d9fd7a0052c: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 9d9adcde3d254acda7f28fb66fbc417c at {username='oryx', principal='oryx/127.20.171.125@KRBTEST.COM'} at 127.0.0.1:37324: session id = 9d9adcde3d254acda7f28fb66fbc417c-00000000000000000000000000000000
I20260807 10:36:51.614488 27508 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P a3ba955fde1542b8a0187d9fd7a0052c: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 10:36:51.617254 27965 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260807 10:36:51.623880 27965 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 9d9adcde3d254acda7f28fb66fbc417c: tablet copy: Starting download of 0 data blocks...
I20260807 10:36:51.624295 27965 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 9d9adcde3d254acda7f28fb66fbc417c: tablet copy: Starting download of 1 WAL segments...
I20260807 10:36:51.628218 27965 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 9d9adcde3d254acda7f28fb66fbc417c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 10:36:51.632891 27508 tablet_copy_service.cc:342] P a3ba955fde1542b8a0187d9fd7a0052c: Request end of tablet copy session 9d9adcde3d254acda7f28fb66fbc417c-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.20.171.125@KRBTEST.COM'} at 127.0.0.1:37324
I20260807 10:36:51.633163 27508 tablet_copy_service.cc:433] P a3ba955fde1542b8a0187d9fd7a0052c: ending tablet copy session 9d9adcde3d254acda7f28fb66fbc417c-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 9d9adcde3d254acda7f28fb66fbc417c
I20260807 10:36:51.647051 27965 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:36:51.649840 28078 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:36:51.650929 28079 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:36:51.658021 28081 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:36:51.658339 27965 server_base.cc:1034] running on GCE node
I20260807 10:36:51.658772 27965 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:36:51.659431 27965 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:36:51.660715 27965 hybrid_clock.cc:648] HybridClock initialized: now 1786099011660662 us; error 45 us; skew 500 ppm
I20260807 10:36:51.660938 27965 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:36:51 dist-test-slave-0b58 krb5kdc[27442](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099011, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.171.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:36:51.663050 27965 init.cc:377] Logged in from keytab as oryx/127.20.171.125@KRBTEST.COM (short username oryx)
I20260807 10:36:51.669279 27965 webserver.cc:460] Webserver started at http://127.20.171.125:36989/ using document root <none> and password file <none>
I20260807 10:36:51.669590 27965 fs_manager.cc:359] Metadata directory not provided
I20260807 10:36:51.669680 27965 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:36:51.672729 27965 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.001s
I20260807 10:36:51.674717 28088 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:36:51.675102 27965 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.001s
I20260807 10:36:51.675230 27965 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/master-1/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/master-1/wal
uuid: "9d9adcde3d254acda7f28fb66fbc417c"
format_stamp: "Formatted at 2026-08-07 10:36:51 on dist-test-slave-0b58"
server_key: "963656705dac945b93fde0b40ddb81e2"
server_key_iv: "9ae86cf0f31ffddff0e7108b0a91cd50"
server_key_version: "encryptionkey@0"
I20260807 10:36:51.675380 27965 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:36:51.690546 27965 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:36:51.694478 27965 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:36:51.728073 27965 rpc_server.cc:307] RPC server started. Bound to: 127.20.171.125:41963
I20260807 10:36:51.728118 28139 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.171.125:41963 every 8 connection(s)
I20260807 10:36:51.729239 27965 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/master-1/data/info.pb
I20260807 10:36:51.734855 28140 sys_catalog.cc:263] Verifying existing consensus state
I20260807 10:36:51.739254 28140 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9d9adcde3d254acda7f28fb66fbc417c: Bootstrap starting.
I20260807 10:36:51.758390 28140 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9d9adcde3d254acda7f28fb66fbc417c: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 10:36:51.759078 28140 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9d9adcde3d254acda7f28fb66fbc417c: Bootstrap complete.
I20260807 10:36:51.760545 28140 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9d9adcde3d254acda7f28fb66fbc417c [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "a3ba955fde1542b8a0187d9fd7a0052c" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 45569 } } peers { permanent_uuid: "9d9adcde3d254acda7f28fb66fbc417c" member_type: NON_VOTER last_known_addr { host: "127.20.171.125" port: 41963 } attrs { promote: true } }
I20260807 10:36:51.760970 28140 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9d9adcde3d254acda7f28fb66fbc417c [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 9d9adcde3d254acda7f28fb66fbc417c, State: Initialized, Role: LEARNER
I20260807 10:36:51.761548 28140 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9d9adcde3d254acda7f28fb66fbc417c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "a3ba955fde1542b8a0187d9fd7a0052c" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 45569 } } peers { permanent_uuid: "9d9adcde3d254acda7f28fb66fbc417c" member_type: NON_VOTER last_known_addr { host: "127.20.171.125" port: 41963 } attrs { promote: true } }
I20260807 10:36:51.763295 28140 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9d9adcde3d254acda7f28fb66fbc417c [sys.catalog]: configured and running, proceeding with master startup.
I20260807 10:36:51.763144 28143 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9d9adcde3d254acda7f28fb66fbc417c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "a3ba955fde1542b8a0187d9fd7a0052c" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 45569 } } peers { permanent_uuid: "9d9adcde3d254acda7f28fb66fbc417c" member_type: NON_VOTER last_known_addr { host: "127.20.171.125" port: 41963 } attrs { promote: true } } }
I20260807 10:36:51.763931 28143 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9d9adcde3d254acda7f28fb66fbc417c [sys.catalog]: This master's current role is: LEARNER
I20260807 10:36:51.779512 28155 catalog_manager.cc:1259] Loaded cluster ID: 7b9a4b9fc4a3418fa3f99e0b86b93379
I20260807 10:36:51.779700 28155 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 9d9adcde3d254acda7f28fb66fbc417c: loading cluster ID for follower catalog manager: success
I20260807 10:36:51.784200 28155 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 9d9adcde3d254acda7f28fb66fbc417c: acquiring CA information for follower catalog manager: success
I20260807 10:36:51.786998 28155 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 9d9adcde3d254acda7f28fb66fbc417c: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260807 10:36:51.904683 27960 heartbeater.cc:503] Master 127.20.171.126:45569 was elected leader, sending a full tablet report...
I20260807 10:36:51.955421 28060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:51.928808 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.125:41963 (local address 127.0.0.1:41890)
0807 10:36:51.929360 (+ 552us) negotiation.cc:107] Waiting for socket to connect
0807 10:36:51.929382 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0807 10:36:51.929526 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:36:51.943895 (+ 14369us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:36:51.943901 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:36:51.943939 (+ 38us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:36:51.944204 (+ 265us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:51.944218 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:51.947821 (+ 3603us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:51.947827 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:51.951036 (+ 3209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:51.951052 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:51.954157 (+ 3105us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:51.954164 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:51.954574 (+ 410us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:51.954641 (+ 67us) client_negotiation.cc:769] Sending connection context
0807 10:36:51.954756 (+ 115us) client_negotiation.cc:240] Negotiation successful
0807 10:36:51.954897 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":344}
I20260807 10:36:51.955868 28156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:51.930049 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41890 (local address 127.20.171.125:41963)
0807 10:36:51.943289 (+ 13240us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:51.943306 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:51.943337 (+ 31us) server_negotiation.cc:407] Connection header received
0807 10:36:51.943439 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:51.943448 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:51.943623 (+ 175us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:51.943807 (+ 184us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:36:51.944453 (+ 646us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:51.947605 (+ 3152us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:51.951221 (+ 3616us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:51.953914 (+ 2693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:51.954192 (+ 278us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:51.954420 (+ 228us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:51.954824 (+ 404us) server_negotiation.cc:299] Negotiation successful
0807 10:36:51.955076 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13026,"thread_start_us":12678,"threads_started":1}
I20260807 10:36:51.958310 28115 raft_consensus.cc:1203] T 00000000000000000000000000000000 P 9d9adcde3d254acda7f28fb66fbc417c [term 1 LEARNER]: Deduplicated request from leader. Original: 0.0->[1.1-1.5] Dedup: 1.5->[]
I20260807 10:36:51.959451 28143 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9d9adcde3d254acda7f28fb66fbc417c [sys.catalog]: SysCatalogTable state changed. Reason: New leader a3ba955fde1542b8a0187d9fd7a0052c. Latest consensus state: current_term: 1 leader_uuid: "a3ba955fde1542b8a0187d9fd7a0052c" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "a3ba955fde1542b8a0187d9fd7a0052c" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 45569 } } peers { permanent_uuid: "9d9adcde3d254acda7f28fb66fbc417c" member_type: NON_VOTER last_known_addr { host: "127.20.171.125" port: 41963 } attrs { promote: true } } }
I20260807 10:36:51.959782 28143 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9d9adcde3d254acda7f28fb66fbc417c [sys.catalog]: This master's current role is: LEARNER
W20260807 10:36:52.074314 28068 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:36:52.074771 28068 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:36:52.075023 28068 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:36:52.085870 28068 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 10:36:52.086117 28068 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:36:52.086277 28068 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:36:52.086398 28068 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 10:36:52.086534 28068 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 10:36:52.101023 28068 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.171.84:36279
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.20.171.126:45569,127.20.171.125:41963,127.20.171.124:42363
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/krb5kdc/oryx_127.20.171.124.keytab
--principal=oryx/127.20.171.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.171.124:42363
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.20.171.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:36:52.102614 28068 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:36:52.104142 28068 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:36:52.121234 28161 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:36:52.121424 28164 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:36:52.121455 28162 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:36:52.122702 28068 server_base.cc:1034] running on GCE node
I20260807 10:36:52.123656 28068 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:36:52.125424 28068 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:36:52.126739 28068 hybrid_clock.cc:648] HybridClock initialized: now 1786099012126611 us; error 54 us; skew 500 ppm
I20260807 10:36:52.127178 28068 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:36:52 dist-test-slave-0b58 krb5kdc[27442](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099012, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.171.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:36:52.131866 28068 init.cc:377] Logged in from keytab as oryx/127.20.171.124@KRBTEST.COM (short username oryx)
I20260807 10:36:52.134047 28068 webserver.cc:460] Webserver started at http://127.20.171.124:40977/ using document root <none> and password file <none>
I20260807 10:36:52.134874 28068 fs_manager.cc:359] Metadata directory not provided
I20260807 10:36:52.135020 28068 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:36:52.135354 28068 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:36:52.139454 28068 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/master-2/data/instance:
uuid: "7cb70b70a1944a069f2e1ef2c66c7b19"
format_stamp: "Formatted at 2026-08-07 10:36:52 on dist-test-slave-0b58"
server_key: "8f009aed73d5526b959835c75151a690"
server_key_iv: "474f5dd20b38da57e9579151f2fcbe6d"
server_key_version: "encryptionkey@0"
I20260807 10:36:52.140615 28068 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/master-2/wal/instance:
uuid: "7cb70b70a1944a069f2e1ef2c66c7b19"
format_stamp: "Formatted at 2026-08-07 10:36:52 on dist-test-slave-0b58"
server_key: "8f009aed73d5526b959835c75151a690"
server_key_iv: "474f5dd20b38da57e9579151f2fcbe6d"
server_key_version: "encryptionkey@0"
I20260807 10:36:52.147578 28068 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.001s
I20260807 10:36:52.152923 28171 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:36:52.154495 28068 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260807 10:36:52.154778 28068 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/master-2/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/master-2/wal
uuid: "7cb70b70a1944a069f2e1ef2c66c7b19"
format_stamp: "Formatted at 2026-08-07 10:36:52 on dist-test-slave-0b58"
server_key: "8f009aed73d5526b959835c75151a690"
server_key_iv: "474f5dd20b38da57e9579151f2fcbe6d"
server_key_version: "encryptionkey@0"
I20260807 10:36:52.155081 28068 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:36:52.175891 28068 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:36:52.182055 28068 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:36:52.182542 28068 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:36:52.244908 28068 rpc_server.cc:307] RPC server started. Bound to: 127.20.171.124:42363
I20260807 10:36:52.245157 28223 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.171.124:42363 every 8 connection(s)
I20260807 10:36:52.246874 28068 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/master-2/data/info.pb
I20260807 10:36:52.250188 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 28068
I20260807 10:36:52.253298 28224 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:36:52.263690 28224 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.171.126" port: 45569 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 10:36:52 dist-test-slave-0b58 krb5kdc[27442](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099008, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.20.171.124@KRBTEST.COM
Aug 07 10:36:52 dist-test-slave-0b58 krb5kdc[27442](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099012, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.171.124@KRBTEST.COM for oryx/127.20.171.126@KRBTEST.COM
I20260807 10:36:52.284116 28227 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:52.252695 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35356 (local address 127.20.171.124:42363)
0807 10:36:52.253808 (+ 1113us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:52.253820 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:52.253896 (+ 76us) server_negotiation.cc:407] Connection header received
0807 10:36:52.256074 (+ 2178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:52.256095 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:52.256535 (+ 440us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:52.257064 (+ 529us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:36:52.259507 (+ 2443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:52.261082 (+ 1575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:52.263103 (+ 2021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:52.264430 (+ 1327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:52.264689 (+ 259us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:52.272853 (+ 8164us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:36:52.272862 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:36:52.272873 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:36:52.272910 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:36:52.278378 (+ 5468us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:52.279696 (+ 1318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:52.279717 (+ 21us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:52.279725 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:52.279912 (+ 187us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:52.280474 (+ 562us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:52.280477 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:52.280479 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:52.280969 (+ 490us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:36:52.281260 (+ 291us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:52.281867 (+ 607us) server_negotiation.cc:299] Negotiation successful
0807 10:36:52.282282 (+ 415us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":841,"thread_start_us":533,"threads_started":1}
I20260807 10:36:52.292055 28228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:52.267165 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:45569 (local address 127.0.0.1:37340)
0807 10:36:52.269497 (+ 2332us) negotiation.cc:107] Waiting for socket to connect
0807 10:36:52.269563 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0807 10:36:52.269945 (+ 382us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:36:52.270589 (+ 644us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:36:52.270597 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:36:52.272011 (+ 1414us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:36:52.273201 (+ 1190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:52.273214 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:52.275382 (+ 2168us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:52.275388 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:52.277274 (+ 1886us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:52.277286 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:52.278586 (+ 1300us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:52.278596 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:52.278960 (+ 364us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:52.279924 (+ 964us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:36:52.279940 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:36:52.283967 (+ 4027us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:36:52.289154 (+ 5187us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:36:52.289163 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:36:52.289168 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:36:52.289795 (+ 627us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:36:52.290122 (+ 327us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:36:52.290125 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:36:52.290127 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:36:52.290332 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:36:52.290860 (+ 528us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:36:52.290866 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:36:52.291082 (+ 216us) client_negotiation.cc:769] Sending connection context
0807 10:36:52.291286 (+ 204us) client_negotiation.cc:240] Negotiation successful
0807 10:36:52.291530 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1884,"thread_start_us":970,"threads_started":1}
I20260807 10:36:52.292066 28229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:52.267500 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37340 (local address 127.20.171.126:45569)
0807 10:36:52.268622 (+ 1122us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:52.268626 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:52.269794 (+ 1168us) server_negotiation.cc:407] Connection header received
0807 10:36:52.270106 (+ 312us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:52.270113 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:52.270198 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:52.270462 (+ 264us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:36:52.273403 (+ 2941us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:52.275107 (+ 1704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:52.277432 (+ 2325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:52.278194 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:52.278364 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:52.284291 (+ 5927us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:36:52.284298 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:36:52.284302 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:36:52.284343 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:36:52.288999 (+ 4656us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:52.289905 (+ 906us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:52.289909 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:52.289911 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:52.290033 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:52.290430 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:52.290433 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:52.290435 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:52.290738 (+ 303us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:36:52.290862 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:52.291389 (+ 527us) server_negotiation.cc:299] Negotiation successful
0807 10:36:52.291597 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1020,"thread_start_us":909,"threads_started":1}
I20260807 10:36:52.293843 28224 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.171.125" port: 41963 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 10:36:52 dist-test-slave-0b58 krb5kdc[27442](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099012, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.171.124@KRBTEST.COM for oryx/127.20.171.125@KRBTEST.COM
I20260807 10:36:52.311275 28156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:52.294835 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41904 (local address 127.20.171.125:41963)
0807 10:36:52.295086 (+ 251us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:52.295091 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:52.295542 (+ 451us) server_negotiation.cc:407] Connection header received
0807 10:36:52.295653 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:52.295657 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:52.295731 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:52.295803 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:36:52.296865 (+ 1062us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:52.297825 (+ 960us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:52.299556 (+ 1731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:52.300243 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:52.300409 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:52.304607 (+ 4198us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:36:52.304612 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:36:52.304629 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:36:52.304679 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:36:52.308528 (+ 3849us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:52.309346 (+ 818us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:52.309350 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:52.309352 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:52.309553 (+ 201us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:52.309922 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:52.309925 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:52.309927 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:52.310300 (+ 373us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:36:52.310429 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:52.310728 (+ 299us) server_negotiation.cc:299] Negotiation successful
0807 10:36:52.310940 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260807 10:36:52.311842 28228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:52.295251 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.125:41963 (local address 127.0.0.1:41904)
0807 10:36:52.295456 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0807 10:36:52.295471 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 10:36:52.295561 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:36:52.295852 (+ 291us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:36:52.295855 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:36:52.296412 (+ 557us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:36:52.296711 (+ 299us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:52.296721 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:52.297997 (+ 1276us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:52.298001 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:52.299421 (+ 1420us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:52.299432 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:52.300477 (+ 1045us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:52.300481 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:52.300693 (+ 212us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:52.301436 (+ 743us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:36:52.301451 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:36:52.304407 (+ 2956us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:36:52.308637 (+ 4230us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:36:52.308641 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:36:52.308643 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:36:52.309228 (+ 585us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:36:52.309646 (+ 418us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:36:52.309649 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:36:52.309651 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:36:52.309833 (+ 182us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:36:52.310419 (+ 586us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:36:52.310422 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:36:52.310544 (+ 122us) client_negotiation.cc:769] Sending connection context
0807 10:36:52.310641 (+ 97us) client_negotiation.cc:240] Negotiation successful
0807 10:36:52.311110 (+ 469us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":53}
I20260807 10:36:52.313387 28224 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.171.124" port: 42363 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 10:36:52 dist-test-slave-0b58 krb5kdc[27442](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099012, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.171.124@KRBTEST.COM for oryx/127.20.171.124@KRBTEST.COM
I20260807 10:36:52.330101 28228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:52.314085 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.124:42363 (local address 127.0.0.1:35368)
0807 10:36:52.314240 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0807 10:36:52.314254 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 10:36:52.314333 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:36:52.314748 (+ 415us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:36:52.314753 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:36:52.315339 (+ 586us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:36:52.315578 (+ 239us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:52.315587 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:52.316892 (+ 1305us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:52.316900 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:52.318075 (+ 1175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:52.318087 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:52.319119 (+ 1032us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:52.319125 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:52.319449 (+ 324us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:52.320222 (+ 773us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:36:52.320238 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:36:52.322947 (+ 2709us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:36:52.327094 (+ 4147us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:36:52.327109 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:36:52.327113 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:36:52.327639 (+ 526us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:36:52.328096 (+ 457us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:36:52.328100 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:36:52.328103 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:36:52.328456 (+ 353us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:36:52.329030 (+ 574us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:36:52.329034 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:36:52.329242 (+ 208us) client_negotiation.cc:769] Sending connection context
0807 10:36:52.329361 (+ 119us) client_negotiation.cc:240] Negotiation successful
0807 10:36:52.329558 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":65}
I20260807 10:36:52.330257 28227 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:52.314360 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35368 (local address 127.20.171.124:42363)
0807 10:36:52.314505 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:52.314509 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:52.314534 (+ 25us) server_negotiation.cc:407] Connection header received
0807 10:36:52.314576 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:52.314580 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:52.314624 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:52.314731 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:36:52.315715 (+ 984us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:52.316772 (+ 1057us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:52.318220 (+ 1448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:52.318915 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:52.319043 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:52.323127 (+ 4084us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:36:52.323132 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:36:52.323135 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:36:52.323165 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:36:52.326958 (+ 3793us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:52.327751 (+ 793us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:52.327758 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:52.327761 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:52.327965 (+ 204us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:52.328569 (+ 604us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:52.328573 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:52.328575 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:52.328923 (+ 348us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:36:52.329031 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:52.329475 (+ 444us) server_negotiation.cc:299] Negotiation successful
0807 10:36:52.329760 (+ 285us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":33,"server-negotiator.queue_time_us":58}
I20260807 10:36:52.336318 28224 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7cb70b70a1944a069f2e1ef2c66c7b19: Bootstrap starting.
I20260807 10:36:52.340299 28224 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7cb70b70a1944a069f2e1ef2c66c7b19: Neither blocks nor log segments found. Creating new log.
I20260807 10:36:52.342017 28224 log.cc:824] T 00000000000000000000000000000000 P 7cb70b70a1944a069f2e1ef2c66c7b19: Log is configured to *not* fsync() on all Append() calls
I20260807 10:36:52.345846 28224 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7cb70b70a1944a069f2e1ef2c66c7b19: No bootstrap required, opened a new log
I20260807 10:36:52.356751 28224 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7cb70b70a1944a069f2e1ef2c66c7b19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ba955fde1542b8a0187d9fd7a0052c" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 45569 } } peers { permanent_uuid: "9d9adcde3d254acda7f28fb66fbc417c" member_type: VOTER last_known_addr { host: "127.20.171.125" port: 41963 } } peers { permanent_uuid: "7cb70b70a1944a069f2e1ef2c66c7b19" member_type: VOTER last_known_addr { host: "127.20.171.124" port: 42363 } }
I20260807 10:36:52.357177 28224 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7cb70b70a1944a069f2e1ef2c66c7b19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:36:52.357342 28224 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7cb70b70a1944a069f2e1ef2c66c7b19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7cb70b70a1944a069f2e1ef2c66c7b19, State: Initialized, Role: FOLLOWER
I20260807 10:36:52.358044 28224 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7cb70b70a1944a069f2e1ef2c66c7b19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ba955fde1542b8a0187d9fd7a0052c" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 45569 } } peers { permanent_uuid: "9d9adcde3d254acda7f28fb66fbc417c" member_type: VOTER last_known_addr { host: "127.20.171.125" port: 41963 } } peers { permanent_uuid: "7cb70b70a1944a069f2e1ef2c66c7b19" member_type: VOTER last_known_addr { host: "127.20.171.124" port: 42363 } }
I20260807 10:36:52.359534 28231 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7cb70b70a1944a069f2e1ef2c66c7b19 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ba955fde1542b8a0187d9fd7a0052c" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 45569 } } peers { permanent_uuid: "9d9adcde3d254acda7f28fb66fbc417c" member_type: VOTER last_known_addr { host: "127.20.171.125" port: 41963 } } peers { permanent_uuid: "7cb70b70a1944a069f2e1ef2c66c7b19" member_type: VOTER last_known_addr { host: "127.20.171.124" port: 42363 } } }
I20260807 10:36:52.360244 28231 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7cb70b70a1944a069f2e1ef2c66c7b19 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 10:36:52.360644 28224 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7cb70b70a1944a069f2e1ef2c66c7b19 [sys.catalog]: configured and running, proceeding with master startup.
W20260807 10:36:52.377246 28242 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 7cb70b70a1944a069f2e1ef2c66c7b19: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 10:36:52.377489 28242 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 10:36:52.381254 28068 master_runner.cc:428] Detected that this master 7cb70b70a1944a069f2e1ef2c66c7b19 is joining an existing cluster
I20260807 10:36:52.381393 28068 master_runner.cc:432] Initiating AddMaster RPC to add 127.20.171.124:42363
I20260807 10:36:52.391574 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 27551
Aug 07 10:36:52 dist-test-slave-0b58 krb5kdc[27442](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099008, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.20.171.65@KRBTEST.COM
I20260807 10:36:52.431730 28248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:52.393089 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59310 (local address 127.20.171.65:42425)
0807 10:36:52.395359 (+ 2270us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:52.395367 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:52.395396 (+ 29us) server_negotiation.cc:407] Connection header received
0807 10:36:52.395524 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:52.395534 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:52.395808 (+ 274us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:52.398925 (+ 3117us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:36:52.399429 (+ 504us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:52.401732 (+ 2303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:52.404690 (+ 2958us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:52.406311 (+ 1621us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:52.418296 (+ 11985us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:52.418888 (+ 592us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:36:52.418903 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:36:52.418920 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:36:52.418976 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:36:52.424936 (+ 5960us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:52.426322 (+ 1386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:52.426330 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:52.426334 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:52.426652 (+ 318us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:52.427541 (+ 889us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:52.427548 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:52.427553 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:52.428335 (+ 782us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:36:52.430311 (+ 1976us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:52.430539 (+ 228us) server_negotiation.cc:299] Negotiation successful
0807 10:36:52.430962 (+ 423us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2043,"thread_start_us":1722,"threads_started":1}
I20260807 10:36:52.433760 27680 generic_service.cc:196] Checking for leaks (request via RPC)
W20260807 10:36:52.436698 28177 tablet.cc:2369] T 00000000000000000000000000000000 P 7cb70b70a1944a069f2e1ef2c66c7b19: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 10:36:52.452884 28229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:52.392631 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37350 (local address 127.20.171.126:45569)
0807 10:36:52.392841 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:52.392847 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:52.407882 (+ 15035us) server_negotiation.cc:407] Connection header received
0807 10:36:52.408202 (+ 320us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:52.408207 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:52.408294 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:52.408366 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:36:52.418283 (+ 9917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:52.419903 (+ 1620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:52.425719 (+ 5816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:52.426996 (+ 1277us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:52.427167 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:52.442390 (+ 15223us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:36:52.442411 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:36:52.442417 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:36:52.442484 (+ 67us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:36:52.448071 (+ 5587us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:52.449059 (+ 988us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:52.449065 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:52.449070 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:52.449387 (+ 317us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:52.450263 (+ 876us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:52.450269 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:52.450272 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:52.450764 (+ 492us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:36:52.450916 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:52.451946 (+ 1030us) server_negotiation.cc:299] Negotiation successful
0807 10:36:52.452286 (+ 340us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260807 10:36:52.455041 28250 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:52.394365 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:45569 (local address 127.0.0.1:37350)
0807 10:36:52.407774 (+ 13409us) negotiation.cc:107] Waiting for socket to connect
0807 10:36:52.407797 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0807 10:36:52.408033 (+ 236us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:36:52.408639 (+ 606us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:36:52.408644 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:36:52.410331 (+ 1687us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:36:52.411312 (+ 981us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:52.411332 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:52.420252 (+ 8920us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:52.420272 (+ 20us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:52.424699 (+ 4427us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:52.424720 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:52.427945 (+ 3225us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:52.427958 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:52.429953 (+ 1995us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:52.432917 (+ 2964us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:36:52.432949 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:36:52.442109 (+ 9160us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:36:52.448259 (+ 6150us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:36:52.448264 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:36:52.448267 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:36:52.448893 (+ 626us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:36:52.449598 (+ 705us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:36:52.449603 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:36:52.449606 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:36:52.450084 (+ 478us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:36:52.451021 (+ 937us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:36:52.451025 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:36:52.451447 (+ 422us) client_negotiation.cc:769] Sending connection context
0807 10:36:52.453183 (+ 1736us) client_negotiation.cc:240] Negotiation successful
0807 10:36:52.453633 (+ 450us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13162,"thread_start_us":30669,"threads_started":1}
I20260807 10:36:52.462850 28249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:52.397001 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.125:41963 (local address 127.0.0.1:41908)
0807 10:36:52.425895 (+ 28894us) negotiation.cc:107] Waiting for socket to connect
0807 10:36:52.425916 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0807 10:36:52.426194 (+ 278us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:36:52.426926 (+ 732us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:36:52.426931 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:36:52.429133 (+ 2202us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:36:52.430123 (+ 990us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:52.430155 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:52.432780 (+ 2625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:52.432788 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:52.443219 (+ 10431us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:52.443231 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:52.445160 (+ 1929us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:52.445168 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:52.445595 (+ 427us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:52.446621 (+ 1026us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:36:52.446645 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:36:52.448684 (+ 2039us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:36:52.457935 (+ 9251us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:36:52.457942 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:36:52.457946 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:36:52.458514 (+ 568us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:36:52.459387 (+ 873us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:36:52.459394 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:36:52.459400 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:36:52.459637 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:36:52.461056 (+ 1419us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:36:52.461061 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:36:52.461869 (+ 808us) client_negotiation.cc:769] Sending connection context
0807 10:36:52.462007 (+ 138us) client_negotiation.cc:240] Negotiation successful
0807 10:36:52.462324 (+ 317us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":28470,"thread_start_us":7956,"threads_started":1}
I20260807 10:36:52.467293 28156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:52.394032 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41908 (local address 127.20.171.125:41963)
0807 10:36:52.394244 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:52.394249 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:52.426019 (+ 31770us) server_negotiation.cc:407] Connection header received
0807 10:36:52.426355 (+ 336us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:52.426360 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:52.426499 (+ 139us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:52.426577 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:36:52.430350 (+ 3773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:52.432164 (+ 1814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:52.443363 (+ 11199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:52.444683 (+ 1320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:52.444808 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:52.452296 (+ 7488us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:36:52.452304 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:36:52.452308 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:36:52.452347 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:36:52.457805 (+ 5458us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:52.458714 (+ 909us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:52.459005 (+ 291us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:52.459009 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:52.459222 (+ 213us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:52.459838 (+ 616us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:52.459843 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:52.459847 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:52.460861 (+ 1014us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:36:52.460987 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:52.463325 (+ 2338us) server_negotiation.cc:299] Negotiation successful
0807 10:36:52.466762 (+ 3437us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260807 10:36:52.491664 28227 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:52.393767 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35382 (local address 127.20.171.124:42363)
0807 10:36:52.394075 (+ 308us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:52.394081 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:52.441439 (+ 47358us) server_negotiation.cc:407] Connection header received
0807 10:36:52.441656 (+ 217us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:52.441664 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:52.441766 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:52.441910 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:36:52.444587 (+ 2677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:52.446254 (+ 1667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:52.453405 (+ 7151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:52.454661 (+ 1256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:52.454771 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:52.464718 (+ 9947us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:36:52.464726 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:36:52.464733 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:36:52.464769 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:36:52.478393 (+ 13624us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:52.479372 (+ 979us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:52.479377 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:52.479380 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:52.479555 (+ 175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:52.480695 (+ 1140us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:52.480700 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:52.480703 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:52.481827 (+ 1124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:36:52.482396 (+ 569us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:52.484438 (+ 2042us) server_negotiation.cc:299] Negotiation successful
0807 10:36:52.490930 (+ 6492us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":6230,"server-negotiator.queue_time_us":92}
I20260807 10:36:52.492336 28251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:52.401424 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.124:42363 (local address 127.0.0.1:35382)
0807 10:36:52.441250 (+ 39826us) negotiation.cc:107] Waiting for socket to connect
0807 10:36:52.441299 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0807 10:36:52.441503 (+ 204us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:36:52.442178 (+ 675us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:36:52.442184 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:36:52.443493 (+ 1309us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:36:52.444429 (+ 936us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:52.444447 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:52.448917 (+ 4470us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:52.448924 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:52.451989 (+ 3065us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:52.452002 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:52.457963 (+ 5961us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:52.457974 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:52.458340 (+ 366us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:52.459232 (+ 892us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:36:52.459309 (+ 77us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:36:52.464450 (+ 5141us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:36:52.478606 (+ 14156us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:36:52.478610 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:36:52.478613 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:36:52.479182 (+ 569us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:36:52.479690 (+ 508us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:36:52.479694 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:36:52.479697 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:36:52.479871 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:36:52.481949 (+ 2078us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:36:52.481956 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:36:52.482512 (+ 556us) client_negotiation.cc:769] Sending connection context
0807 10:36:52.482808 (+ 296us) client_negotiation.cc:240] Negotiation successful
0807 10:36:52.490775 (+ 7967us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":39604,"thread_start_us":38921,"threads_started":1}
Aug 07 10:36:52 dist-test-slave-0b58 krb5kdc[27442](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099009, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.171.126@KRBTEST.COM for oryx/127.20.171.124@KRBTEST.COM
I20260807 10:36:52.502280 28255 sys_catalog.cc:455] T 00000000000000000000000000000000 P a3ba955fde1542b8a0187d9fd7a0052c [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "a3ba955fde1542b8a0187d9fd7a0052c" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "a3ba955fde1542b8a0187d9fd7a0052c" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 45569 } } peers { permanent_uuid: "9d9adcde3d254acda7f28fb66fbc417c" member_type: NON_VOTER last_known_addr { host: "127.20.171.125" port: 41963 } attrs { promote: true } } }
I20260807 10:36:52.502837 28255 sys_catalog.cc:458] T 00000000000000000000000000000000 P a3ba955fde1542b8a0187d9fd7a0052c [sys.catalog]: This master's current role is: LEADER
I20260807 10:36:52.506829 28256 raft_consensus.cc:1050] T 00000000000000000000000000000000 P a3ba955fde1542b8a0187d9fd7a0052c: attempting to promote NON_VOTER 9d9adcde3d254acda7f28fb66fbc417c to VOTER
I20260807 10:36:52.508899 28256 consensus_queue.cc:237] T 00000000000000000000000000000000 P a3ba955fde1542b8a0187d9fd7a0052c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "a3ba955fde1542b8a0187d9fd7a0052c" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 45569 } } peers { permanent_uuid: "9d9adcde3d254acda7f28fb66fbc417c" member_type: VOTER last_known_addr { host: "127.20.171.125" port: 41963 } attrs { promote: false } }
I20260807 10:36:52.512843 28115 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 9d9adcde3d254acda7f28fb66fbc417c [term 1 LEARNER]: Refusing update from remote peer a3ba955fde1542b8a0187d9fd7a0052c: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260807 10:36:52.513669 28255 consensus_queue.cc:1035] T 00000000000000000000000000000000 P a3ba955fde1542b8a0187d9fd7a0052c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d9adcde3d254acda7f28fb66fbc417c" member_type: VOTER last_known_addr { host: "127.20.171.125" port: 41963 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260807 10:36:52.517812 28253 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:52.466827 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.124:42363 (local address 127.0.0.1:35392)
0807 10:36:52.468013 (+ 1186us) negotiation.cc:107] Waiting for socket to connect
0807 10:36:52.468033 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0807 10:36:52.468307 (+ 274us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:36:52.478106 (+ 9799us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:36:52.478112 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:36:52.478925 (+ 813us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:36:52.479544 (+ 619us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:52.479561 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:52.483997 (+ 4436us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:52.484004 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:52.489816 (+ 5812us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:52.489831 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:52.495909 (+ 6078us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:52.495918 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:52.496217 (+ 299us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:52.497204 (+ 987us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:36:52.497227 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:36:52.500811 (+ 3584us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:36:52.514111 (+ 13300us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:36:52.514117 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:36:52.514122 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:36:52.514861 (+ 739us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:36:52.515403 (+ 542us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:36:52.515408 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:36:52.515412 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:36:52.515672 (+ 260us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:36:52.516557 (+ 885us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:36:52.516562 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:36:52.516777 (+ 215us) client_negotiation.cc:769] Sending connection context
0807 10:36:52.516903 (+ 126us) client_negotiation.cc:240] Negotiation successful
0807 10:36:52.517211 (+ 308us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1060,"thread_start_us":839,"threads_started":1}
I20260807 10:36:52.520195 28254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:52.467319 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35392 (local address 127.20.171.124:42363)
0807 10:36:52.477482 (+ 10163us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:52.477488 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:52.477546 (+ 58us) server_negotiation.cc:407] Connection header received
0807 10:36:52.477657 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:52.477664 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:52.477760 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:52.479691 (+ 1931us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:36:52.480410 (+ 719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:52.483844 (+ 3434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:52.489973 (+ 6129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:52.495617 (+ 5644us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:52.496741 (+ 1124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:52.501964 (+ 5223us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:36:52.501971 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:36:52.501976 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:36:52.502009 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:36:52.513836 (+ 11827us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:52.515016 (+ 1180us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:52.515025 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:52.515028 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:52.515277 (+ 249us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:52.515849 (+ 572us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:52.515856 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:52.515862 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:52.516431 (+ 569us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:36:52.518391 (+ 1960us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:52.518498 (+ 107us) server_negotiation.cc:299] Negotiation successful
0807 10:36:52.518729 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":9751,"thread_start_us":8112,"threads_started":1}
I20260807 10:36:52.521979 27487 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.20.171.124:42363: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "7cb70b70a1944a069f2e1ef2c66c7b19"
member_type: NON_VOTER
last_known_addr {
host: "127.20.171.124"
port: 42363
}
attrs {
promote: true
}
}
dest_uuid: "a3ba955fde1542b8a0187d9fd7a0052c"
cas_config_opid_index: 5
W20260807 10:36:52.522817 27487 master_service.cc:301] AddMaster 127.20.171.124:42363 failed with retriable error: Illegal state: Failed initiating master Raft ChangeConfig request, error: unknown: RaftConfig change currently pending. Only one is allowed at a time.
Committed config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "a3ba955fde1542b8a0187d9fd7a0052c" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 45569 } } peers { permanent_uuid: "9d9adcde3d254acda7f28fb66fbc417c" member_type: NON_VOTER last_known_addr { host: "127.20.171.125" port: 41963 } attrs { promote: true } }.
Pending config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "a3ba955fde1542b8a0187d9fd7a0052c" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 45569 } } peers { permanent_uuid: "9d9adcde3d254acda7f28fb66fbc417c" member_type: VOTER last_known_addr { host: "127.20.171.125" port: 41963 } attrs { promote: false } }
W20260807 10:36:52.524504 28244 master_proxy_rpc.cc:203] Re-attempting AddMaster request to leader Master (127.20.171.126:45569)
I20260807 10:36:52.529340 28231 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7cb70b70a1944a069f2e1ef2c66c7b19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 10:36:52.528934 28257 raft_consensus.cc:2932] T 00000000000000000000000000000000 P a3ba955fde1542b8a0187d9fd7a0052c [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 9d9adcde3d254acda7f28fb66fbc417c (127.20.171.125) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "a3ba955fde1542b8a0187d9fd7a0052c" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 45569 } } peers { permanent_uuid: "9d9adcde3d254acda7f28fb66fbc417c" member_type: VOTER last_known_addr { host: "127.20.171.125" port: 41963 } attrs { promote: false } } }
I20260807 10:36:52.529846 28231 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7cb70b70a1944a069f2e1ef2c66c7b19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ba955fde1542b8a0187d9fd7a0052c" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 45569 } } peers { permanent_uuid: "9d9adcde3d254acda7f28fb66fbc417c" member_type: VOTER last_known_addr { host: "127.20.171.125" port: 41963 } } peers { permanent_uuid: "7cb70b70a1944a069f2e1ef2c66c7b19" member_type: VOTER last_known_addr { host: "127.20.171.124" port: 42363 } }
I20260807 10:36:52.530938 28115 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 9d9adcde3d254acda7f28fb66fbc417c [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 9d9adcde3d254acda7f28fb66fbc417c (127.20.171.125) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "a3ba955fde1542b8a0187d9fd7a0052c" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 45569 } } peers { permanent_uuid: "9d9adcde3d254acda7f28fb66fbc417c" member_type: VOTER last_known_addr { host: "127.20.171.125" port: 41963 } attrs { promote: false } } }
I20260807 10:36:52.532177 28231 leader_election.cc:288] T 00000000000000000000000000000000 P 7cb70b70a1944a069f2e1ef2c66c7b19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3ba955fde1542b8a0187d9fd7a0052c (127.20.171.126:45569), 9d9adcde3d254acda7f28fb66fbc417c (127.20.171.125:41963)
I20260807 10:36:52.532972 27497 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7cb70b70a1944a069f2e1ef2c66c7b19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ba955fde1542b8a0187d9fd7a0052c" is_pre_election: true
I20260807 10:36:52.533505 28114 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7cb70b70a1944a069f2e1ef2c66c7b19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d9adcde3d254acda7f28fb66fbc417c" is_pre_election: true
I20260807 10:36:52.535033 28172 leader_election.cc:302] T 00000000000000000000000000000000 P 7cb70b70a1944a069f2e1ef2c66c7b19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cb70b70a1944a069f2e1ef2c66c7b19; no voters: 9d9adcde3d254acda7f28fb66fbc417c, a3ba955fde1542b8a0187d9fd7a0052c
I20260807 10:36:52.535905 28231 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 7cb70b70a1944a069f2e1ef2c66c7b19 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 10:36:52.536412 28258 sys_catalog.cc:455] T 00000000000000000000000000000000 P a3ba955fde1542b8a0187d9fd7a0052c [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "a3ba955fde1542b8a0187d9fd7a0052c" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "a3ba955fde1542b8a0187d9fd7a0052c" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 45569 } } peers { permanent_uuid: "9d9adcde3d254acda7f28fb66fbc417c" member_type: VOTER last_known_addr { host: "127.20.171.125" port: 41963 } attrs { promote: false } } }
I20260807 10:36:52.537139 28258 sys_catalog.cc:458] T 00000000000000000000000000000000 P a3ba955fde1542b8a0187d9fd7a0052c [sys.catalog]: This master's current role is: LEADER
I20260807 10:36:52.541787 27487 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.20.171.124:42363: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "7cb70b70a1944a069f2e1ef2c66c7b19"
member_type: NON_VOTER
last_known_addr {
host: "127.20.171.124"
port: 42363
}
attrs {
promote: true
}
}
dest_uuid: "a3ba955fde1542b8a0187d9fd7a0052c"
cas_config_opid_index: 6
I20260807 10:36:52.542784 27487 consensus_queue.cc:237] T 00000000000000000000000000000000 P a3ba955fde1542b8a0187d9fd7a0052c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "a3ba955fde1542b8a0187d9fd7a0052c" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 45569 } } peers { permanent_uuid: "9d9adcde3d254acda7f28fb66fbc417c" member_type: VOTER last_known_addr { host: "127.20.171.125" port: 41963 } attrs { promote: false } } peers { permanent_uuid: "7cb70b70a1944a069f2e1ef2c66c7b19" member_type: NON_VOTER last_known_addr { host: "127.20.171.124" port: 42363 } attrs { promote: true } }
I20260807 10:36:52.547258 28198 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7cb70b70a1944a069f2e1ef2c66c7b19 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:36:52.549562 28261 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9d9adcde3d254acda7f28fb66fbc417c [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "a3ba955fde1542b8a0187d9fd7a0052c" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "a3ba955fde1542b8a0187d9fd7a0052c" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 45569 } } peers { permanent_uuid: "9d9adcde3d254acda7f28fb66fbc417c" member_type: VOTER last_known_addr { host: "127.20.171.125" port: 41963 } attrs { promote: false } } }
I20260807 10:36:52.550241 28261 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9d9adcde3d254acda7f28fb66fbc417c [sys.catalog]: This master's current role is: FOLLOWER
I20260807 10:36:52.551822 28115 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 9d9adcde3d254acda7f28fb66fbc417c [term 1 FOLLOWER]: Refusing update from remote peer a3ba955fde1542b8a0187d9fd7a0052c: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260807 10:36:52.552711 28255 consensus_queue.cc:1035] T 00000000000000000000000000000000 P a3ba955fde1542b8a0187d9fd7a0052c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d9adcde3d254acda7f28fb66fbc417c" member_type: VOTER last_known_addr { host: "127.20.171.125" port: 41963 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260807 10:36:52.553314 28198 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 7cb70b70a1944a069f2e1ef2c66c7b19 [term 1 FOLLOWER]: Refusing update from remote peer a3ba955fde1542b8a0187d9fd7a0052c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260807 10:36:52.553488 28255 sys_catalog.cc:455] T 00000000000000000000000000000000 P a3ba955fde1542b8a0187d9fd7a0052c [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "a3ba955fde1542b8a0187d9fd7a0052c" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "a3ba955fde1542b8a0187d9fd7a0052c" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 45569 } } peers { permanent_uuid: "9d9adcde3d254acda7f28fb66fbc417c" member_type: VOTER last_known_addr { host: "127.20.171.125" port: 41963 } attrs { promote: false } } } pending_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "a3ba955fde1542b8a0187d9fd7a0052c" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 45569 } } peers { permanent_uuid: "9d9adcde3d254acda7f28fb66fbc417c" member_type: VOTER last_known_addr { host: "127.20.171.125" port: 41963 } attrs { promote: false } } peers { permanent_uuid: "7cb70b70a1944a069f2e1ef2c66c7b19" member_type: NON_VOTER last_known_addr { host: "127.20.171.124" port: 42363 } attrs { promote: true } } }
I20260807 10:36:52.554064 28255 sys_catalog.cc:458] T 00000000000000000000000000000000 P a3ba955fde1542b8a0187d9fd7a0052c [sys.catalog]: This master's current role is: LEADER
I20260807 10:36:52.554384 28258 consensus_queue.cc:1035] T 00000000000000000000000000000000 P a3ba955fde1542b8a0187d9fd7a0052c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cb70b70a1944a069f2e1ef2c66c7b19" member_type: NON_VOTER last_known_addr { host: "127.20.171.124" port: 42363 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 10:36:52.557000 28255 raft_consensus.cc:2932] T 00000000000000000000000000000000 P a3ba955fde1542b8a0187d9fd7a0052c [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, NON_VOTER 7cb70b70a1944a069f2e1ef2c66c7b19 (127.20.171.124) added. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "a3ba955fde1542b8a0187d9fd7a0052c" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 45569 } } peers { permanent_uuid: "9d9adcde3d254acda7f28fb66fbc417c" member_type: VOTER last_known_addr { host: "127.20.171.125" port: 41963 } attrs { promote: false } } peers { permanent_uuid: "7cb70b70a1944a069f2e1ef2c66c7b19" member_type: NON_VOTER last_known_addr { host: "127.20.171.124" port: 42363 } attrs { promote: true } } }
I20260807 10:36:52.562216 28114 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 9d9adcde3d254acda7f28fb66fbc417c [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, NON_VOTER 7cb70b70a1944a069f2e1ef2c66c7b19 (127.20.171.124) added. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "a3ba955fde1542b8a0187d9fd7a0052c" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 45569 } } peers { permanent_uuid: "9d9adcde3d254acda7f28fb66fbc417c" member_type: VOTER last_known_addr { host: "127.20.171.125" port: 41963 } attrs { promote: false } } peers { permanent_uuid: "7cb70b70a1944a069f2e1ef2c66c7b19" member_type: NON_VOTER last_known_addr { host: "127.20.171.124" port: 42363 } attrs { promote: true } } }
I20260807 10:36:52.563163 28255 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.20.171.124:42363
I20260807 10:36:52.563889 28255 sys_catalog.cc:455] T 00000000000000000000000000000000 P a3ba955fde1542b8a0187d9fd7a0052c [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "a3ba955fde1542b8a0187d9fd7a0052c" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "a3ba955fde1542b8a0187d9fd7a0052c" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 45569 } } peers { permanent_uuid: "9d9adcde3d254acda7f28fb66fbc417c" member_type: VOTER last_known_addr { host: "127.20.171.125" port: 41963 } attrs { promote: false } } peers { permanent_uuid: "7cb70b70a1944a069f2e1ef2c66c7b19" member_type: NON_VOTER last_known_addr { host: "127.20.171.124" port: 42363 } attrs { promote: true } } }
I20260807 10:36:52.564193 28068 master.cc:537] Master@127.20.171.124:42363 shutting down...
I20260807 10:36:52.564360 28255 sys_catalog.cc:458] T 00000000000000000000000000000000 P a3ba955fde1542b8a0187d9fd7a0052c [sys.catalog]: This master's current role is: LEADER
I20260807 10:36:52.564769 28255 sys_catalog.cc:455] T 00000000000000000000000000000000 P a3ba955fde1542b8a0187d9fd7a0052c [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "a3ba955fde1542b8a0187d9fd7a0052c" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "a3ba955fde1542b8a0187d9fd7a0052c" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 45569 } } peers { permanent_uuid: "9d9adcde3d254acda7f28fb66fbc417c" member_type: VOTER last_known_addr { host: "127.20.171.125" port: 41963 } attrs { promote: false } } peers { permanent_uuid: "7cb70b70a1944a069f2e1ef2c66c7b19" member_type: NON_VOTER last_known_addr { host: "127.20.171.124" port: 42363 } attrs { promote: true } } }
I20260807 10:36:52.565325 28255 sys_catalog.cc:458] T 00000000000000000000000000000000 P a3ba955fde1542b8a0187d9fd7a0052c [sys.catalog]: This master's current role is: LEADER
I20260807 10:36:52.568077 28261 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9d9adcde3d254acda7f28fb66fbc417c [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "a3ba955fde1542b8a0187d9fd7a0052c" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "a3ba955fde1542b8a0187d9fd7a0052c" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 45569 } } peers { permanent_uuid: "9d9adcde3d254acda7f28fb66fbc417c" member_type: VOTER last_known_addr { host: "127.20.171.125" port: 41963 } attrs { promote: false } } peers { permanent_uuid: "7cb70b70a1944a069f2e1ef2c66c7b19" member_type: NON_VOTER last_known_addr { host: "127.20.171.124" port: 42363 } attrs { promote: true } } }
I20260807 10:36:52.568498 28261 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9d9adcde3d254acda7f28fb66fbc417c [sys.catalog]: This master's current role is: FOLLOWER
I20260807 10:36:52.581674 28198 raft_consensus.cc:858] T 00000000000000000000000000000000 P 7cb70b70a1944a069f2e1ef2c66c7b19 [term 1 NON_PARTICIPANT]: Illegal state: RaftConfig change currently pending. Only one is allowed at a time.
Committed config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ba955fde1542b8a0187d9fd7a0052c" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 45569 } } peers { permanent_uuid: "9d9adcde3d254acda7f28fb66fbc417c" member_type: VOTER last_known_addr { host: "127.20.171.125" port: 41963 } } peers { permanent_uuid: "7cb70b70a1944a069f2e1ef2c66c7b19" member_type: VOTER last_known_addr { host: "127.20.171.124" port: 42363 } }.
Pending config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "a3ba955fde1542b8a0187d9fd7a0052c" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 45569 } } peers { permanent_uuid: "9d9adcde3d254acda7f28fb66fbc417c" member_type: NON_VOTER last_known_addr { host: "127.20.171.125" port: 41963 } attrs { promote: true } }:
New config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "a3ba955fde1542b8a0187d9fd7a0052c" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 45569 } } peers { permanent_uuid: "9d9adcde3d254acda7f28fb66fbc417c" member_type: VOTER last_known_addr { host: "127.20.171.125" port: 41963 } attrs { promote: false } }
W20260807 10:36:52.581969 28198 raft_consensus.cc:1565] T 00000000000000000000000000000000 P 7cb70b70a1944a069f2e1ef2c66c7b19 [term 1 NON_PARTICIPANT]: Could not prepare op 'term: 1 index: 6' and following 1 ops. Status for this op: Illegal state: RaftConfig change currently pending. Only one is allowed at a time.
Committed config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ba955fde1542b8a0187d9fd7a0052c" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 45569 } } peers { permanent_uuid: "9d9adcde3d254acda7f28fb66fbc417c" member_type: VOTER last_known_addr { host: "127.20.171.125" port: 41963 } } peers { permanent_uuid: "7cb70b70a1944a069f2e1ef2c66c7b19" member_type: VOTER last_known_addr { host: "127.20.171.124" port: 42363 } }.
Pending config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "a3ba955fde1542b8a0187d9fd7a0052c" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 45569 } } peers { permanent_uuid: "9d9adcde3d254acda7f28fb66fbc417c" member_type: NON_VOTER last_known_addr { host: "127.20.171.125" port: 41963 } attrs { promote: true } }:
New config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "a3ba955fde1542b8a0187d9fd7a0052c" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 45569 } } peers { permanent_uuid: "9d9adcde3d254acda7f28fb66fbc417c" member_type: VOTER last_known_addr { host: "127.20.171.125" port: 41963 } attrs { promote: false } }
I20260807 10:36:52.607443 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 27551
I20260807 10:36:52.614203 28198 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 7cb70b70a1944a069f2e1ef2c66c7b19 [term 1 NON_PARTICIPANT]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER 9d9adcde3d254acda7f28fb66fbc417c (127.20.171.125) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "a3ba955fde1542b8a0187d9fd7a0052c" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 45569 } } peers { permanent_uuid: "9d9adcde3d254acda7f28fb66fbc417c" member_type: NON_VOTER last_known_addr { host: "127.20.171.125" port: 41963 } attrs { promote: true } } }
I20260807 10:36:52.619490 28267 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7cb70b70a1944a069f2e1ef2c66c7b19 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "a3ba955fde1542b8a0187d9fd7a0052c" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "a3ba955fde1542b8a0187d9fd7a0052c" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 45569 } } peers { permanent_uuid: "9d9adcde3d254acda7f28fb66fbc417c" member_type: NON_VOTER last_known_addr { host: "127.20.171.125" port: 41963 } attrs { promote: true } } }
I20260807 10:36:52.620137 28267 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7cb70b70a1944a069f2e1ef2c66c7b19 [sys.catalog]: This master's current role is: NON_PARTICIPANT
I20260807 10:36:52.620677 28231 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7cb70b70a1944a069f2e1ef2c66c7b19 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a3ba955fde1542b8a0187d9fd7a0052c. Latest consensus state: current_term: 1 leader_uuid: "a3ba955fde1542b8a0187d9fd7a0052c" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "a3ba955fde1542b8a0187d9fd7a0052c" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 45569 } } peers { permanent_uuid: "9d9adcde3d254acda7f28fb66fbc417c" member_type: NON_VOTER last_known_addr { host: "127.20.171.125" port: 41963 } attrs { promote: true } } }
I20260807 10:36:52.620936 28231 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7cb70b70a1944a069f2e1ef2c66c7b19 [sys.catalog]: This master's current role is: NON_PARTICIPANT
I20260807 10:36:52.620746 28264 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7cb70b70a1944a069f2e1ef2c66c7b19 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "a3ba955fde1542b8a0187d9fd7a0052c" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "a3ba955fde1542b8a0187d9fd7a0052c" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 45569 } } peers { permanent_uuid: "9d9adcde3d254acda7f28fb66fbc417c" member_type: NON_VOTER last_known_addr { host: "127.20.171.125" port: 41963 } attrs { promote: true } } }
I20260807 10:36:52.621184 28264 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7cb70b70a1944a069f2e1ef2c66c7b19 [sys.catalog]: This master's current role is: NON_PARTICIPANT
I20260807 10:36:52.621157 28255 sys_catalog.cc:455] T 00000000000000000000000000000000 P a3ba955fde1542b8a0187d9fd7a0052c [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "a3ba955fde1542b8a0187d9fd7a0052c" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "a3ba955fde1542b8a0187d9fd7a0052c" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 45569 } } peers { permanent_uuid: "9d9adcde3d254acda7f28fb66fbc417c" member_type: VOTER last_known_addr { host: "127.20.171.125" port: 41963 } attrs { promote: false } } peers { permanent_uuid: "7cb70b70a1944a069f2e1ef2c66c7b19" member_type: NON_VOTER last_known_addr { host: "127.20.171.124" port: 42363 } attrs { promote: true } } }
I20260807 10:36:52.621488 28255 sys_catalog.cc:458] T 00000000000000000000000000000000 P a3ba955fde1542b8a0187d9fd7a0052c [sys.catalog]: This master's current role is: LEADER
I20260807 10:36:52.623391 28068 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 7cb70b70a1944a069f2e1ef2c66c7b19 [term 1 NON_PARTICIPANT]: Raft consensus shutting down.
I20260807 10:36:52.623898 28068 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 7cb70b70a1944a069f2e1ef2c66c7b19 [term 1 NON_PARTICIPANT]: Raft consensus is shut down!
I20260807 10:36:52.624084 28068 tablet_replica.cc:330] T 00000000000000000000000000000000 P 7cb70b70a1944a069f2e1ef2c66c7b19: stopping tablet replica
W20260807 10:36:52.628010 28173 connection.cc:441] server connection from 127.0.0.1:35392 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35392 (request call id 5) could send its response
W20260807 10:36:52.628922 27473 consensus_peers.cc:487] T 00000000000000000000000000000000 P a3ba955fde1542b8a0187d9fd7a0052c -> Peer 7cb70b70a1944a069f2e1ef2c66c7b19 (127.20.171.124:42363): Couldn't send request to peer 7cb70b70a1944a069f2e1ef2c66c7b19. Status: Network error: recv got EOF from 127.20.171.124:42363 (error 108). This is attempt 1: this message will repeat every 5th retry.
I20260807 10:36:52.636811 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.171.65:42425
--local_ip_for_outbound_sockets=127.20.171.65
--tserver_master_addrs=127.20.171.126:45569
--webserver_port=33641
--webserver_interface=127.20.171.65
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/krb5kdc/oryx_127.20.171.65.keytab
--principal=oryx/127.20.171.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.171.84:36279
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.20.171.126:45569,127.20.171.125:41963
--tserver_master_addrs=127.20.171.126:45569,127.20.171.125:41963,127.20.171.124:42363 with env {KRB5CCNAME=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 10:36:52.642318 28068 master.cc:552] Master@127.20.171.124:42363 shutdown complete.
I20260807 10:36:52.642418 28068 master_runner.cc:305] Clearing existing system tablet
I20260807 10:36:52.642746 28068 fs_manager.cc:359] Metadata directory not provided
I20260807 10:36:52.642853 28068 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:36:52.645133 28068 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.000s sys 0.003s
I20260807 10:36:52.646588 28270 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:36:52.647038 28068 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:36:52.647343 28068 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.001s
I20260807 10:36:52.647447 28068 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/master-2/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/master-2/wal
uuid: "7cb70b70a1944a069f2e1ef2c66c7b19"
format_stamp: "Formatted at 2026-08-07 10:36:52 on dist-test-slave-0b58"
server_key: "8f009aed73d5526b959835c75151a690"
server_key_iv: "474f5dd20b38da57e9579151f2fcbe6d"
server_key_version: "encryptionkey@0"
I20260807 10:36:52.650776 28068 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 7cb70b70a1944a069f2e1ef2c66c7b19: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 10:36:52.655275 28068 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 7cb70b70a1944a069f2e1ef2c66c7b19: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260807 10:36:52.655437 28068 log.cc:1196] T 00000000000000000000000000000000 P 7cb70b70a1944a069f2e1ef2c66c7b19: Deleting WAL directory at /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260807 10:36:52.655920 28068 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 7cb70b70a1944a069f2e1ef2c66c7b19: Deleting consensus metadata
I20260807 10:36:52.656141 28068 master_runner.cc:315] Copying system tablet from 127.20.171.126:45569
I20260807 10:36:52.658715 28068 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 7cb70b70a1944a069f2e1ef2c66c7b19: tablet copy: Beginning tablet copy session from remote peer at address 127.20.171.126:45569
I20260807 10:36:52.671514 28277 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:52.659452 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:45569 (local address 127.0.0.1:37362)
0807 10:36:52.660081 (+ 629us) negotiation.cc:107] Waiting for socket to connect
0807 10:36:52.660098 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 10:36:52.660273 (+ 175us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:36:52.660645 (+ 372us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:36:52.660649 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:36:52.661124 (+ 475us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:36:52.661304 (+ 180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:52.661312 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:52.662329 (+ 1017us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:52.662336 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:52.663283 (+ 947us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:52.663294 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:52.664034 (+ 740us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:52.664045 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:52.664316 (+ 271us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:52.664952 (+ 636us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:36:52.664970 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:36:52.665838 (+ 868us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:36:52.669063 (+ 3225us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:36:52.669069 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:36:52.669073 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:36:52.669407 (+ 334us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:36:52.669774 (+ 367us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:36:52.669779 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:36:52.669782 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:36:52.669916 (+ 134us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:36:52.670465 (+ 549us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:36:52.670469 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:36:52.670638 (+ 169us) client_negotiation.cc:769] Sending connection context
0807 10:36:52.670775 (+ 137us) client_negotiation.cc:240] Negotiation successful
0807 10:36:52.671065 (+ 290us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":521,"thread_start_us":400,"threads_started":1}
I20260807 10:36:52.671507 28229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:52.659470 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37362 (local address 127.20.171.126:45569)
0807 10:36:52.659720 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:52.659728 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:52.660186 (+ 458us) server_negotiation.cc:407] Connection header received
0807 10:36:52.660441 (+ 255us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:52.660445 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:52.660519 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:52.660619 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:36:52.661443 (+ 824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:52.662204 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:52.663421 (+ 1217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:52.663887 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:52.664020 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:52.666011 (+ 1991us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:36:52.666019 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:36:52.666023 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:36:52.666064 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:36:52.668939 (+ 2875us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:52.669525 (+ 586us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:52.669532 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:52.669539 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:52.669657 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:52.670021 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:52.670026 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:52.670029 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:52.670351 (+ 322us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:36:52.670496 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:52.670873 (+ 377us) server_negotiation.cc:299] Negotiation successful
0807 10:36:52.671189 (+ 316us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":104}
I20260807 10:36:52.672794 27508 tablet_copy_service.cc:140] P a3ba955fde1542b8a0187d9fd7a0052c: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 7cb70b70a1944a069f2e1ef2c66c7b19 ({username='oryx', principal='oryx/127.20.171.124@KRBTEST.COM'} at 127.0.0.1:37362)
I20260807 10:36:52.672967 27508 tablet_copy_service.cc:161] P a3ba955fde1542b8a0187d9fd7a0052c: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 7cb70b70a1944a069f2e1ef2c66c7b19 at {username='oryx', principal='oryx/127.20.171.124@KRBTEST.COM'} at 127.0.0.1:37362: session id = 7cb70b70a1944a069f2e1ef2c66c7b19-00000000000000000000000000000000
I20260807 10:36:52.675333 27508 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P a3ba955fde1542b8a0187d9fd7a0052c: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 10:36:52.677022 28068 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260807 10:36:52.681440 28068 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 7cb70b70a1944a069f2e1ef2c66c7b19: tablet copy: Starting download of 0 data blocks...
I20260807 10:36:52.681722 28068 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 7cb70b70a1944a069f2e1ef2c66c7b19: tablet copy: Starting download of 1 WAL segments...
I20260807 10:36:52.683823 28068 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 7cb70b70a1944a069f2e1ef2c66c7b19: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 10:36:52.686931 27508 tablet_copy_service.cc:342] P a3ba955fde1542b8a0187d9fd7a0052c: Request end of tablet copy session 7cb70b70a1944a069f2e1ef2c66c7b19-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.20.171.124@KRBTEST.COM'} at 127.0.0.1:37362
I20260807 10:36:52.687062 27508 tablet_copy_service.cc:433] P a3ba955fde1542b8a0187d9fd7a0052c: ending tablet copy session 7cb70b70a1944a069f2e1ef2c66c7b19-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 7cb70b70a1944a069f2e1ef2c66c7b19
I20260807 10:36:52.697062 28068 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:36:52.699617 28278 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:36:52.705839 28279 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:36:52.710125 28282 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:36:52.713161 28068 server_base.cc:1034] running on GCE node
I20260807 10:36:52.713521 28068 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:36:52.714257 28068 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:36:52.715445 28068 hybrid_clock.cc:648] HybridClock initialized: now 1786099012715409 us; error 35 us; skew 500 ppm
I20260807 10:36:52.715662 28068 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:36:52 dist-test-slave-0b58 krb5kdc[27442](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099012, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.171.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:36:52.717723 28068 init.cc:377] Logged in from keytab as oryx/127.20.171.124@KRBTEST.COM (short username oryx)
I20260807 10:36:52.722841 28068 webserver.cc:460] Webserver started at http://127.20.171.124:42613/ using document root <none> and password file <none>
I20260807 10:36:52.723133 28068 fs_manager.cc:359] Metadata directory not provided
I20260807 10:36:52.723253 28068 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:36:52.725760 28068 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.000s
I20260807 10:36:52.733681 28289 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:36:52.734107 28068 fs_manager.cc:725] Time spent opening block manager: real 0.007s user 0.007s sys 0.000s
I20260807 10:36:52.734251 28068 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/master-2/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/master-2/wal
uuid: "7cb70b70a1944a069f2e1ef2c66c7b19"
format_stamp: "Formatted at 2026-08-07 10:36:52 on dist-test-slave-0b58"
server_key: "8f009aed73d5526b959835c75151a690"
server_key_iv: "474f5dd20b38da57e9579151f2fcbe6d"
server_key_version: "encryptionkey@0"
I20260807 10:36:52.734467 28068 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:36:52.770316 28068 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:36:52.773936 28068 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:36:52.808599 28068 rpc_server.cc:307] RPC server started. Bound to: 127.20.171.124:42363
I20260807 10:36:52.808624 28342 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.171.124:42363 every 8 connection(s)
I20260807 10:36:52.809921 28068 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/master-2/data/info.pb
I20260807 10:36:52.815064 28343 sys_catalog.cc:263] Verifying existing consensus state
I20260807 10:36:52.818902 28343 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7cb70b70a1944a069f2e1ef2c66c7b19: Bootstrap starting.
I20260807 10:36:52.840978 28343 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7cb70b70a1944a069f2e1ef2c66c7b19: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 10:36:52.841619 28343 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7cb70b70a1944a069f2e1ef2c66c7b19: Bootstrap complete.
I20260807 10:36:52.842847 28343 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7cb70b70a1944a069f2e1ef2c66c7b19 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "a3ba955fde1542b8a0187d9fd7a0052c" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 45569 } } peers { permanent_uuid: "9d9adcde3d254acda7f28fb66fbc417c" member_type: VOTER last_known_addr { host: "127.20.171.125" port: 41963 } attrs { promote: false } } peers { permanent_uuid: "7cb70b70a1944a069f2e1ef2c66c7b19" member_type: NON_VOTER last_known_addr { host: "127.20.171.124" port: 42363 } attrs { promote: true } }
I20260807 10:36:52.843155 28343 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7cb70b70a1944a069f2e1ef2c66c7b19 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 7cb70b70a1944a069f2e1ef2c66c7b19, State: Initialized, Role: LEARNER
I20260807 10:36:52.843425 28343 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7cb70b70a1944a069f2e1ef2c66c7b19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "a3ba955fde1542b8a0187d9fd7a0052c" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 45569 } } peers { permanent_uuid: "9d9adcde3d254acda7f28fb66fbc417c" member_type: VOTER last_known_addr { host: "127.20.171.125" port: 41963 } attrs { promote: false } } peers { permanent_uuid: "7cb70b70a1944a069f2e1ef2c66c7b19" member_type: NON_VOTER last_known_addr { host: "127.20.171.124" port: 42363 } attrs { promote: true } }
I20260807 10:36:52.844626 28343 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7cb70b70a1944a069f2e1ef2c66c7b19 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 10:36:52.844337 28346 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7cb70b70a1944a069f2e1ef2c66c7b19 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "a3ba955fde1542b8a0187d9fd7a0052c" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 45569 } } peers { permanent_uuid: "9d9adcde3d254acda7f28fb66fbc417c" member_type: VOTER last_known_addr { host: "127.20.171.125" port: 41963 } attrs { promote: false } } peers { permanent_uuid: "7cb70b70a1944a069f2e1ef2c66c7b19" member_type: NON_VOTER last_known_addr { host: "127.20.171.124" port: 42363 } attrs { promote: true } } }
I20260807 10:36:52.844897 28346 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7cb70b70a1944a069f2e1ef2c66c7b19 [sys.catalog]: This master's current role is: LEARNER
I20260807 10:36:52.853081 28357 catalog_manager.cc:1259] Loaded cluster ID: 7b9a4b9fc4a3418fa3f99e0b86b93379
I20260807 10:36:52.853192 28357 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 7cb70b70a1944a069f2e1ef2c66c7b19: loading cluster ID for follower catalog manager: success
I20260807 10:36:52.856694 28357 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 7cb70b70a1944a069f2e1ef2c66c7b19: acquiring CA information for follower catalog manager: success
I20260807 10:36:52.859226 28357 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 7cb70b70a1944a069f2e1ef2c66c7b19: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260807 10:36:53.141722 28271 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:36:53.142124 28271 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:36:53.142302 28271 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:36:53.153133 28271 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:36:53.153339 28271 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:36:53.153568 28271 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.171.65
I20260807 10:36:53.167181 28271 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.171.84:36279
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/krb5kdc/oryx_127.20.171.65.keytab
--principal=oryx/127.20.171.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.171.65:42425
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.171.65
--webserver_port=33641
--tserver_master_addrs=127.20.171.126:45569,127.20.171.125:41963,127.20.171.124:42363
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.171.65
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:36:53.168911 28271 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:36:53.170629 28271 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 10:36:53.173853 28255 sys_catalog.cc:455] T 00000000000000000000000000000000 P a3ba955fde1542b8a0187d9fd7a0052c [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "a3ba955fde1542b8a0187d9fd7a0052c" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "a3ba955fde1542b8a0187d9fd7a0052c" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 45569 } } peers { permanent_uuid: "9d9adcde3d254acda7f28fb66fbc417c" member_type: VOTER last_known_addr { host: "127.20.171.125" port: 41963 } attrs { promote: false } } peers { permanent_uuid: "7cb70b70a1944a069f2e1ef2c66c7b19" member_type: NON_VOTER last_known_addr { host: "127.20.171.124" port: 42363 } attrs { promote: true } } }
I20260807 10:36:53.174191 28255 sys_catalog.cc:458] T 00000000000000000000000000000000 P a3ba955fde1542b8a0187d9fd7a0052c [sys.catalog]: This master's current role is: LEADER
I20260807 10:36:53.194885 28363 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:53.174094 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.124:42363 (local address 127.0.0.1:35396)
0807 10:36:53.185959 (+ 11865us) negotiation.cc:107] Waiting for socket to connect
0807 10:36:53.185982 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0807 10:36:53.186235 (+ 253us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:36:53.186833 (+ 598us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:36:53.186839 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:36:53.186873 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:36:53.187076 (+ 203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:53.187092 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:53.190125 (+ 3033us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:53.190136 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:53.191652 (+ 1516us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:53.191666 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:53.194043 (+ 2377us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:53.194048 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:53.194299 (+ 251us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:53.194326 (+ 27us) client_negotiation.cc:769] Sending connection context
0807 10:36:53.194399 (+ 73us) client_negotiation.cc:240] Negotiation successful
0807 10:36:53.194505 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11735,"thread_start_us":11679,"threads_started":1}
I20260807 10:36:53.195487 28365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:53.174209 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35396 (local address 127.20.171.124:42363)
0807 10:36:53.185846 (+ 11637us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:53.185852 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:53.186160 (+ 308us) server_negotiation.cc:407] Connection header received
0807 10:36:53.186447 (+ 287us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:53.186455 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:53.186634 (+ 179us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:53.186804 (+ 170us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:36:53.187344 (+ 540us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:53.189770 (+ 2426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:53.191815 (+ 2045us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:53.193778 (+ 1963us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:53.194198 (+ 420us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:53.194411 (+ 213us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:53.194467 (+ 56us) server_negotiation.cc:299] Negotiation successful
0807 10:36:53.194759 (+ 292us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11426,"thread_start_us":11307,"threads_started":1}
I20260807 10:36:53.196846 28317 raft_consensus.cc:1203] T 00000000000000000000000000000000 P 7cb70b70a1944a069f2e1ef2c66c7b19 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.5->[1.6-1.7] Dedup: 1.7->[]
I20260807 10:36:53.197359 28346 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7cb70b70a1944a069f2e1ef2c66c7b19 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a3ba955fde1542b8a0187d9fd7a0052c. Latest consensus state: current_term: 1 leader_uuid: "a3ba955fde1542b8a0187d9fd7a0052c" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "a3ba955fde1542b8a0187d9fd7a0052c" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 45569 } } peers { permanent_uuid: "9d9adcde3d254acda7f28fb66fbc417c" member_type: VOTER last_known_addr { host: "127.20.171.125" port: 41963 } attrs { promote: false } } peers { permanent_uuid: "7cb70b70a1944a069f2e1ef2c66c7b19" member_type: NON_VOTER last_known_addr { host: "127.20.171.124" port: 42363 } attrs { promote: true } } }
I20260807 10:36:53.197726 28346 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7cb70b70a1944a069f2e1ef2c66c7b19 [sys.catalog]: This master's current role is: LEARNER
I20260807 10:36:53.199059 28361 raft_consensus.cc:1050] T 00000000000000000000000000000000 P a3ba955fde1542b8a0187d9fd7a0052c: attempting to promote NON_VOTER 7cb70b70a1944a069f2e1ef2c66c7b19 to VOTER
I20260807 10:36:53.200333 28361 consensus_queue.cc:237] T 00000000000000000000000000000000 P a3ba955fde1542b8a0187d9fd7a0052c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "a3ba955fde1542b8a0187d9fd7a0052c" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 45569 } } peers { permanent_uuid: "9d9adcde3d254acda7f28fb66fbc417c" member_type: VOTER last_known_addr { host: "127.20.171.125" port: 41963 } attrs { promote: false } } peers { permanent_uuid: "7cb70b70a1944a069f2e1ef2c66c7b19" member_type: VOTER last_known_addr { host: "127.20.171.124" port: 42363 } attrs { promote: false } }
W20260807 10:36:53.203406 28368 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:36:53.204051 28114 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 9d9adcde3d254acda7f28fb66fbc417c [term 1 FOLLOWER]: Refusing update from remote peer a3ba955fde1542b8a0187d9fd7a0052c: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260807 10:36:53.204077 28317 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 7cb70b70a1944a069f2e1ef2c66c7b19 [term 1 LEARNER]: Refusing update from remote peer a3ba955fde1542b8a0187d9fd7a0052c: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260807 10:36:53.204962 28255 consensus_queue.cc:1035] T 00000000000000000000000000000000 P a3ba955fde1542b8a0187d9fd7a0052c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d9adcde3d254acda7f28fb66fbc417c" member_type: VOTER last_known_addr { host: "127.20.171.125" port: 41963 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260807 10:36:53.205415 28367 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:36:53.205417 28361 consensus_queue.cc:1035] T 00000000000000000000000000000000 P a3ba955fde1542b8a0187d9fd7a0052c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cb70b70a1944a069f2e1ef2c66c7b19" member_type: VOTER last_known_addr { host: "127.20.171.124" port: 42363 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260807 10:36:53.203760 28370 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:36:53.208952 28271 server_base.cc:1034] running on GCE node
I20260807 10:36:53.208639 28361 raft_consensus.cc:2932] T 00000000000000000000000000000000 P a3ba955fde1542b8a0187d9fd7a0052c [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 7cb70b70a1944a069f2e1ef2c66c7b19 (127.20.171.124) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "a3ba955fde1542b8a0187d9fd7a0052c" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 45569 } } peers { permanent_uuid: "9d9adcde3d254acda7f28fb66fbc417c" member_type: VOTER last_known_addr { host: "127.20.171.125" port: 41963 } attrs { promote: false } } peers { permanent_uuid: "7cb70b70a1944a069f2e1ef2c66c7b19" member_type: VOTER last_known_addr { host: "127.20.171.124" port: 42363 } attrs { promote: false } } }
I20260807 10:36:53.210217 28271 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:36:53.210121 28114 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 9d9adcde3d254acda7f28fb66fbc417c [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 7cb70b70a1944a069f2e1ef2c66c7b19 (127.20.171.124) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "a3ba955fde1542b8a0187d9fd7a0052c" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 45569 } } peers { permanent_uuid: "9d9adcde3d254acda7f28fb66fbc417c" member_type: VOTER last_known_addr { host: "127.20.171.125" port: 41963 } attrs { promote: false } } peers { permanent_uuid: "7cb70b70a1944a069f2e1ef2c66c7b19" member_type: VOTER last_known_addr { host: "127.20.171.124" port: 42363 } attrs { promote: false } } }
I20260807 10:36:53.210187 28317 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 7cb70b70a1944a069f2e1ef2c66c7b19 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 7cb70b70a1944a069f2e1ef2c66c7b19 (127.20.171.124) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "a3ba955fde1542b8a0187d9fd7a0052c" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 45569 } } peers { permanent_uuid: "9d9adcde3d254acda7f28fb66fbc417c" member_type: VOTER last_known_addr { host: "127.20.171.125" port: 41963 } attrs { promote: false } } peers { permanent_uuid: "7cb70b70a1944a069f2e1ef2c66c7b19" member_type: VOTER last_known_addr { host: "127.20.171.124" port: 42363 } attrs { promote: false } } }
I20260807 10:36:53.214752 28255 sys_catalog.cc:455] T 00000000000000000000000000000000 P a3ba955fde1542b8a0187d9fd7a0052c [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "a3ba955fde1542b8a0187d9fd7a0052c" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "a3ba955fde1542b8a0187d9fd7a0052c" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 45569 } } peers { permanent_uuid: "9d9adcde3d254acda7f28fb66fbc417c" member_type: VOTER last_known_addr { host: "127.20.171.125" port: 41963 } attrs { promote: false } } peers { permanent_uuid: "7cb70b70a1944a069f2e1ef2c66c7b19" member_type: VOTER last_known_addr { host: "127.20.171.124" port: 42363 } attrs { promote: false } } }
I20260807 10:36:53.215170 28255 sys_catalog.cc:458] T 00000000000000000000000000000000 P a3ba955fde1542b8a0187d9fd7a0052c [sys.catalog]: This master's current role is: LEADER
I20260807 10:36:53.215586 28255 sys_catalog.cc:455] T 00000000000000000000000000000000 P a3ba955fde1542b8a0187d9fd7a0052c [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "a3ba955fde1542b8a0187d9fd7a0052c" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "a3ba955fde1542b8a0187d9fd7a0052c" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 45569 } } peers { permanent_uuid: "9d9adcde3d254acda7f28fb66fbc417c" member_type: VOTER last_known_addr { host: "127.20.171.125" port: 41963 } attrs { promote: false } } peers { permanent_uuid: "7cb70b70a1944a069f2e1ef2c66c7b19" member_type: VOTER last_known_addr { host: "127.20.171.124" port: 42363 } attrs { promote: false } } }
I20260807 10:36:53.216037 28255 sys_catalog.cc:458] T 00000000000000000000000000000000 P a3ba955fde1542b8a0187d9fd7a0052c [sys.catalog]: This master's current role is: LEADER
I20260807 10:36:53.216426 28346 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7cb70b70a1944a069f2e1ef2c66c7b19 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "a3ba955fde1542b8a0187d9fd7a0052c" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "a3ba955fde1542b8a0187d9fd7a0052c" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 45569 } } peers { permanent_uuid: "9d9adcde3d254acda7f28fb66fbc417c" member_type: VOTER last_known_addr { host: "127.20.171.125" port: 41963 } attrs { promote: false } } peers { permanent_uuid: "7cb70b70a1944a069f2e1ef2c66c7b19" member_type: VOTER last_known_addr { host: "127.20.171.124" port: 42363 } attrs { promote: false } } }
I20260807 10:36:53.216547 28255 sys_catalog.cc:455] T 00000000000000000000000000000000 P a3ba955fde1542b8a0187d9fd7a0052c [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "a3ba955fde1542b8a0187d9fd7a0052c" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "a3ba955fde1542b8a0187d9fd7a0052c" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 45569 } } peers { permanent_uuid: "9d9adcde3d254acda7f28fb66fbc417c" member_type: VOTER last_known_addr { host: "127.20.171.125" port: 41963 } attrs { promote: false } } peers { permanent_uuid: "7cb70b70a1944a069f2e1ef2c66c7b19" member_type: VOTER last_known_addr { host: "127.20.171.124" port: 42363 } attrs { promote: false } } }
I20260807 10:36:53.216858 28346 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7cb70b70a1944a069f2e1ef2c66c7b19 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 10:36:53.217085 28255 sys_catalog.cc:458] T 00000000000000000000000000000000 P a3ba955fde1542b8a0187d9fd7a0052c [sys.catalog]: This master's current role is: LEADER
I20260807 10:36:53.220598 28271 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:36:53.222458 28374 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9d9adcde3d254acda7f28fb66fbc417c [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "a3ba955fde1542b8a0187d9fd7a0052c" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "a3ba955fde1542b8a0187d9fd7a0052c" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 45569 } } peers { permanent_uuid: "9d9adcde3d254acda7f28fb66fbc417c" member_type: VOTER last_known_addr { host: "127.20.171.125" port: 41963 } attrs { promote: false } } peers { permanent_uuid: "7cb70b70a1944a069f2e1ef2c66c7b19" member_type: VOTER last_known_addr { host: "127.20.171.124" port: 42363 } attrs { promote: false } } }
I20260807 10:36:53.222680 28271 hybrid_clock.cc:648] HybridClock initialized: now 1786099013222483 us; error 97 us; skew 500 ppm
I20260807 10:36:53.222822 28374 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9d9adcde3d254acda7f28fb66fbc417c [sys.catalog]: This master's current role is: FOLLOWER
I20260807 10:36:53.223428 28271 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:36:53 dist-test-slave-0b58 krb5kdc[27442](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099013, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.171.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:36:53.229789 28271 init.cc:377] Logged in from keytab as oryx/127.20.171.65@KRBTEST.COM (short username oryx)
I20260807 10:36:53.236552 28271 webserver.cc:460] Webserver started at http://127.20.171.65:33641/ using document root <none> and password file <none>
I20260807 10:36:53.237563 28271 fs_manager.cc:359] Metadata directory not provided
I20260807 10:36:53.237810 28271 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:36:53.245316 28271 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.003s sys 0.000s
I20260807 10:36:53.249521 28379 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:36:53.251101 28271 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260807 10:36:53.251376 28271 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/ts-0/wal
uuid: "c04827968c1b4c469f0b4cbf1bf63c3d"
format_stamp: "Formatted at 2026-08-07 10:36:49 on dist-test-slave-0b58"
server_key: "01b9da05c8605cb79c64bbfd536a1b73"
server_key_iv: "5ad478c8c92849b9b77b71ea3dba49cb"
server_key_version: "encryptionkey@0"
I20260807 10:36:53.253087 28271 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:36:53.283056 28271 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:36:53.289400 28271 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:36:53.289913 28271 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:36:53.291494 28271 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:36:53.293767 28271 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:36:53.293992 28271 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:36:53.294185 28271 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:36:53.294384 28271 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:36:53.390230 28271 rpc_server.cc:307] RPC server started. Bound to: 127.20.171.65:42425
I20260807 10:36:53.390471 28494 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.171.65:42425 every 8 connection(s)
I20260807 10:36:53.391968 28271 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/ts-0/data/info.pb
I20260807 10:36:53.395632 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 28271
I20260807 10:36:53.396167 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 27691
Aug 07 10:36:53 dist-test-slave-0b58 krb5kdc[27442](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099008, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.20.171.66@KRBTEST.COM
Aug 07 10:36:53 dist-test-slave-0b58 krb5kdc[27442](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099013, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.171.65@KRBTEST.COM for oryx/127.20.171.124@KRBTEST.COM
I20260807 10:36:53.460112 28502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:53.397791 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33416 (local address 127.20.171.66:45441)
0807 10:36:53.423153 (+ 25362us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:53.423163 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:53.425377 (+ 2214us) server_negotiation.cc:407] Connection header received
0807 10:36:53.425625 (+ 248us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:53.425637 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:53.426012 (+ 375us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:53.426500 (+ 488us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:36:53.430585 (+ 4085us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:53.433463 (+ 2878us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:53.436399 (+ 2936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:53.437818 (+ 1419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:53.437986 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:53.447895 (+ 9909us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:36:53.447913 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:36:53.447934 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:36:53.447995 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:36:53.455021 (+ 7026us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:53.456680 (+ 1659us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:53.456693 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:53.456699 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:53.457090 (+ 391us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:53.457698 (+ 608us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:53.457703 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:53.457706 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:53.458314 (+ 608us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:36:53.458723 (+ 409us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:53.458988 (+ 265us) server_negotiation.cc:299] Negotiation successful
0807 10:36:53.459279 (+ 291us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25024,"thread_start_us":25393,"threads_started":1}
I20260807 10:36:53.462138 27817 generic_service.cc:196] Checking for leaks (request via RPC)
Aug 07 10:36:53 dist-test-slave-0b58 krb5kdc[27442](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099013, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.171.65@KRBTEST.COM for oryx/127.20.171.126@KRBTEST.COM
I20260807 10:36:53.472877 28365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:53.405113 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.65:33829 (local address 127.20.171.124:42363)
0807 10:36:53.405412 (+ 299us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:53.405422 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:53.444143 (+ 38721us) server_negotiation.cc:407] Connection header received
0807 10:36:53.444492 (+ 349us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:53.444501 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:53.444624 (+ 123us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:53.444738 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:36:53.449989 (+ 5251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:53.451523 (+ 1534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:53.453924 (+ 2401us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:53.454970 (+ 1046us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:53.455094 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:53.462249 (+ 7155us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:36:53.462270 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:36:53.462274 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:36:53.462324 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:36:53.466636 (+ 4312us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:53.467635 (+ 999us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:53.467642 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:53.467645 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:53.467844 (+ 199us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:53.468451 (+ 607us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:53.468458 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:53.468462 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:53.468879 (+ 417us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:36:53.472012 (+ 3133us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:53.472176 (+ 164us) server_negotiation.cc:299] Negotiation successful
0807 10:36:53.472436 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":95}
I20260807 10:36:53.473100 28504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:53.407101 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.124:42363 (local address 127.20.171.65:33829)
0807 10:36:53.443895 (+ 36794us) negotiation.cc:107] Waiting for socket to connect
0807 10:36:53.443919 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0807 10:36:53.444317 (+ 398us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:36:53.445389 (+ 1072us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:36:53.445407 (+ 18us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:36:53.446971 (+ 1564us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:36:53.449772 (+ 2801us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:53.449793 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:53.451751 (+ 1958us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:53.451755 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:53.453773 (+ 2018us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:53.453786 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:53.455503 (+ 1717us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:53.455510 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:53.455899 (+ 389us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:53.456876 (+ 977us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:36:53.456906 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:36:53.461940 (+ 5034us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:36:53.466778 (+ 4838us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:36:53.466786 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:36:53.466802 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:36:53.467445 (+ 643us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:36:53.467966 (+ 521us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:36:53.467971 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:36:53.467975 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:36:53.468306 (+ 331us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:36:53.469051 (+ 745us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:36:53.469060 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:36:53.469497 (+ 437us) client_negotiation.cc:769] Sending connection context
0807 10:36:53.469852 (+ 355us) client_negotiation.cc:240] Negotiation successful
0807 10:36:53.470504 (+ 652us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":36618,"thread_start_us":36290,"threads_started":1}
Aug 07 10:36:53 dist-test-slave-0b58 krb5kdc[27442](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099013, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.171.65@KRBTEST.COM for oryx/127.20.171.125@KRBTEST.COM
I20260807 10:36:53.475034 28495 heartbeater.cc:347] Connected to a master server at 127.20.171.124:42363
I20260807 10:36:53.475399 28495 heartbeater.cc:464] Registering TS with master...
I20260807 10:36:53.476568 28495 heartbeater.cc:511] Master 127.20.171.124:42363 requested a full tablet report, sending...
I20260807 10:36:53.479583 28307 ts_manager.cc:194] Registered new tserver with Master: c04827968c1b4c469f0b4cbf1bf63c3d (127.20.171.65:42425)
I20260807 10:36:53.484799 28505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:53.398247 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:45569 (local address 127.20.171.65:33295)
0807 10:36:53.437749 (+ 39502us) negotiation.cc:107] Waiting for socket to connect
0807 10:36:53.437807 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0807 10:36:53.441598 (+ 3791us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:36:53.450437 (+ 8839us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:36:53.450442 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:36:53.451136 (+ 694us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:36:53.451582 (+ 446us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:53.451597 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:53.455933 (+ 4336us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:53.455938 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:53.459116 (+ 3178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:53.459137 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:53.461275 (+ 2138us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:53.461283 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:53.467669 (+ 6386us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:53.468885 (+ 1216us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:36:53.468913 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:36:53.474014 (+ 5101us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:36:53.481379 (+ 7365us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:36:53.481386 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:36:53.481391 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:36:53.482020 (+ 629us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:36:53.482494 (+ 474us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:36:53.482498 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:36:53.482502 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:36:53.482855 (+ 353us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:36:53.483493 (+ 638us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:36:53.483497 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:36:53.483658 (+ 161us) client_negotiation.cc:769] Sending connection context
0807 10:36:53.483797 (+ 139us) client_negotiation.cc:240] Negotiation successful
0807 10:36:53.484132 (+ 335us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":39062,"thread_start_us":38733,"threads_started":1}
I20260807 10:36:53.484799 28499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:53.396913 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.65:33295 (local address 127.20.171.126:45569)
0807 10:36:53.448146 (+ 51233us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:53.448151 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:53.448810 (+ 659us) server_negotiation.cc:407] Connection header received
0807 10:36:53.448871 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:53.448875 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:53.448936 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:53.449186 (+ 250us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:36:53.454083 (+ 4897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:53.455740 (+ 1657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:53.459358 (+ 3618us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:53.460084 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:53.460201 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:53.476523 (+ 16322us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:36:53.476530 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:36:53.476535 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:36:53.476577 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:36:53.481191 (+ 4614us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:53.482186 (+ 995us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:53.482192 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:53.482195 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:53.482357 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:53.482970 (+ 613us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:53.482975 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:53.482979 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:53.483374 (+ 395us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:36:53.483518 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:53.483908 (+ 390us) server_negotiation.cc:299] Negotiation successful
0807 10:36:53.484132 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51094,"thread_start_us":50946,"threads_started":1}
I20260807 10:36:53.485980 28496 heartbeater.cc:347] Connected to a master server at 127.20.171.126:45569
I20260807 10:36:53.485991 28500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:53.397011 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.65:51493 (local address 127.20.171.125:41963)
0807 10:36:53.457883 (+ 60872us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:53.457889 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:53.457911 (+ 22us) server_negotiation.cc:407] Connection header received
0807 10:36:53.457971 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:53.457976 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:53.460552 (+ 2576us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:53.460799 (+ 247us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:36:53.463251 (+ 2452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:53.464980 (+ 1729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:53.468017 (+ 3037us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:53.469273 (+ 1256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:53.470601 (+ 1328us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:53.476064 (+ 5463us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:36:53.476072 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:36:53.476076 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:36:53.476120 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:36:53.481740 (+ 5620us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:53.482604 (+ 864us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:53.482609 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:53.482613 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:53.482793 (+ 180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:53.483257 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:53.483264 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:53.483268 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:53.483782 (+ 514us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:36:53.483940 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:53.485219 (+ 1279us) server_negotiation.cc:299] Negotiation successful
0807 10:36:53.485449 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60657,"thread_start_us":60388,"threads_started":1}
I20260807 10:36:53.486167 28496 heartbeater.cc:464] Registering TS with master...
I20260807 10:36:53.486917 28503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:53.405850 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.125:41963 (local address 127.20.171.65:51493)
0807 10:36:53.442730 (+ 36880us) negotiation.cc:107] Waiting for socket to connect
0807 10:36:53.442754 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0807 10:36:53.443062 (+ 308us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:36:53.460855 (+ 17793us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:36:53.460860 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:36:53.462181 (+ 1321us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:36:53.462954 (+ 773us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:53.462968 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:53.465192 (+ 2224us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:53.465201 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:53.467818 (+ 2617us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:53.467835 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:53.469660 (+ 1825us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:53.469672 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:53.470010 (+ 338us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:53.471098 (+ 1088us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:36:53.471147 (+ 49us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:36:53.475861 (+ 4714us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:36:53.481886 (+ 6025us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:36:53.481891 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:36:53.481894 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:36:53.482497 (+ 603us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:36:53.482910 (+ 413us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:36:53.482915 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:36:53.482921 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:36:53.483131 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:36:53.484029 (+ 898us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:36:53.484035 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:36:53.484332 (+ 297us) client_negotiation.cc:769] Sending connection context
0807 10:36:53.484514 (+ 182us) client_negotiation.cc:240] Negotiation successful
0807 10:36:53.486192 (+ 1678us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":36677,"thread_start_us":36376,"threads_started":1}
I20260807 10:36:53.487185 28496 heartbeater.cc:511] Master 127.20.171.126:45569 requested a full tablet report, sending...
I20260807 10:36:53.488091 28497 heartbeater.cc:347] Connected to a master server at 127.20.171.125:41963
I20260807 10:36:53.488338 28497 heartbeater.cc:464] Registering TS with master...
I20260807 10:36:53.488714 27487 ts_manager.cc:194] Re-registered known tserver with Master: c04827968c1b4c469f0b4cbf1bf63c3d (127.20.171.65:42425)
I20260807 10:36:53.489285 28497 heartbeater.cc:511] Master 127.20.171.125:41963 requested a full tablet report, sending...
I20260807 10:36:53.489997 27487 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.20.171.65@KRBTEST.COM'} at 127.20.171.65:33295
I20260807 10:36:53.493708 28105 ts_manager.cc:194] Registered new tserver with Master: c04827968c1b4c469f0b4cbf1bf63c3d (127.20.171.65:42425)
I20260807 10:36:53.563910 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 27691
I20260807 10:36:53.584911 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.171.66:45441
--local_ip_for_outbound_sockets=127.20.171.66
--tserver_master_addrs=127.20.171.126:45569
--webserver_port=45949
--webserver_interface=127.20.171.66
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/krb5kdc/oryx_127.20.171.66.keytab
--principal=oryx/127.20.171.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.171.84:36279
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.20.171.126:45569,127.20.171.125:41963
--tserver_master_addrs=127.20.171.126:45569,127.20.171.125:41963,127.20.171.124:42363 with env {KRB5CCNAME=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:36:53.962777 28507 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:36:53.963048 28507 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:36:53.963205 28507 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:36:53.970655 28507 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:36:53.970777 28507 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:36:53.970919 28507 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.171.66
I20260807 10:36:53.981377 28507 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.171.84:36279
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/krb5kdc/oryx_127.20.171.66.keytab
--principal=oryx/127.20.171.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.171.66:45441
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.171.66
--webserver_port=45949
--tserver_master_addrs=127.20.171.126:45569,127.20.171.125:41963,127.20.171.124:42363
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.171.66
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:36:53.982642 28507 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:36:53.984009 28507 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:36:54.000048 28512 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:36:54.000109 28513 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:36:54.000643 28515 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:36:54.001415 28507 server_base.cc:1034] running on GCE node
I20260807 10:36:54.002046 28507 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:36:54.002967 28507 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:36:54.004204 28507 hybrid_clock.cc:648] HybridClock initialized: now 1786099014004155 us; error 51 us; skew 500 ppm
I20260807 10:36:54.004547 28507 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:36:54 dist-test-slave-0b58 krb5kdc[27442](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099014, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.171.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:36:54.007782 28507 init.cc:377] Logged in from keytab as oryx/127.20.171.66@KRBTEST.COM (short username oryx)
I20260807 10:36:54.009577 28507 webserver.cc:460] Webserver started at http://127.20.171.66:45949/ using document root <none> and password file <none>
I20260807 10:36:54.010215 28507 fs_manager.cc:359] Metadata directory not provided
I20260807 10:36:54.010329 28507 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:36:54.015494 28507 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.002s
I20260807 10:36:54.018716 28522 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:36:54.020009 28507 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 10:36:54.020135 28507 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/ts-1/wal
uuid: "13625247901b4ad7a38dae319a093281"
format_stamp: "Formatted at 2026-08-07 10:36:50 on dist-test-slave-0b58"
server_key: "5986b7a4081411273d5ee53b05f79545"
server_key_iv: "7867fdfc150b360238445bf7587bd3c9"
server_key_version: "encryptionkey@0"
I20260807 10:36:54.021167 28507 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:36:54.037699 28507 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:36:54.041416 28507 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:36:54.041656 28507 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:36:54.042842 28507 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:36:54.044202 28507 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:36:54.044343 28507 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:36:54.044479 28507 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:36:54.044587 28507 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:36:54.079521 28507 rpc_server.cc:307] RPC server started. Bound to: 127.20.171.66:45441
I20260807 10:36:54.079581 28637 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.171.66:45441 every 8 connection(s)
I20260807 10:36:54.081156 28507 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/ts-1/data/info.pb
I20260807 10:36:54.082173 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 28507
I20260807 10:36:54.082515 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 27828
Aug 07 10:36:54 dist-test-slave-0b58 krb5kdc[27442](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099014, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.171.66@KRBTEST.COM for oryx/127.20.171.126@KRBTEST.COM
Aug 07 10:36:54 dist-test-slave-0b58 krb5kdc[27442](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099014, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.171.66@KRBTEST.COM for oryx/127.20.171.124@KRBTEST.COM
Aug 07 10:36:54 dist-test-slave-0b58 krb5kdc[27442](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099014, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.171.66@KRBTEST.COM for oryx/127.20.171.125@KRBTEST.COM
Aug 07 10:36:54 dist-test-slave-0b58 krb5kdc[27442](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099008, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.20.171.67@KRBTEST.COM
I20260807 10:36:54.139062 28645 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:54.089436 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.66:45863 (local address 127.20.171.126:45569)
0807 10:36:54.100773 (+ 11337us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:54.100782 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:54.116870 (+ 16088us) server_negotiation.cc:407] Connection header received
0807 10:36:54.117042 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:54.117050 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:54.117145 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:54.117261 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:36:54.120607 (+ 3346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:54.121771 (+ 1164us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:54.124592 (+ 2821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:54.125089 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:54.125183 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:54.130783 (+ 5600us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:36:54.130788 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:36:54.130792 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:36:54.130833 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:36:54.135053 (+ 4220us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:54.136177 (+ 1124us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:54.136182 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:54.136185 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:54.136377 (+ 192us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:54.136933 (+ 556us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:54.136937 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:54.136941 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:54.137270 (+ 329us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:36:54.137402 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:54.138448 (+ 1046us) server_negotiation.cc:299] Negotiation successful
0807 10:36:54.138682 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11170,"thread_start_us":11043,"threads_started":1}
I20260807 10:36:54.139266 28644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:54.085547 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.66:52235 (local address 127.20.171.124:42363)
0807 10:36:54.117344 (+ 31797us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:54.117350 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:54.117366 (+ 16us) server_negotiation.cc:407] Connection header received
0807 10:36:54.117422 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:54.117426 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:54.117513 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:54.117631 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:36:54.122072 (+ 4441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:54.123184 (+ 1112us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:54.126000 (+ 2816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:54.126678 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:54.126799 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:54.131507 (+ 4708us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:36:54.131514 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:36:54.131519 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:36:54.131554 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:36:54.135115 (+ 3561us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:54.136179 (+ 1064us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:54.136183 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:54.136186 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:54.136371 (+ 185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:54.136937 (+ 566us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:54.136942 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:54.136945 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:54.137261 (+ 316us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:36:54.137402 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:54.138736 (+ 1334us) server_negotiation.cc:299] Negotiation successful
0807 10:36:54.138936 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31678,"thread_start_us":31548,"threads_started":1}
I20260807 10:36:54.140314 28647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:54.089390 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:45569 (local address 127.20.171.66:45863)
0807 10:36:54.116748 (+ 27358us) negotiation.cc:107] Waiting for socket to connect
0807 10:36:54.116767 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 10:36:54.116915 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:36:54.117928 (+ 1013us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:36:54.117942 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:36:54.119316 (+ 1374us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:36:54.120411 (+ 1095us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:54.120433 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:54.121945 (+ 1512us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:54.121949 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:54.124432 (+ 2483us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:54.124461 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:54.125357 (+ 896us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:54.125365 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:54.125674 (+ 309us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:54.126751 (+ 1077us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:36:54.126792 (+ 41us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:36:54.130566 (+ 3774us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:36:54.135232 (+ 4666us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:36:54.135241 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:36:54.135256 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:36:54.136056 (+ 800us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:36:54.136525 (+ 469us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:36:54.136529 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:36:54.136531 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:36:54.136792 (+ 261us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:36:54.137487 (+ 695us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:36:54.137494 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:36:54.137985 (+ 491us) client_negotiation.cc:769] Sending connection context
0807 10:36:54.138320 (+ 335us) client_negotiation.cc:240] Negotiation successful
0807 10:36:54.138839 (+ 519us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":27213,"mutex_wait_us":355,"spinlock_wait_cycles":21248,"thread_start_us":27101,"threads_started":1}
I20260807 10:36:54.140642 28642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:54.083883 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59280 (local address 127.20.171.67:37807)
0807 10:36:54.099052 (+ 15169us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:54.099065 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:54.119707 (+ 20642us) server_negotiation.cc:407] Connection header received
0807 10:36:54.120038 (+ 331us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:54.120048 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:54.120322 (+ 274us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:54.120445 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:36:54.122802 (+ 2357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:54.124436 (+ 1634us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:54.126084 (+ 1648us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:54.127094 (+ 1010us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:54.127193 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:54.132819 (+ 5626us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:36:54.132833 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:36:54.132848 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:36:54.132890 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:36:54.137084 (+ 4194us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:54.137933 (+ 849us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:54.137943 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:54.137951 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:54.138072 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:54.138507 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:54.138512 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:54.138515 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:54.138919 (+ 404us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:36:54.139326 (+ 407us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:54.139953 (+ 627us) server_negotiation.cc:299] Negotiation successful
0807 10:36:54.140199 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14935,"thread_start_us":15170,"threads_started":1}
I20260807 10:36:54.140754 28650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:54.102477 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.66:45489 (local address 127.20.171.125:41963)
0807 10:36:54.112730 (+ 10253us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:54.112739 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:54.118932 (+ 6193us) server_negotiation.cc:407] Connection header received
0807 10:36:54.119152 (+ 220us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:54.119158 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:54.119283 (+ 125us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:54.119391 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:36:54.120797 (+ 1406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:54.121538 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:54.125601 (+ 4063us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:54.126344 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:54.126652 (+ 308us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:54.132423 (+ 5771us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:36:54.132429 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:36:54.132434 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:36:54.132478 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:36:54.136191 (+ 3713us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:54.137064 (+ 873us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:54.137071 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:54.137074 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:54.137223 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:54.137711 (+ 488us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:54.137716 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:54.137719 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:54.138075 (+ 356us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:36:54.138220 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:54.140132 (+ 1912us) server_negotiation.cc:299] Negotiation successful
0807 10:36:54.140392 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10099,"thread_start_us":9950,"threads_started":1}
I20260807 10:36:54.141572 28643 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:54.101925 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.125:41963 (local address 127.20.171.66:45489)
0807 10:36:54.118813 (+ 16888us) negotiation.cc:107] Waiting for socket to connect
0807 10:36:54.118832 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 10:36:54.119010 (+ 178us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:36:54.119585 (+ 575us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:36:54.119589 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:36:54.120218 (+ 629us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:36:54.120650 (+ 432us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:54.120658 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:54.121707 (+ 1049us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:54.121712 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:54.124432 (+ 2720us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:54.125402 (+ 970us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:54.126980 (+ 1578us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:54.126988 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:54.127191 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:54.127826 (+ 635us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:36:54.127850 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:36:54.132181 (+ 4331us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:36:54.136385 (+ 4204us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:36:54.136390 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:36:54.136394 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:36:54.136922 (+ 528us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:36:54.137393 (+ 471us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:36:54.137399 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:36:54.137402 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:36:54.137593 (+ 191us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:36:54.139486 (+ 1893us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:36:54.139491 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:36:54.139632 (+ 141us) client_negotiation.cc:769] Sending connection context
0807 10:36:54.140982 (+ 1350us) client_negotiation.cc:240] Negotiation successful
0807 10:36:54.141239 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":16756,"mutex_wait_us":294,"thread_start_us":11004,"threads_started":1}
I20260807 10:36:54.141902 27955 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:36:54.142829 28639 heartbeater.cc:347] Connected to a master server at 127.20.171.126:45569
I20260807 10:36:54.142989 28640 heartbeater.cc:347] Connected to a master server at 127.20.171.125:41963
I20260807 10:36:54.143131 28639 heartbeater.cc:464] Registering TS with master...
I20260807 10:36:54.143133 28640 heartbeater.cc:464] Registering TS with master...
I20260807 10:36:54.143874 28639 heartbeater.cc:511] Master 127.20.171.126:45569 requested a full tablet report, sending...
I20260807 10:36:54.143942 28640 heartbeater.cc:511] Master 127.20.171.125:41963 requested a full tablet report, sending...
I20260807 10:36:54.145473 27487 ts_manager.cc:194] Re-registered known tserver with Master: 13625247901b4ad7a38dae319a093281 (127.20.171.66:45441)
I20260807 10:36:54.145804 28105 ts_manager.cc:194] Registered new tserver with Master: 13625247901b4ad7a38dae319a093281 (127.20.171.66:45441)
I20260807 10:36:54.146438 27487 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.20.171.66@KRBTEST.COM'} at 127.20.171.66:45863
I20260807 10:36:54.141223 28649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:54.084866 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.124:42363 (local address 127.20.171.66:52235)
0807 10:36:54.113352 (+ 28486us) negotiation.cc:107] Waiting for socket to connect
0807 10:36:54.113415 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0807 10:36:54.115641 (+ 2226us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:36:54.117928 (+ 2287us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:36:54.117942 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:36:54.119829 (+ 1887us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:36:54.120447 (+ 618us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:54.120463 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:54.123386 (+ 2923us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:54.123391 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:54.125820 (+ 2429us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:54.125836 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:54.127111 (+ 1275us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:54.127117 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:54.127283 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:54.127971 (+ 688us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:36:54.127994 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:36:54.131301 (+ 3307us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:36:54.135242 (+ 3941us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:36:54.135246 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:36:54.135256 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:36:54.136046 (+ 790us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:36:54.136523 (+ 477us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:36:54.136527 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:36:54.136531 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:36:54.136792 (+ 261us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:36:54.137487 (+ 695us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:36:54.137494 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:36:54.138393 (+ 899us) client_negotiation.cc:769] Sending connection context
0807 10:36:54.138506 (+ 113us) client_negotiation.cc:240] Negotiation successful
0807 10:36:54.140832 (+ 2326us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":28153,"mutex_wait_us":2706,"spinlock_wait_cycles":30976,"thread_start_us":33502,"threads_started":1}
I20260807 10:36:54.148144 28638 heartbeater.cc:347] Connected to a master server at 127.20.171.124:42363
I20260807 10:36:54.148295 28638 heartbeater.cc:464] Registering TS with master...
I20260807 10:36:54.148590 28638 heartbeater.cc:511] Master 127.20.171.124:42363 requested a full tablet report, sending...
I20260807 10:36:54.149593 28307 ts_manager.cc:194] Registered new tserver with Master: 13625247901b4ad7a38dae319a093281 (127.20.171.66:45441)
I20260807 10:36:54.243873 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 27828
I20260807 10:36:54.264237 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.171.67:37807
--local_ip_for_outbound_sockets=127.20.171.67
--tserver_master_addrs=127.20.171.126:45569
--webserver_port=39273
--webserver_interface=127.20.171.67
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/krb5kdc/oryx_127.20.171.67.keytab
--principal=oryx/127.20.171.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.171.84:36279
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.20.171.126:45569,127.20.171.125:41963
--tserver_master_addrs=127.20.171.126:45569,127.20.171.125:41963,127.20.171.124:42363 with env {KRB5CCNAME=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 10:36:54.492406 28496 heartbeater.cc:503] Master 127.20.171.126:45569 was elected leader, sending a full tablet report...
W20260807 10:36:54.598580 28652 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:36:54.598940 28652 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:36:54.599113 28652 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:36:54.606514 28652 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:36:54.606674 28652 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:36:54.606850 28652 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.171.67
I20260807 10:36:54.616564 28652 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.171.84:36279
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/krb5kdc/oryx_127.20.171.67.keytab
--principal=oryx/127.20.171.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.171.67:37807
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.171.67
--webserver_port=39273
--tserver_master_addrs=127.20.171.126:45569,127.20.171.125:41963,127.20.171.124:42363
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.171.67
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:36:54.617980 28652 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:36:54.619366 28652 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:36:54.632390 28657 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:36:54.632443 28660 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:36:54.632404 28658 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:36:54.633483 28652 server_base.cc:1034] running on GCE node
I20260807 10:36:54.634045 28652 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:36:54.635202 28652 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:36:54.636356 28652 hybrid_clock.cc:648] HybridClock initialized: now 1786099014636306 us; error 40 us; skew 500 ppm
I20260807 10:36:54.636695 28652 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:36:54 dist-test-slave-0b58 krb5kdc[27442](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099014, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.171.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:36:54.639720 28652 init.cc:377] Logged in from keytab as oryx/127.20.171.67@KRBTEST.COM (short username oryx)
I20260807 10:36:54.641211 28652 webserver.cc:460] Webserver started at http://127.20.171.67:39273/ using document root <none> and password file <none>
I20260807 10:36:54.641896 28652 fs_manager.cc:359] Metadata directory not provided
I20260807 10:36:54.642005 28652 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:36:54.647349 28652 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.005s sys 0.000s
I20260807 10:36:54.650180 28667 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:36:54.651468 28652 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 10:36:54.651640 28652 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/ts-2/wal
uuid: "0ee4d53fcb5c47acbc12ef3ba680766a"
format_stamp: "Formatted at 2026-08-07 10:36:50 on dist-test-slave-0b58"
server_key: "6074a662d2c90e3f16c2f30367a3f596"
server_key_iv: "4d389d7d8ac62d921c82ba571649f811"
server_key_version: "encryptionkey@0"
I20260807 10:36:54.652673 28652 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:36:54.663697 28652 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:36:54.667467 28652 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:36:54.667774 28652 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:36:54.668772 28652 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:36:54.670279 28652 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:36:54.670405 28652 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:36:54.670537 28652 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:36:54.670621 28652 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:36:54.704365 28652 rpc_server.cc:307] RPC server started. Bound to: 127.20.171.67:37807
I20260807 10:36:54.704453 28781 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.171.67:37807 every 8 connection(s)
I20260807 10:36:54.705828 28652 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/ts-2/data/info.pb
I20260807 10:36:54.710523 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 28652
Aug 07 10:36:54 dist-test-slave-0b58 krb5kdc[27442](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099014, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.171.67@KRBTEST.COM for oryx/127.20.171.124@KRBTEST.COM
Aug 07 10:36:54 dist-test-slave-0b58 krb5kdc[27442](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099014, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.171.67@KRBTEST.COM for oryx/127.20.171.126@KRBTEST.COM
Aug 07 10:36:54 dist-test-slave-0b58 krb5kdc[27442](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099014, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.171.67@KRBTEST.COM for oryx/127.20.171.125@KRBTEST.COM
I20260807 10:36:54.766340 28787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:54.708742 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.67:47865 (local address 127.20.171.124:42363)
0807 10:36:54.746659 (+ 37917us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:54.746671 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:54.746692 (+ 21us) server_negotiation.cc:407] Connection header received
0807 10:36:54.746780 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:54.746785 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:54.746864 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:54.747112 (+ 248us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:36:54.748503 (+ 1391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:54.749651 (+ 1148us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:54.751605 (+ 1954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:54.752196 (+ 591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:54.752376 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:54.757724 (+ 5348us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:36:54.757731 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:36:54.757736 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:36:54.757777 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:36:54.761339 (+ 3562us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:54.762199 (+ 860us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:54.762205 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:54.762208 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:54.762345 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:54.762812 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:54.762817 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:54.762820 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:54.763120 (+ 300us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:36:54.763283 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:54.765687 (+ 2404us) server_negotiation.cc:299] Negotiation successful
0807 10:36:54.765916 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37782,"thread_start_us":39424,"threads_started":1}
I20260807 10:36:54.766495 28791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:54.709333 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.124:42363 (local address 127.20.171.67:47865)
0807 10:36:54.731986 (+ 22653us) negotiation.cc:107] Waiting for socket to connect
0807 10:36:54.732048 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0807 10:36:54.735357 (+ 3309us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:36:54.747220 (+ 11863us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:36:54.747228 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:36:54.747829 (+ 601us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:36:54.748228 (+ 399us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:54.748291 (+ 63us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:54.749880 (+ 1589us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:54.749885 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:54.751384 (+ 1499us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:54.751399 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:54.752632 (+ 1233us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:54.752639 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:54.752950 (+ 311us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:54.753722 (+ 772us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:36:54.753757 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:36:54.757410 (+ 3653us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:36:54.761486 (+ 4076us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:36:54.761495 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:36:54.761512 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:36:54.762061 (+ 549us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:36:54.762467 (+ 406us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:36:54.762472 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:36:54.762475 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:36:54.762682 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:36:54.763267 (+ 585us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:36:54.763275 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:36:54.763823 (+ 548us) client_negotiation.cc:769] Sending connection context
0807 10:36:54.764219 (+ 396us) client_negotiation.cc:240] Negotiation successful
0807 10:36:54.764892 (+ 673us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":22323,"mutex_wait_us":3,"spinlock_wait_cycles":28416,"thread_start_us":36604,"threads_started":1}
I20260807 10:36:54.769994 28790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:54.709616 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.67:37781 (local address 127.20.171.125:41963)
0807 10:36:54.744440 (+ 34824us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:54.744448 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:54.744473 (+ 25us) server_negotiation.cc:407] Connection header received
0807 10:36:54.744548 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:54.744556 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:54.744657 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:54.747961 (+ 3304us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:36:54.748471 (+ 510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:54.749747 (+ 1276us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:54.751947 (+ 2200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:54.752766 (+ 819us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:54.752872 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:54.760574 (+ 7702us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:36:54.760584 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:36:54.760592 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:36:54.760648 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:36:54.765708 (+ 5060us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:54.767237 (+ 1529us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:54.767243 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:54.767247 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:54.767428 (+ 181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:54.768233 (+ 805us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:54.768238 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:54.768241 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:54.768604 (+ 363us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:36:54.768749 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:54.769391 (+ 642us) server_negotiation.cc:299] Negotiation successful
0807 10:36:54.769614 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34661,"thread_start_us":35357,"threads_started":1}
I20260807 10:36:54.770150 28792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:54.709333 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.125:41963 (local address 127.20.171.67:37781)
0807 10:36:54.736235 (+ 26902us) negotiation.cc:107] Waiting for socket to connect
0807 10:36:54.736272 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0807 10:36:54.736593 (+ 321us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:36:54.745465 (+ 8872us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:36:54.745479 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:36:54.746788 (+ 1309us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:36:54.748219 (+ 1431us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:54.748250 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:54.749958 (+ 1708us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:54.749965 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:54.751761 (+ 1796us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:54.751779 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:54.753088 (+ 1309us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:54.753094 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:54.753581 (+ 487us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:54.754758 (+ 1177us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:36:54.754790 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:36:54.760318 (+ 5528us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:36:54.765885 (+ 5567us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:36:54.765893 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:36:54.765899 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:36:54.767045 (+ 1146us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:36:54.767550 (+ 505us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:36:54.767556 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:36:54.767563 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:36:54.767797 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:36:54.768862 (+ 1065us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:36:54.768869 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:36:54.769077 (+ 208us) client_negotiation.cc:769] Sending connection context
0807 10:36:54.769277 (+ 200us) client_negotiation.cc:240] Negotiation successful
0807 10:36:54.769572 (+ 295us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":26741,"mutex_wait_us":1011,"spinlock_wait_cycles":21248,"thread_start_us":21355,"threads_started":1}
I20260807 10:36:54.770498 28782 heartbeater.cc:347] Connected to a master server at 127.20.171.124:42363
I20260807 10:36:54.770875 28782 heartbeater.cc:464] Registering TS with master...
I20260807 10:36:54.771297 28784 heartbeater.cc:347] Connected to a master server at 127.20.171.125:41963
I20260807 10:36:54.771476 28784 heartbeater.cc:464] Registering TS with master...
I20260807 10:36:54.771975 28782 heartbeater.cc:511] Master 127.20.171.124:42363 requested a full tablet report, sending...
I20260807 10:36:54.772185 28784 heartbeater.cc:511] Master 127.20.171.125:41963 requested a full tablet report, sending...
I20260807 10:36:54.772756 28788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:54.709333 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:45569 (local address 127.20.171.67:55805)
0807 10:36:54.745659 (+ 36326us) negotiation.cc:107] Waiting for socket to connect
0807 10:36:54.745681 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0807 10:36:54.745950 (+ 269us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:36:54.748109 (+ 2159us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:36:54.748116 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:36:54.748825 (+ 709us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:36:54.749112 (+ 287us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:54.749123 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:54.751273 (+ 2150us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:54.751279 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:54.752723 (+ 1444us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:54.752735 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:54.753681 (+ 946us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:54.753696 (+ 15us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:54.753920 (+ 224us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:54.754492 (+ 572us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:36:54.754512 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:36:54.758055 (+ 3543us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:36:54.766712 (+ 8657us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:36:54.766716 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:36:54.766719 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:36:54.767308 (+ 589us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:36:54.767906 (+ 598us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:36:54.767910 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:36:54.767914 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:36:54.768070 (+ 156us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:36:54.771448 (+ 3378us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:36:54.771453 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:36:54.771618 (+ 165us) client_negotiation.cc:769] Sending connection context
0807 10:36:54.771825 (+ 207us) client_negotiation.cc:240] Negotiation successful
0807 10:36:54.772229 (+ 404us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":36170,"mutex_wait_us":1105,"thread_start_us":25518,"threads_started":1}
I20260807 10:36:54.773885 28789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:54.709557 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.67:55805 (local address 127.20.171.126:45569)
0807 10:36:54.747630 (+ 38073us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:54.747638 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:54.747660 (+ 22us) server_negotiation.cc:407] Connection header received
0807 10:36:54.747724 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:54.747729 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:54.747818 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:54.748046 (+ 228us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:36:54.749431 (+ 1385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:54.751120 (+ 1689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:54.752844 (+ 1724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:54.753442 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:54.753560 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:54.758305 (+ 4745us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:36:54.758311 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:36:54.758316 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:36:54.758362 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:36:54.765431 (+ 7069us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:54.767594 (+ 2163us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:54.767602 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:54.767606 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:54.767756 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:54.768221 (+ 465us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:54.768225 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:54.768228 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:54.768604 (+ 376us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:36:54.768749 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:54.773287 (+ 4538us) server_negotiation.cc:299] Negotiation successful
0807 10:36:54.773493 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37910,"thread_start_us":37796,"threads_started":1}
I20260807 10:36:54.774505 28105 ts_manager.cc:194] Registered new tserver with Master: 0ee4d53fcb5c47acbc12ef3ba680766a (127.20.171.67:37807)
I20260807 10:36:54.775223 28783 heartbeater.cc:347] Connected to a master server at 127.20.171.126:45569
I20260807 10:36:54.775382 28783 heartbeater.cc:464] Registering TS with master...
I20260807 10:36:54.775911 28783 heartbeater.cc:511] Master 127.20.171.126:45569 requested a full tablet report, sending...
I20260807 10:36:54.777215 27487 ts_manager.cc:194] Re-registered known tserver with Master: 0ee4d53fcb5c47acbc12ef3ba680766a (127.20.171.67:37807)
I20260807 10:36:54.777923 28307 ts_manager.cc:194] Registered new tserver with Master: 0ee4d53fcb5c47acbc12ef3ba680766a (127.20.171.67:37807)
I20260807 10:36:54.778584 27487 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.20.171.67@KRBTEST.COM'} at 127.20.171.67:55805
I20260807 10:36:54.796345 28789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:54.769380 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37376 (local address 127.20.171.126:45569)
0807 10:36:54.774632 (+ 5252us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:54.774637 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:54.777950 (+ 3313us) server_negotiation.cc:407] Connection header received
0807 10:36:54.779339 (+ 1389us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:54.779344 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:54.779464 (+ 120us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:54.779542 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:36:54.782144 (+ 2602us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:54.783281 (+ 1137us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:54.785236 (+ 1955us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:54.785651 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:54.785793 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:54.789310 (+ 3517us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:36:54.789318 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:36:54.789324 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:36:54.789363 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:36:54.793136 (+ 3773us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:54.793951 (+ 815us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:54.793956 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:54.793960 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:54.794121 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:54.794593 (+ 472us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:54.794598 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:54.794604 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:54.794986 (+ 382us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:36:54.795219 (+ 233us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:54.795667 (+ 448us) server_negotiation.cc:299] Negotiation successful
0807 10:36:54.795908 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5150,"thread_start_us":14159,"threads_started":1}
I20260807 10:36:54.797755 28787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:54.768987 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35402 (local address 127.20.171.124:42363)
0807 10:36:54.769155 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:54.769160 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:54.778635 (+ 9475us) server_negotiation.cc:407] Connection header received
0807 10:36:54.782369 (+ 3734us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:54.782375 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:54.782449 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:54.782516 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:36:54.785147 (+ 2631us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:54.786161 (+ 1014us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:54.788220 (+ 2059us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:54.788802 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:54.788913 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:54.791740 (+ 2827us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:36:54.791746 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:36:54.791750 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:36:54.791787 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:36:54.794523 (+ 2736us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:54.795125 (+ 602us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:54.795132 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:54.795138 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:54.795282 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:54.795693 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:54.795697 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:54.795700 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:54.796340 (+ 640us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:36:54.796575 (+ 235us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:54.797091 (+ 516us) server_negotiation.cc:299] Negotiation successful
0807 10:36:54.797309 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260807 10:36:54.799261 28790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:54.776850 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41922 (local address 127.20.171.125:41963)
0807 10:36:54.779146 (+ 2296us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:54.779153 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:54.779902 (+ 749us) server_negotiation.cc:407] Connection header received
0807 10:36:54.780195 (+ 293us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:54.780203 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:54.780312 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:54.780394 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:36:54.784092 (+ 3698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:54.785237 (+ 1145us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:54.787048 (+ 1811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:54.787463 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:54.787584 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:54.791647 (+ 4063us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:36:54.791655 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:36:54.791660 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:36:54.791713 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:36:54.795526 (+ 3813us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:54.796395 (+ 869us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:54.796403 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:54.796407 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:54.796557 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:54.797067 (+ 510us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:54.797074 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:54.797076 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:54.797425 (+ 349us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:36:54.797665 (+ 240us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:54.798817 (+ 1152us) server_negotiation.cc:299] Negotiation successful
0807 10:36:54.799049 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2125}
I20260807 10:36:54.801148 27487 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37376:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 10:36:54.807834 27487 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 10:36:54.853782 28813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:54.829280 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.67:37807 (local address 127.0.0.1:59288)
0807 10:36:54.844623 (+ 15343us) negotiation.cc:107] Waiting for socket to connect
0807 10:36:54.844651 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0807 10:36:54.844973 (+ 322us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:36:54.846857 (+ 1884us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:36:54.846861 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:36:54.846889 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:36:54.847268 (+ 379us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:54.847279 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:54.849401 (+ 2122us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:54.849408 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:54.850988 (+ 1580us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:54.851001 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:54.852967 (+ 1966us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:54.852973 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:54.853143 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:54.853192 (+ 49us) client_negotiation.cc:769] Sending connection context
0807 10:36:54.853305 (+ 113us) client_negotiation.cc:240] Negotiation successful
0807 10:36:54.853435 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14876,"thread_start_us":15807,"threads_started":1}
I20260807 10:36:54.853847 28812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:54.829470 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59288 (local address 127.20.171.67:37807)
0807 10:36:54.846285 (+ 16815us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:54.846290 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:54.846315 (+ 25us) server_negotiation.cc:407] Connection header received
0807 10:36:54.846385 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:54.846389 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:54.846530 (+ 141us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:54.846884 (+ 354us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:36:54.847461 (+ 577us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:54.849282 (+ 1821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:54.851139 (+ 1857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:54.852121 (+ 982us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:54.852281 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:54.852523 (+ 242us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:54.853354 (+ 831us) server_negotiation.cc:299] Negotiation successful
0807 10:36:54.853512 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16638,"thread_start_us":16474,"threads_started":1}
I20260807 10:36:54.859529 28811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:54.830305 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.66:45441 (local address 127.0.0.1:33432)
0807 10:36:54.844621 (+ 14316us) negotiation.cc:107] Waiting for socket to connect
0807 10:36:54.844644 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0807 10:36:54.844981 (+ 337us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:36:54.852171 (+ 7190us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:36:54.852176 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:36:54.852206 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:36:54.852759 (+ 553us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:54.852778 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:54.855415 (+ 2637us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:54.855419 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:54.857335 (+ 1916us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:54.857386 (+ 51us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:54.858805 (+ 1419us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:54.858811 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:54.858956 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:54.858986 (+ 30us) client_negotiation.cc:769] Sending connection context
0807 10:36:54.859064 (+ 78us) client_negotiation.cc:240] Negotiation successful
0807 10:36:54.859184 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14185,"spinlock_wait_cycles":23424,"thread_start_us":13835,"threads_started":1}
I20260807 10:36:54.859544 28814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:54.830620 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33432 (local address 127.20.171.66:45441)
0807 10:36:54.843656 (+ 13036us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:54.843673 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:54.845127 (+ 1454us) server_negotiation.cc:407] Connection header received
0807 10:36:54.845253 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:54.845263 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:54.845653 (+ 390us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:54.852187 (+ 6534us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:36:54.853019 (+ 832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:54.855247 (+ 2228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:54.857569 (+ 2322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:54.858622 (+ 1053us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:54.858780 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:54.858980 (+ 200us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:54.859115 (+ 135us) server_negotiation.cc:299] Negotiation successful
0807 10:36:54.859278 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12733,"thread_start_us":13595,"threads_started":1}
I20260807 10:36:54.860538 28715 tablet_service.cc:1467] Processing CreateTablet for tablet 3fcc47d3a8c74a449f92993d2dfd1416 (DEFAULT_TABLE table=test-table [id=e6cabf2475df4863902d3d6e3ef4c498]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:36:54.862041 28715 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3fcc47d3a8c74a449f92993d2dfd1416. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:36:54.863780 28571 tablet_service.cc:1467] Processing CreateTablet for tablet 3fcc47d3a8c74a449f92993d2dfd1416 (DEFAULT_TABLE table=test-table [id=e6cabf2475df4863902d3d6e3ef4c498]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:36:54.865099 28571 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3fcc47d3a8c74a449f92993d2dfd1416. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:36:54.870991 28813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:54.845537 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.65:42425 (local address 127.0.0.1:59322)
0807 10:36:54.854341 (+ 8804us) negotiation.cc:107] Waiting for socket to connect
0807 10:36:54.854356 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 10:36:54.854430 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:36:54.862575 (+ 8145us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:36:54.862580 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:36:54.862610 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:36:54.862787 (+ 177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:54.862798 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:54.865358 (+ 2560us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:54.865363 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:54.867197 (+ 1834us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:54.867214 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:54.870152 (+ 2938us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:54.870166 (+ 14us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:54.870409 (+ 243us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:54.870441 (+ 32us) client_negotiation.cc:769] Sending connection context
0807 10:36:54.870551 (+ 110us) client_negotiation.cc:240] Negotiation successful
0807 10:36:54.870699 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8717,"thread_start_us":10348,"threads_started":1}
I20260807 10:36:54.872223 28816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:54.845982 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59322 (local address 127.20.171.65:42425)
0807 10:36:54.861766 (+ 15784us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:54.861773 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:54.861821 (+ 48us) server_negotiation.cc:407] Connection header received
0807 10:36:54.861929 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:54.861937 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:54.862193 (+ 256us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:54.862566 (+ 373us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:36:54.863009 (+ 443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:54.865072 (+ 2063us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:54.867423 (+ 2351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:54.869982 (+ 2559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:54.870128 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:54.870439 (+ 311us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:54.871568 (+ 1129us) server_negotiation.cc:299] Negotiation successful
0807 10:36:54.871773 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15590,"thread_start_us":16729,"threads_started":1}
I20260807 10:36:54.877357 28428 tablet_service.cc:1467] Processing CreateTablet for tablet 3fcc47d3a8c74a449f92993d2dfd1416 (DEFAULT_TABLE table=test-table [id=e6cabf2475df4863902d3d6e3ef4c498]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:36:54.880014 28428 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3fcc47d3a8c74a449f92993d2dfd1416. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:36:54.881877 28817 tablet_bootstrap.cc:492] T 3fcc47d3a8c74a449f92993d2dfd1416 P 13625247901b4ad7a38dae319a093281: Bootstrap starting.
I20260807 10:36:54.888154 28817 tablet_bootstrap.cc:654] T 3fcc47d3a8c74a449f92993d2dfd1416 P 13625247901b4ad7a38dae319a093281: Neither blocks nor log segments found. Creating new log.
I20260807 10:36:54.890866 28817 log.cc:824] T 3fcc47d3a8c74a449f92993d2dfd1416 P 13625247901b4ad7a38dae319a093281: Log is configured to *not* fsync() on all Append() calls
I20260807 10:36:54.893472 28818 tablet_bootstrap.cc:492] T 3fcc47d3a8c74a449f92993d2dfd1416 P 0ee4d53fcb5c47acbc12ef3ba680766a: Bootstrap starting.
I20260807 10:36:54.899994 28817 tablet_bootstrap.cc:492] T 3fcc47d3a8c74a449f92993d2dfd1416 P 13625247901b4ad7a38dae319a093281: No bootstrap required, opened a new log
I20260807 10:36:54.900424 28817 ts_tablet_manager.cc:1397] T 3fcc47d3a8c74a449f92993d2dfd1416 P 13625247901b4ad7a38dae319a093281: Time spent bootstrapping tablet: real 0.019s user 0.002s sys 0.015s
I20260807 10:36:54.900936 28818 tablet_bootstrap.cc:654] T 3fcc47d3a8c74a449f92993d2dfd1416 P 0ee4d53fcb5c47acbc12ef3ba680766a: Neither blocks nor log segments found. Creating new log.
I20260807 10:36:54.903077 28818 log.cc:824] T 3fcc47d3a8c74a449f92993d2dfd1416 P 0ee4d53fcb5c47acbc12ef3ba680766a: Log is configured to *not* fsync() on all Append() calls
I20260807 10:36:54.907750 28821 tablet_bootstrap.cc:492] T 3fcc47d3a8c74a449f92993d2dfd1416 P c04827968c1b4c469f0b4cbf1bf63c3d: Bootstrap starting.
I20260807 10:36:54.907927 28818 tablet_bootstrap.cc:492] T 3fcc47d3a8c74a449f92993d2dfd1416 P 0ee4d53fcb5c47acbc12ef3ba680766a: No bootstrap required, opened a new log
I20260807 10:36:54.908344 28818 ts_tablet_manager.cc:1397] T 3fcc47d3a8c74a449f92993d2dfd1416 P 0ee4d53fcb5c47acbc12ef3ba680766a: Time spent bootstrapping tablet: real 0.015s user 0.004s sys 0.010s
I20260807 10:36:54.912202 28821 tablet_bootstrap.cc:654] T 3fcc47d3a8c74a449f92993d2dfd1416 P c04827968c1b4c469f0b4cbf1bf63c3d: Neither blocks nor log segments found. Creating new log.
I20260807 10:36:54.913892 28821 log.cc:824] T 3fcc47d3a8c74a449f92993d2dfd1416 P c04827968c1b4c469f0b4cbf1bf63c3d: Log is configured to *not* fsync() on all Append() calls
I20260807 10:36:54.915544 28817 raft_consensus.cc:348] T 3fcc47d3a8c74a449f92993d2dfd1416 P 13625247901b4ad7a38dae319a093281 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ee4d53fcb5c47acbc12ef3ba680766a" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 37807 } } peers { permanent_uuid: "c04827968c1b4c469f0b4cbf1bf63c3d" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 42425 } } peers { permanent_uuid: "13625247901b4ad7a38dae319a093281" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 45441 } }
I20260807 10:36:54.916227 28817 raft_consensus.cc:374] T 3fcc47d3a8c74a449f92993d2dfd1416 P 13625247901b4ad7a38dae319a093281 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:36:54.916425 28817 raft_consensus.cc:729] T 3fcc47d3a8c74a449f92993d2dfd1416 P 13625247901b4ad7a38dae319a093281 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13625247901b4ad7a38dae319a093281, State: Initialized, Role: FOLLOWER
I20260807 10:36:54.917654 28821 tablet_bootstrap.cc:492] T 3fcc47d3a8c74a449f92993d2dfd1416 P c04827968c1b4c469f0b4cbf1bf63c3d: No bootstrap required, opened a new log
I20260807 10:36:54.917346 28817 consensus_queue.cc:260] T 3fcc47d3a8c74a449f92993d2dfd1416 P 13625247901b4ad7a38dae319a093281 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ee4d53fcb5c47acbc12ef3ba680766a" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 37807 } } peers { permanent_uuid: "c04827968c1b4c469f0b4cbf1bf63c3d" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 42425 } } peers { permanent_uuid: "13625247901b4ad7a38dae319a093281" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 45441 } }
I20260807 10:36:54.918038 28821 ts_tablet_manager.cc:1397] T 3fcc47d3a8c74a449f92993d2dfd1416 P c04827968c1b4c469f0b4cbf1bf63c3d: Time spent bootstrapping tablet: real 0.011s user 0.001s sys 0.008s
I20260807 10:36:54.919883 28817 ts_tablet_manager.cc:1428] T 3fcc47d3a8c74a449f92993d2dfd1416 P 13625247901b4ad7a38dae319a093281: Time spent starting tablet: real 0.019s user 0.015s sys 0.003s
I20260807 10:36:54.920583 28639 heartbeater.cc:503] Master 127.20.171.126:45569 was elected leader, sending a full tablet report...
I20260807 10:36:54.929392 28818 raft_consensus.cc:348] T 3fcc47d3a8c74a449f92993d2dfd1416 P 0ee4d53fcb5c47acbc12ef3ba680766a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ee4d53fcb5c47acbc12ef3ba680766a" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 37807 } } peers { permanent_uuid: "c04827968c1b4c469f0b4cbf1bf63c3d" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 42425 } } peers { permanent_uuid: "13625247901b4ad7a38dae319a093281" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 45441 } }
I20260807 10:36:54.929935 28818 raft_consensus.cc:374] T 3fcc47d3a8c74a449f92993d2dfd1416 P 0ee4d53fcb5c47acbc12ef3ba680766a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:36:54.930073 28818 raft_consensus.cc:729] T 3fcc47d3a8c74a449f92993d2dfd1416 P 0ee4d53fcb5c47acbc12ef3ba680766a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ee4d53fcb5c47acbc12ef3ba680766a, State: Initialized, Role: FOLLOWER
I20260807 10:36:54.930749 28818 consensus_queue.cc:260] T 3fcc47d3a8c74a449f92993d2dfd1416 P 0ee4d53fcb5c47acbc12ef3ba680766a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ee4d53fcb5c47acbc12ef3ba680766a" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 37807 } } peers { permanent_uuid: "c04827968c1b4c469f0b4cbf1bf63c3d" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 42425 } } peers { permanent_uuid: "13625247901b4ad7a38dae319a093281" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 45441 } }
I20260807 10:36:54.931329 28821 raft_consensus.cc:348] T 3fcc47d3a8c74a449f92993d2dfd1416 P c04827968c1b4c469f0b4cbf1bf63c3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ee4d53fcb5c47acbc12ef3ba680766a" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 37807 } } peers { permanent_uuid: "c04827968c1b4c469f0b4cbf1bf63c3d" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 42425 } } peers { permanent_uuid: "13625247901b4ad7a38dae319a093281" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 45441 } }
I20260807 10:36:54.931802 28821 raft_consensus.cc:374] T 3fcc47d3a8c74a449f92993d2dfd1416 P c04827968c1b4c469f0b4cbf1bf63c3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:36:54.931932 28821 raft_consensus.cc:729] T 3fcc47d3a8c74a449f92993d2dfd1416 P c04827968c1b4c469f0b4cbf1bf63c3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c04827968c1b4c469f0b4cbf1bf63c3d, State: Initialized, Role: FOLLOWER
I20260807 10:36:54.932549 28783 heartbeater.cc:503] Master 127.20.171.126:45569 was elected leader, sending a full tablet report...
I20260807 10:36:54.933174 28818 ts_tablet_manager.cc:1428] T 3fcc47d3a8c74a449f92993d2dfd1416 P 0ee4d53fcb5c47acbc12ef3ba680766a: Time spent starting tablet: real 0.025s user 0.004s sys 0.014s
I20260807 10:36:54.933701 28821 consensus_queue.cc:260] T 3fcc47d3a8c74a449f92993d2dfd1416 P c04827968c1b4c469f0b4cbf1bf63c3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ee4d53fcb5c47acbc12ef3ba680766a" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 37807 } } peers { permanent_uuid: "c04827968c1b4c469f0b4cbf1bf63c3d" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 42425 } } peers { permanent_uuid: "13625247901b4ad7a38dae319a093281" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 45441 } }
I20260807 10:36:54.938916 28821 ts_tablet_manager.cc:1428] T 3fcc47d3a8c74a449f92993d2dfd1416 P c04827968c1b4c469f0b4cbf1bf63c3d: Time spent starting tablet: real 0.021s user 0.005s sys 0.013s
W20260807 10:36:54.976998 28785 tablet.cc:2369] T 3fcc47d3a8c74a449f92993d2dfd1416 P 0ee4d53fcb5c47acbc12ef3ba680766a: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 10:36:55.108778 28648 tablet.cc:2369] T 3fcc47d3a8c74a449f92993d2dfd1416 P 13625247901b4ad7a38dae319a093281: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 10:36:55.186915 28498 tablet.cc:2369] T 3fcc47d3a8c74a449f92993d2dfd1416 P c04827968c1b4c469f0b4cbf1bf63c3d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 10:36:55.211350 28825 raft_consensus.cc:482] T 3fcc47d3a8c74a449f92993d2dfd1416 P c04827968c1b4c469f0b4cbf1bf63c3d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 10:36:55.211784 28825 raft_consensus.cc:504] T 3fcc47d3a8c74a449f92993d2dfd1416 P c04827968c1b4c469f0b4cbf1bf63c3d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ee4d53fcb5c47acbc12ef3ba680766a" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 37807 } } peers { permanent_uuid: "c04827968c1b4c469f0b4cbf1bf63c3d" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 42425 } } peers { permanent_uuid: "13625247901b4ad7a38dae319a093281" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 45441 } }
I20260807 10:36:55.214283 28825 leader_election.cc:288] T 3fcc47d3a8c74a449f92993d2dfd1416 P c04827968c1b4c469f0b4cbf1bf63c3d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ee4d53fcb5c47acbc12ef3ba680766a (127.20.171.67:37807), 13625247901b4ad7a38dae319a093281 (127.20.171.66:45441)
I20260807 10:36:55.225824 28812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:55.214847 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.65:44069 (local address 127.20.171.67:37807)
0807 10:36:55.215147 (+ 300us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:55.215152 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:55.216630 (+ 1478us) server_negotiation.cc:407] Connection header received
0807 10:36:55.216901 (+ 271us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:55.216907 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:55.216981 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:55.217071 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:36:55.218381 (+ 1310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:55.219757 (+ 1376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:55.222859 (+ 3102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:55.224492 (+ 1633us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:55.224692 (+ 200us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:55.224771 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:55.225257 (+ 486us) server_negotiation.cc:299] Negotiation successful
0807 10:36:55.225386 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":182}
I20260807 10:36:55.226261 28827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:55.214305 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.67:37807 (local address 127.20.171.65:44069)
0807 10:36:55.216467 (+ 2162us) negotiation.cc:107] Waiting for socket to connect
0807 10:36:55.216484 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 10:36:55.216739 (+ 255us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:36:55.217111 (+ 372us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:36:55.217116 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:36:55.217142 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:36:55.218142 (+ 1000us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:55.218158 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:55.219972 (+ 1814us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:55.219977 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:55.222678 (+ 2701us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:55.222690 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:55.224831 (+ 2141us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:55.224838 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:55.225086 (+ 248us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:55.225120 (+ 34us) client_negotiation.cc:769] Sending connection context
0807 10:36:55.225215 (+ 95us) client_negotiation.cc:240] Negotiation successful
0807 10:36:55.225345 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1741,"mutex_wait_us":2,"thread_start_us":1831,"threads_started":1}
I20260807 10:36:55.226904 28814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:55.214816 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.65:53429 (local address 127.20.171.66:45441)
0807 10:36:55.215005 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:55.215010 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:55.216644 (+ 1634us) server_negotiation.cc:407] Connection header received
0807 10:36:55.216948 (+ 304us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:55.216954 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:55.217051 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:55.217133 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:36:55.218245 (+ 1112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:55.219698 (+ 1453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:55.223269 (+ 3571us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:55.225142 (+ 1873us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:55.225344 (+ 202us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:55.225407 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:55.226368 (+ 961us) server_negotiation.cc:299] Negotiation successful
0807 10:36:55.226503 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260807 10:36:55.227913 28826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:55.214432 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.66:45441 (local address 127.20.171.65:53429)
0807 10:36:55.216525 (+ 2093us) negotiation.cc:107] Waiting for socket to connect
0807 10:36:55.216560 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0807 10:36:55.216773 (+ 213us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:36:55.217357 (+ 584us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:36:55.217361 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:36:55.217390 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:36:55.218056 (+ 666us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:55.218067 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:55.219897 (+ 1830us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:55.219902 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:55.223067 (+ 3165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:55.223082 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:55.225848 (+ 2766us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:55.225859 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:55.226146 (+ 287us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:55.226210 (+ 64us) client_negotiation.cc:769] Sending connection context
0807 10:36:55.227101 (+ 891us) client_negotiation.cc:240] Negotiation successful
0807 10:36:55.227219 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1952,"mutex_wait_us":26,"spinlock_wait_cycles":6912,"thread_start_us":1091,"threads_started":1}
I20260807 10:36:55.227783 28737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3fcc47d3a8c74a449f92993d2dfd1416" candidate_uuid: "c04827968c1b4c469f0b4cbf1bf63c3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ee4d53fcb5c47acbc12ef3ba680766a" is_pre_election: true
I20260807 10:36:55.228729 28737 raft_consensus.cc:2454] T 3fcc47d3a8c74a449f92993d2dfd1416 P 0ee4d53fcb5c47acbc12ef3ba680766a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c04827968c1b4c469f0b4cbf1bf63c3d in term 0.
I20260807 10:36:55.229635 28380 leader_election.cc:302] T 3fcc47d3a8c74a449f92993d2dfd1416 P c04827968c1b4c469f0b4cbf1bf63c3d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ee4d53fcb5c47acbc12ef3ba680766a, c04827968c1b4c469f0b4cbf1bf63c3d; no voters:
I20260807 10:36:55.229548 28592 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3fcc47d3a8c74a449f92993d2dfd1416" candidate_uuid: "c04827968c1b4c469f0b4cbf1bf63c3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13625247901b4ad7a38dae319a093281" is_pre_election: true
I20260807 10:36:55.230263 28825 raft_consensus.cc:2781] T 3fcc47d3a8c74a449f92993d2dfd1416 P c04827968c1b4c469f0b4cbf1bf63c3d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 10:36:55.230527 28825 raft_consensus.cc:482] T 3fcc47d3a8c74a449f92993d2dfd1416 P c04827968c1b4c469f0b4cbf1bf63c3d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 10:36:55.230472 28592 raft_consensus.cc:2454] T 3fcc47d3a8c74a449f92993d2dfd1416 P 13625247901b4ad7a38dae319a093281 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c04827968c1b4c469f0b4cbf1bf63c3d in term 0.
I20260807 10:36:55.230710 28825 raft_consensus.cc:3037] T 3fcc47d3a8c74a449f92993d2dfd1416 P c04827968c1b4c469f0b4cbf1bf63c3d [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:36:55.233902 28825 raft_consensus.cc:504] T 3fcc47d3a8c74a449f92993d2dfd1416 P c04827968c1b4c469f0b4cbf1bf63c3d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ee4d53fcb5c47acbc12ef3ba680766a" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 37807 } } peers { permanent_uuid: "c04827968c1b4c469f0b4cbf1bf63c3d" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 42425 } } peers { permanent_uuid: "13625247901b4ad7a38dae319a093281" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 45441 } }
I20260807 10:36:55.234730 28825 leader_election.cc:288] T 3fcc47d3a8c74a449f92993d2dfd1416 P c04827968c1b4c469f0b4cbf1bf63c3d [CANDIDATE]: Term 1 election: Requested vote from peers 0ee4d53fcb5c47acbc12ef3ba680766a (127.20.171.67:37807), 13625247901b4ad7a38dae319a093281 (127.20.171.66:45441)
I20260807 10:36:55.235291 28737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3fcc47d3a8c74a449f92993d2dfd1416" candidate_uuid: "c04827968c1b4c469f0b4cbf1bf63c3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ee4d53fcb5c47acbc12ef3ba680766a"
I20260807 10:36:55.235317 28592 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3fcc47d3a8c74a449f92993d2dfd1416" candidate_uuid: "c04827968c1b4c469f0b4cbf1bf63c3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13625247901b4ad7a38dae319a093281"
I20260807 10:36:55.235524 28592 raft_consensus.cc:3037] T 3fcc47d3a8c74a449f92993d2dfd1416 P 13625247901b4ad7a38dae319a093281 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:36:55.235534 28737 raft_consensus.cc:3037] T 3fcc47d3a8c74a449f92993d2dfd1416 P 0ee4d53fcb5c47acbc12ef3ba680766a [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:36:55.240123 28592 raft_consensus.cc:2454] T 3fcc47d3a8c74a449f92993d2dfd1416 P 13625247901b4ad7a38dae319a093281 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c04827968c1b4c469f0b4cbf1bf63c3d in term 1.
I20260807 10:36:55.240151 28737 raft_consensus.cc:2454] T 3fcc47d3a8c74a449f92993d2dfd1416 P 0ee4d53fcb5c47acbc12ef3ba680766a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c04827968c1b4c469f0b4cbf1bf63c3d in term 1.
I20260807 10:36:55.240651 28380 leader_election.cc:302] T 3fcc47d3a8c74a449f92993d2dfd1416 P c04827968c1b4c469f0b4cbf1bf63c3d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ee4d53fcb5c47acbc12ef3ba680766a, c04827968c1b4c469f0b4cbf1bf63c3d; no voters:
I20260807 10:36:55.241056 28825 raft_consensus.cc:2781] T 3fcc47d3a8c74a449f92993d2dfd1416 P c04827968c1b4c469f0b4cbf1bf63c3d [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:36:55.241700 28825 raft_consensus.cc:686] T 3fcc47d3a8c74a449f92993d2dfd1416 P c04827968c1b4c469f0b4cbf1bf63c3d [term 1 LEADER]: Becoming Leader. State: Replica: c04827968c1b4c469f0b4cbf1bf63c3d, State: Running, Role: LEADER
I20260807 10:36:55.242625 28825 consensus_queue.cc:237] T 3fcc47d3a8c74a449f92993d2dfd1416 P c04827968c1b4c469f0b4cbf1bf63c3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ee4d53fcb5c47acbc12ef3ba680766a" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 37807 } } peers { permanent_uuid: "c04827968c1b4c469f0b4cbf1bf63c3d" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 42425 } } peers { permanent_uuid: "13625247901b4ad7a38dae319a093281" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 45441 } }
I20260807 10:36:55.249251 27486 catalog_manager.cc:5495] T 3fcc47d3a8c74a449f92993d2dfd1416 P c04827968c1b4c469f0b4cbf1bf63c3d reported cstate change: term changed from 0 to 1, leader changed from <none> to c04827968c1b4c469f0b4cbf1bf63c3d (127.20.171.65). New cstate: current_term: 1 leader_uuid: "c04827968c1b4c469f0b4cbf1bf63c3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ee4d53fcb5c47acbc12ef3ba680766a" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 37807 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c04827968c1b4c469f0b4cbf1bf63c3d" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 42425 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "13625247901b4ad7a38dae319a093281" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 45441 } health_report { overall_health: UNKNOWN } } }
I20260807 10:36:55.311411 28816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:55.306153 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59338 (local address 127.20.171.65:42425)
0807 10:36:55.306387 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:55.306391 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:55.306647 (+ 256us) server_negotiation.cc:407] Connection header received
0807 10:36:55.306844 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:55.306848 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:55.306938 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:55.307063 (+ 125us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 10:36:55.307429 (+ 366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:55.308108 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:55.309556 (+ 1448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:55.309920 (+ 364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:55.310010 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:55.310405 (+ 395us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 10:36:55.310862 (+ 457us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 10:36:55.310963 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:55.311069 (+ 106us) server_negotiation.cc:299] Negotiation successful
0807 10:36:55.311130 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":93}
I20260807 10:36:55.320582 28592 raft_consensus.cc:1261] T 3fcc47d3a8c74a449f92993d2dfd1416 P 13625247901b4ad7a38dae319a093281 [term 1 FOLLOWER]: Refusing update from remote peer c04827968c1b4c469f0b4cbf1bf63c3d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 10:36:55.320636 28737 raft_consensus.cc:1261] T 3fcc47d3a8c74a449f92993d2dfd1416 P 0ee4d53fcb5c47acbc12ef3ba680766a [term 1 FOLLOWER]: Refusing update from remote peer c04827968c1b4c469f0b4cbf1bf63c3d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 10:36:55.321786 28828 consensus_queue.cc:1035] T 3fcc47d3a8c74a449f92993d2dfd1416 P c04827968c1b4c469f0b4cbf1bf63c3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ee4d53fcb5c47acbc12ef3ba680766a" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 37807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 10:36:55.322366 28825 consensus_queue.cc:1035] T 3fcc47d3a8c74a449f92993d2dfd1416 P c04827968c1b4c469f0b4cbf1bf63c3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "13625247901b4ad7a38dae319a093281" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 45441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 10:36:55.336032 28833 mvcc.cc:205] Tried to move back new op lower bound from 7315861566742728704 to 7315861566438735872. Current Snapshot: MvccSnapshot[applied={T|T < 7315861566742728704}]
I20260807 10:36:55.340368 28835 mvcc.cc:205] Tried to move back new op lower bound from 7315861566742728704 to 7315861566438735872. Current Snapshot: MvccSnapshot[applied={T|T < 7315861566742728704}]
I20260807 10:36:55.357788 27486 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37376:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 10:36:55.358274 27486 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37376:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 10:36:55.366154 27486 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a3ba955fde1542b8a0187d9fd7a0052c: Sending DeleteTablet for 3 replicas of tablet 3fcc47d3a8c74a449f92993d2dfd1416
I20260807 10:36:55.367432 28715 tablet_service.cc:1514] Processing DeleteTablet for tablet 3fcc47d3a8c74a449f92993d2dfd1416 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:36:55 UTC) from {username='oryx', principal='oryx/127.20.171.126@KRBTEST.COM'} at 127.0.0.1:59288
I20260807 10:36:55.367579 28428 tablet_service.cc:1514] Processing DeleteTablet for tablet 3fcc47d3a8c74a449f92993d2dfd1416 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:36:55 UTC) from {username='oryx', principal='oryx/127.20.171.126@KRBTEST.COM'} at 127.0.0.1:59322
I20260807 10:36:55.367961 28571 tablet_service.cc:1514] Processing DeleteTablet for tablet 3fcc47d3a8c74a449f92993d2dfd1416 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:36:55 UTC) from {username='oryx', principal='oryx/127.20.171.126@KRBTEST.COM'} at 127.0.0.1:33432
I20260807 10:36:55.368993 28843 tablet_replica.cc:330] T 3fcc47d3a8c74a449f92993d2dfd1416 P 0ee4d53fcb5c47acbc12ef3ba680766a: stopping tablet replica
I20260807 10:36:55.369511 28843 raft_consensus.cc:2229] T 3fcc47d3a8c74a449f92993d2dfd1416 P 0ee4d53fcb5c47acbc12ef3ba680766a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 10:36:55.370525 28843 raft_consensus.cc:2258] T 3fcc47d3a8c74a449f92993d2dfd1416 P 0ee4d53fcb5c47acbc12ef3ba680766a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:36:55.373230 28843 ts_tablet_manager.cc:1905] T 3fcc47d3a8c74a449f92993d2dfd1416 P 0ee4d53fcb5c47acbc12ef3ba680766a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 10:36:55.378166 28844 tablet_replica.cc:330] T 3fcc47d3a8c74a449f92993d2dfd1416 P c04827968c1b4c469f0b4cbf1bf63c3d: stopping tablet replica
I20260807 10:36:55.379846 28844 raft_consensus.cc:2229] T 3fcc47d3a8c74a449f92993d2dfd1416 P c04827968c1b4c469f0b4cbf1bf63c3d [term 1 LEADER]: Raft consensus shutting down.
I20260807 10:36:55.381285 28844 raft_consensus.cc:2258] T 3fcc47d3a8c74a449f92993d2dfd1416 P c04827968c1b4c469f0b4cbf1bf63c3d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:36:55.383898 28843 ts_tablet_manager.cc:1918] T 3fcc47d3a8c74a449f92993d2dfd1416 P 0ee4d53fcb5c47acbc12ef3ba680766a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 10:36:55.384086 28844 ts_tablet_manager.cc:1905] T 3fcc47d3a8c74a449f92993d2dfd1416 P c04827968c1b4c469f0b4cbf1bf63c3d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 10:36:55.384204 28843 log.cc:1196] T 3fcc47d3a8c74a449f92993d2dfd1416 P 0ee4d53fcb5c47acbc12ef3ba680766a: Deleting WAL directory at /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/ts-2/wal/wals/3fcc47d3a8c74a449f92993d2dfd1416
I20260807 10:36:55.384999 28843 ts_tablet_manager.cc:1939] T 3fcc47d3a8c74a449f92993d2dfd1416 P 0ee4d53fcb5c47acbc12ef3ba680766a: Deleting consensus metadata
I20260807 10:36:55.385856 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 27455
I20260807 10:36:55.387127 27520 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:36:55.387355 27471 catalog_manager.cc:4841] TS 0ee4d53fcb5c47acbc12ef3ba680766a (127.20.171.67:37807): tablet 3fcc47d3a8c74a449f92993d2dfd1416 (table test-table [id=e6cabf2475df4863902d3d6e3ef4c498]) successfully deleted
I20260807 10:36:55.417048 28847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:55.370977 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41924 (local address 127.20.171.125:41963)
0807 10:36:55.382067 (+ 11090us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:55.382072 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:55.382091 (+ 19us) server_negotiation.cc:407] Connection header received
0807 10:36:55.382476 (+ 385us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:55.382486 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:55.382620 (+ 134us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:55.382743 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:36:55.386935 (+ 4192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:55.388702 (+ 1767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:55.391538 (+ 2836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:55.392530 (+ 992us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:55.393231 (+ 701us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:55.404744 (+ 11513us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:36:55.404753 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:36:55.404759 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:36:55.404808 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:36:55.410668 (+ 5860us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:55.412375 (+ 1707us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:55.412384 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:55.412390 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:55.412634 (+ 244us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:55.413278 (+ 644us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:55.413286 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:55.413292 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:55.413881 (+ 589us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:36:55.414247 (+ 366us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:55.416018 (+ 1771us) server_negotiation.cc:299] Negotiation successful
0807 10:36:55.416333 (+ 315us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10948,"thread_start_us":10806,"threads_started":1}
I20260807 10:36:55.417981 28845 tablet_replica.cc:330] T 3fcc47d3a8c74a449f92993d2dfd1416 P 13625247901b4ad7a38dae319a093281: stopping tablet replica
I20260807 10:36:55.418574 28845 raft_consensus.cc:2229] T 3fcc47d3a8c74a449f92993d2dfd1416 P 13625247901b4ad7a38dae319a093281 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 10:36:55.419199 28844 ts_tablet_manager.cc:1918] T 3fcc47d3a8c74a449f92993d2dfd1416 P c04827968c1b4c469f0b4cbf1bf63c3d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 10:36:55.419581 28844 log.cc:1196] T 3fcc47d3a8c74a449f92993d2dfd1416 P c04827968c1b4c469f0b4cbf1bf63c3d: Deleting WAL directory at /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/ts-0/wal/wals/3fcc47d3a8c74a449f92993d2dfd1416
I20260807 10:36:55.419920 28845 raft_consensus.cc:2258] T 3fcc47d3a8c74a449f92993d2dfd1416 P 13625247901b4ad7a38dae319a093281 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:36:55.420564 28844 ts_tablet_manager.cc:1939] T 3fcc47d3a8c74a449f92993d2dfd1416 P c04827968c1b4c469f0b4cbf1bf63c3d: Deleting consensus metadata
I20260807 10:36:55.427968 28845 ts_tablet_manager.cc:1905] T 3fcc47d3a8c74a449f92993d2dfd1416 P 13625247901b4ad7a38dae319a093281: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 10:36:55.444495 28845 ts_tablet_manager.cc:1918] T 3fcc47d3a8c74a449f92993d2dfd1416 P 13625247901b4ad7a38dae319a093281: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 10:36:55.444855 28845 log.cc:1196] T 3fcc47d3a8c74a449f92993d2dfd1416 P 13625247901b4ad7a38dae319a093281: Deleting WAL directory at /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/ts-1/wal/wals/3fcc47d3a8c74a449f92993d2dfd1416
I20260807 10:36:55.445773 28845 ts_tablet_manager.cc:1939] T 3fcc47d3a8c74a449f92993d2dfd1416 P 13625247901b4ad7a38dae319a093281: Deleting consensus metadata
I20260807 10:36:55.456175 28848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:55.382154 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35416 (local address 127.20.171.124:42363)
0807 10:36:55.404389 (+ 22235us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:55.404396 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:55.419206 (+ 14810us) server_negotiation.cc:407] Connection header received
0807 10:36:55.419501 (+ 295us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:55.419507 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:55.419605 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:55.419723 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:36:55.422880 (+ 3157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:55.425018 (+ 2138us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:55.429793 (+ 4775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:55.431251 (+ 1458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:55.431387 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:55.447340 (+ 15953us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:36:55.447350 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:36:55.447355 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:36:55.447415 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:36:55.452109 (+ 4694us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:55.453367 (+ 1258us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:55.453373 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:55.453377 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:55.453593 (+ 216us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:55.454213 (+ 620us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:55.454219 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:55.454223 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:55.454704 (+ 481us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:36:55.455195 (+ 491us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:55.455496 (+ 301us) server_negotiation.cc:299] Negotiation successful
0807 10:36:55.455752 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21993,"thread_start_us":22263,"threads_started":1}
I20260807 10:36:55.550241 27471 catalog_manager.cc:4841] TS c04827968c1b4c469f0b4cbf1bf63c3d (127.20.171.65:42425): tablet 3fcc47d3a8c74a449f92993d2dfd1416 (table test-table [id=e6cabf2475df4863902d3d6e3ef4c498]) successfully deleted
I20260807 10:36:55.550241 27473 catalog_manager.cc:4841] TS 13625247901b4ad7a38dae319a093281 (127.20.171.66:45441): tablet 3fcc47d3a8c74a449f92993d2dfd1416 (table test-table [id=e6cabf2475df4863902d3d6e3ef4c498]) successfully deleted
I20260807 10:36:55.553339 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 27455
I20260807 10:36:55.611706 28847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:55.590754 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41930 (local address 127.20.171.125:41963)
0807 10:36:55.590942 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:55.590948 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:55.594684 (+ 3736us) server_negotiation.cc:407] Connection header received
0807 10:36:55.595146 (+ 462us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:55.595152 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:55.595232 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:55.595304 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:36:55.597710 (+ 2406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:55.598800 (+ 1090us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:55.601233 (+ 2433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:55.601803 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:55.601935 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:55.605743 (+ 3808us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:36:55.605750 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:36:55.605755 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:36:55.605797 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:36:55.608938 (+ 3141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:55.609574 (+ 636us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:55.609579 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:55.609582 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:55.609705 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:55.610075 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:55.610080 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:55.610083 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:55.610412 (+ 329us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:36:55.610694 (+ 282us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:55.611122 (+ 428us) server_negotiation.cc:299] Negotiation successful
0807 10:36:55.611357 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260807 10:36:55.613581 28848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:55.591258 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35422 (local address 127.20.171.124:42363)
0807 10:36:55.593214 (+ 1956us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:55.593222 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:55.593598 (+ 376us) server_negotiation.cc:407] Connection header received
0807 10:36:55.593874 (+ 276us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:55.593883 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:55.593995 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:55.594128 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:36:55.597610 (+ 3482us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:55.599037 (+ 1427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:55.601540 (+ 2503us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:55.602192 (+ 652us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:55.602324 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:55.606572 (+ 4248us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:36:55.606579 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:36:55.606585 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:36:55.606628 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:36:55.609957 (+ 3329us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:55.610843 (+ 886us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:55.610849 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:55.610852 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:55.611055 (+ 203us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:55.611525 (+ 470us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:55.611530 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:55.611533 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:55.611866 (+ 333us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:36:55.612295 (+ 429us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:55.612857 (+ 562us) server_negotiation.cc:299] Negotiation successful
0807 10:36:55.613257 (+ 400us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1772}
I20260807 10:36:56.346429 28858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:56.345440 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:45569 (local address 127.20.171.67:41819)
0807 10:36:56.346034 (+ 594us) negotiation.cc:107] Waiting for socket to connect
0807 10:36:56.346170 (+ 136us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.126:45569: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":473,"thread_start_us":359,"threads_started":1}
W20260807 10:36:56.347071 28783 heartbeater.cc:644] Failed to heartbeat to 127.20.171.126:45569 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.20.171.126:45569: connect: Connection refused (error 111)
I20260807 10:36:56.347741 28859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:56.346633 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:45569 (local address 127.20.171.65:43671)
0807 10:36:56.347462 (+ 829us) negotiation.cc:107] Waiting for socket to connect
0807 10:36:56.347583 (+ 121us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.126:45569: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":667,"thread_start_us":426,"threads_started":1}
W20260807 10:36:56.348098 28496 heartbeater.cc:644] Failed to heartbeat to 127.20.171.126:45569 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.20.171.126:45569: connect: Connection refused (error 111)
I20260807 10:36:56.353446 28860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:56.352795 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:45569 (local address 127.20.171.66:39201)
0807 10:36:56.353193 (+ 398us) negotiation.cc:107] Waiting for socket to connect
0807 10:36:56.353298 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.126:45569: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":309,"thread_start_us":206,"threads_started":1}
W20260807 10:36:56.353837 28639 heartbeater.cc:644] Failed to heartbeat to 127.20.171.126:45569 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.20.171.126:45569: connect: Connection refused (error 111)
I20260807 10:36:56.865808 28861 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9d9adcde3d254acda7f28fb66fbc417c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a3ba955fde1542b8a0187d9fd7a0052c)
I20260807 10:36:56.866226 28862 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7cb70b70a1944a069f2e1ef2c66c7b19 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a3ba955fde1542b8a0187d9fd7a0052c)
I20260807 10:36:56.866122 28861 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9d9adcde3d254acda7f28fb66fbc417c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "a3ba955fde1542b8a0187d9fd7a0052c" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 45569 } } peers { permanent_uuid: "9d9adcde3d254acda7f28fb66fbc417c" member_type: VOTER last_known_addr { host: "127.20.171.125" port: 41963 } attrs { promote: false } } peers { permanent_uuid: "7cb70b70a1944a069f2e1ef2c66c7b19" member_type: VOTER last_known_addr { host: "127.20.171.124" port: 42363 } attrs { promote: false } }
I20260807 10:36:56.866432 28862 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7cb70b70a1944a069f2e1ef2c66c7b19 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "a3ba955fde1542b8a0187d9fd7a0052c" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 45569 } } peers { permanent_uuid: "9d9adcde3d254acda7f28fb66fbc417c" member_type: VOTER last_known_addr { host: "127.20.171.125" port: 41963 } attrs { promote: false } } peers { permanent_uuid: "7cb70b70a1944a069f2e1ef2c66c7b19" member_type: VOTER last_known_addr { host: "127.20.171.124" port: 42363 } attrs { promote: false } }
I20260807 10:36:56.867276 28862 leader_election.cc:288] T 00000000000000000000000000000000 P 7cb70b70a1944a069f2e1ef2c66c7b19 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a3ba955fde1542b8a0187d9fd7a0052c (127.20.171.126:45569), 9d9adcde3d254acda7f28fb66fbc417c (127.20.171.125:41963)
I20260807 10:36:56.867676 28861 leader_election.cc:288] T 00000000000000000000000000000000 P 9d9adcde3d254acda7f28fb66fbc417c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a3ba955fde1542b8a0187d9fd7a0052c (127.20.171.126:45569), 7cb70b70a1944a069f2e1ef2c66c7b19 (127.20.171.124:42363)
I20260807 10:36:56.880916 28863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:56.867462 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:45569 (local address 127.0.0.1:37746)
0807 10:36:56.880422 (+ 12960us) negotiation.cc:107] Waiting for socket to connect
0807 10:36:56.880626 (+ 204us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.126:45569: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":12773,"thread_start_us":12611,"threads_started":1}
W20260807 10:36:56.881407 28290 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.171.126:45569: connect: Connection refused (error 111)
I20260807 10:36:56.882968 28865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:56.867784 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:45569 (local address 127.0.0.1:37754)
0807 10:36:56.880840 (+ 13056us) negotiation.cc:107] Waiting for socket to connect
0807 10:36:56.882566 (+ 1726us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.126:45569: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":12906,"thread_start_us":12700,"threads_started":1}
W20260807 10:36:56.884622 28089 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.171.126:45569: connect: Connection refused (error 111)
I20260807 10:36:56.886014 28864 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:56.885181 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:45569 (local address 127.0.0.1:37768)
0807 10:36:56.885390 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0807 10:36:56.885693 (+ 303us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.126:45569: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260807 10:36:56.886520 28290 leader_election.cc:334] T 00000000000000000000000000000000 P 7cb70b70a1944a069f2e1ef2c66c7b19 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a3ba955fde1542b8a0187d9fd7a0052c (127.20.171.126:45569): Network error: Client connection negotiation failed: client connection to 127.20.171.126:45569: connect: Connection refused (error 111)
I20260807 10:36:56.891222 28866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:56.890568 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:45569 (local address 127.0.0.1:37788)
0807 10:36:56.890763 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0807 10:36:56.891011 (+ 248us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.126:45569: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260807 10:36:56.891511 28089 leader_election.cc:334] T 00000000000000000000000000000000 P 9d9adcde3d254acda7f28fb66fbc417c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a3ba955fde1542b8a0187d9fd7a0052c (127.20.171.126:45569): Network error: Client connection negotiation failed: client connection to 127.20.171.126:45569: connect: Connection refused (error 111)
I20260807 10:36:56.893141 28865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:56.868107 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.124:42363 (local address 127.0.0.1:35426)
0807 10:36:56.883246 (+ 15139us) negotiation.cc:107] Waiting for socket to connect
0807 10:36:56.883265 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 10:36:56.883589 (+ 324us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:36:56.884531 (+ 942us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:36:56.884539 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:36:56.884580 (+ 41us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:36:56.884943 (+ 363us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:56.884960 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:56.887205 (+ 2245us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:56.887213 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:56.890961 (+ 3748us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:56.890978 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:56.892591 (+ 1613us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:56.892596 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:56.892725 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:56.892749 (+ 24us) client_negotiation.cc:769] Sending connection context
0807 10:36:56.892826 (+ 77us) client_negotiation.cc:240] Negotiation successful
0807 10:36:56.892917 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":15048,"mutex_wait_us":47,"thread_start_us":19778,"threads_started":1}
I20260807 10:36:56.893384 28867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:56.871333 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35426 (local address 127.20.171.124:42363)
0807 10:36:56.878397 (+ 7064us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:56.878407 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:56.883519 (+ 5112us) server_negotiation.cc:407] Connection header received
0807 10:36:56.883703 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:56.883709 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:56.883780 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:56.884083 (+ 303us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:36:56.885207 (+ 1124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:56.886955 (+ 1748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:56.891102 (+ 4147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:56.892452 (+ 1350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:56.892594 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:56.892665 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:56.892888 (+ 223us) server_negotiation.cc:299] Negotiation successful
0807 10:36:56.893027 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":98,"server-negotiator.queue_time_us":6878,"thread_start_us":6662,"threads_started":1}
I20260807 10:36:56.893935 28317 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "9d9adcde3d254acda7f28fb66fbc417c" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "7cb70b70a1944a069f2e1ef2c66c7b19" is_pre_election: true
I20260807 10:36:56.894268 28317 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 7cb70b70a1944a069f2e1ef2c66c7b19 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d9adcde3d254acda7f28fb66fbc417c in term 1.
I20260807 10:36:56.894793 28091 leader_election.cc:302] T 00000000000000000000000000000000 P 9d9adcde3d254acda7f28fb66fbc417c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7cb70b70a1944a069f2e1ef2c66c7b19, 9d9adcde3d254acda7f28fb66fbc417c; no voters: a3ba955fde1542b8a0187d9fd7a0052c
I20260807 10:36:56.895278 28861 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9d9adcde3d254acda7f28fb66fbc417c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 10:36:56.895411 28863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:56.867531 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.125:41963 (local address 127.0.0.1:41934)
0807 10:36:56.881229 (+ 13698us) negotiation.cc:107] Waiting for socket to connect
0807 10:36:56.881252 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0807 10:36:56.881449 (+ 197us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:36:56.883038 (+ 1589us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:36:56.883043 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:36:56.883073 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:36:56.883344 (+ 271us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:56.883378 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:56.890963 (+ 7585us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:56.890970 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:56.893075 (+ 2105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:56.893088 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:56.894681 (+ 1593us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:56.894696 (+ 15us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:56.894821 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:56.894844 (+ 23us) client_negotiation.cc:769] Sending connection context
0807 10:36:56.894942 (+ 98us) client_negotiation.cc:240] Negotiation successful
0807 10:36:56.895092 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13554,"mutex_wait_us":73,"thread_start_us":14394,"threads_started":1}
I20260807 10:36:56.895460 28861 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9d9adcde3d254acda7f28fb66fbc417c [term 1 FOLLOWER]: Starting leader election (detected failure of leader a3ba955fde1542b8a0187d9fd7a0052c)
I20260807 10:36:56.895567 28861 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9d9adcde3d254acda7f28fb66fbc417c [term 1 FOLLOWER]: Advancing to term 2
I20260807 10:36:56.895707 28868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:56.880794 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41934 (local address 127.20.171.125:41963)
0807 10:36:56.882650 (+ 1856us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:56.882656 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:56.882675 (+ 19us) server_negotiation.cc:407] Connection header received
0807 10:36:56.882754 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:56.882759 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:56.882837 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:56.883602 (+ 765us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:36:56.889478 (+ 5876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:56.890791 (+ 1313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:56.893483 (+ 2692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:56.894484 (+ 1001us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:56.894694 (+ 210us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:56.894785 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:56.895006 (+ 221us) server_negotiation.cc:299] Negotiation successful
0807 10:36:56.895160 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":37,"server-negotiator.queue_time_us":1715,"thread_start_us":1531,"threads_started":1}
I20260807 10:36:56.896229 28114 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7cb70b70a1944a069f2e1ef2c66c7b19" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "9d9adcde3d254acda7f28fb66fbc417c" is_pre_election: true
I20260807 10:36:56.897795 28861 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9d9adcde3d254acda7f28fb66fbc417c [term 2 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "a3ba955fde1542b8a0187d9fd7a0052c" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 45569 } } peers { permanent_uuid: "9d9adcde3d254acda7f28fb66fbc417c" member_type: VOTER last_known_addr { host: "127.20.171.125" port: 41963 } attrs { promote: false } } peers { permanent_uuid: "7cb70b70a1944a069f2e1ef2c66c7b19" member_type: VOTER last_known_addr { host: "127.20.171.124" port: 42363 } attrs { promote: false } }
I20260807 10:36:56.898247 28114 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 9d9adcde3d254acda7f28fb66fbc417c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cb70b70a1944a069f2e1ef2c66c7b19 in current term 2: Already voted for candidate 9d9adcde3d254acda7f28fb66fbc417c in this term.
I20260807 10:36:56.898613 28861 leader_election.cc:288] T 00000000000000000000000000000000 P 9d9adcde3d254acda7f28fb66fbc417c [CANDIDATE]: Term 2 election: Requested vote from peers a3ba955fde1542b8a0187d9fd7a0052c (127.20.171.126:45569), 7cb70b70a1944a069f2e1ef2c66c7b19 (127.20.171.124:42363)
I20260807 10:36:56.899102 28865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:56.898599 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:45569 (local address 127.0.0.1:37802)
0807 10:36:56.898870 (+ 271us) negotiation.cc:107] Waiting for socket to connect
0807 10:36:56.898966 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.126:45569: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":180}
I20260807 10:36:56.899060 28317 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "9d9adcde3d254acda7f28fb66fbc417c" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "7cb70b70a1944a069f2e1ef2c66c7b19"
I20260807 10:36:56.899314 28317 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7cb70b70a1944a069f2e1ef2c66c7b19 [term 1 FOLLOWER]: Advancing to term 2
I20260807 10:36:56.899288 28293 leader_election.cc:302] T 00000000000000000000000000000000 P 7cb70b70a1944a069f2e1ef2c66c7b19 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cb70b70a1944a069f2e1ef2c66c7b19; no voters: 9d9adcde3d254acda7f28fb66fbc417c, a3ba955fde1542b8a0187d9fd7a0052c
I20260807 10:36:56.900643 28865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:56.900186 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:45569 (local address 127.0.0.1:37810)
0807 10:36:56.900489 (+ 303us) negotiation.cc:107] Waiting for socket to connect
0807 10:36:56.900549 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.126:45569: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":206}
W20260807 10:36:56.900876 28089 leader_election.cc:334] T 00000000000000000000000000000000 P 9d9adcde3d254acda7f28fb66fbc417c [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer a3ba955fde1542b8a0187d9fd7a0052c (127.20.171.126:45569): Network error: Client connection negotiation failed: client connection to 127.20.171.126:45569: connect: Connection refused (error 111)
I20260807 10:36:56.901683 28317 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 7cb70b70a1944a069f2e1ef2c66c7b19 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d9adcde3d254acda7f28fb66fbc417c in term 2.
I20260807 10:36:56.901849 28862 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 7cb70b70a1944a069f2e1ef2c66c7b19 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 10:36:56.902156 28091 leader_election.cc:302] T 00000000000000000000000000000000 P 9d9adcde3d254acda7f28fb66fbc417c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7cb70b70a1944a069f2e1ef2c66c7b19, 9d9adcde3d254acda7f28fb66fbc417c; no voters: a3ba955fde1542b8a0187d9fd7a0052c
I20260807 10:36:56.902457 28861 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9d9adcde3d254acda7f28fb66fbc417c [term 2 FOLLOWER]: Leader election won for term 2
I20260807 10:36:56.902882 28861 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9d9adcde3d254acda7f28fb66fbc417c [term 2 LEADER]: Becoming Leader. State: Replica: 9d9adcde3d254acda7f28fb66fbc417c, State: Running, Role: LEADER
I20260807 10:36:56.903277 28861 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9d9adcde3d254acda7f28fb66fbc417c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "a3ba955fde1542b8a0187d9fd7a0052c" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 45569 } } peers { permanent_uuid: "9d9adcde3d254acda7f28fb66fbc417c" member_type: VOTER last_known_addr { host: "127.20.171.125" port: 41963 } attrs { promote: false } } peers { permanent_uuid: "7cb70b70a1944a069f2e1ef2c66c7b19" member_type: VOTER last_known_addr { host: "127.20.171.124" port: 42363 } attrs { promote: false } }
I20260807 10:36:56.905000 28871 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9d9adcde3d254acda7f28fb66fbc417c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9d9adcde3d254acda7f28fb66fbc417c. Latest consensus state: current_term: 2 leader_uuid: "9d9adcde3d254acda7f28fb66fbc417c" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "a3ba955fde1542b8a0187d9fd7a0052c" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 45569 } } peers { permanent_uuid: "9d9adcde3d254acda7f28fb66fbc417c" member_type: VOTER last_known_addr { host: "127.20.171.125" port: 41963 } attrs { promote: false } } peers { permanent_uuid: "7cb70b70a1944a069f2e1ef2c66c7b19" member_type: VOTER last_known_addr { host: "127.20.171.124" port: 42363 } attrs { promote: false } } }
I20260807 10:36:56.905339 28871 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9d9adcde3d254acda7f28fb66fbc417c [sys.catalog]: This master's current role is: LEADER
I20260807 10:36:56.906036 28873 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 10:36:56.910292 28873 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 10:36:56.911265 28873 catalog_manager.cc:1259] Loaded cluster ID: 7b9a4b9fc4a3418fa3f99e0b86b93379
I20260807 10:36:56.911360 28873 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 10:36:56.912632 28873 catalog_manager.cc:1504] Loading token signing keys...
I20260807 10:36:56.913466 28873 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 9d9adcde3d254acda7f28fb66fbc417c: Loaded TSK: 0
I20260807 10:36:56.914386 28873 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 10:36:56.945396 28105 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41930:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 10:36:56.953053 28105 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 10:36:56.957458 28865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:56.956956 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:45569 (local address 127.0.0.1:37822)
0807 10:36:56.957167 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0807 10:36:56.957291 (+ 124us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.126:45569: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260807 10:36:56.957438 28317 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 7cb70b70a1944a069f2e1ef2c66c7b19 [term 2 FOLLOWER]: Refusing update from remote peer 9d9adcde3d254acda7f28fb66fbc417c: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 2 index: 14. (index mismatch)
I20260807 10:36:56.958213 28871 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 9d9adcde3d254acda7f28fb66fbc417c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cb70b70a1944a069f2e1ef2c66c7b19" member_type: VOTER last_known_addr { host: "127.20.171.124" port: 42363 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260807 10:36:56.958470 28865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:56.958077 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:45569 (local address 127.0.0.1:37838)
0807 10:36:56.958223 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0807 10:36:56.958315 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.126:45569: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260807 10:36:56.958686 28089 consensus_peers.cc:487] T 00000000000000000000000000000000 P 9d9adcde3d254acda7f28fb66fbc417c -> Peer a3ba955fde1542b8a0187d9fd7a0052c (127.20.171.126:45569): Couldn't send request to peer a3ba955fde1542b8a0187d9fd7a0052c. Status: Network error: Client connection negotiation failed: client connection to 127.20.171.126:45569: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260807 10:36:56.960819 28862 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7cb70b70a1944a069f2e1ef2c66c7b19 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9d9adcde3d254acda7f28fb66fbc417c. Latest consensus state: current_term: 2 leader_uuid: "9d9adcde3d254acda7f28fb66fbc417c" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "a3ba955fde1542b8a0187d9fd7a0052c" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 45569 } } peers { permanent_uuid: "9d9adcde3d254acda7f28fb66fbc417c" member_type: VOTER last_known_addr { host: "127.20.171.125" port: 41963 } attrs { promote: false } } peers { permanent_uuid: "7cb70b70a1944a069f2e1ef2c66c7b19" member_type: VOTER last_known_addr { host: "127.20.171.124" port: 42363 } attrs { promote: false } } }
I20260807 10:36:56.961099 28862 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7cb70b70a1944a069f2e1ef2c66c7b19 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 10:36:56.962265 28874 mvcc.cc:205] Tried to move back new op lower bound from 7315861573450362880 to 7315861573239599104. Current Snapshot: MvccSnapshot[applied={T|T < 7315861573450362880}]
I20260807 10:36:56.962776 28871 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9d9adcde3d254acda7f28fb66fbc417c [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "9d9adcde3d254acda7f28fb66fbc417c" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "a3ba955fde1542b8a0187d9fd7a0052c" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 45569 } } peers { permanent_uuid: "9d9adcde3d254acda7f28fb66fbc417c" member_type: VOTER last_known_addr { host: "127.20.171.125" port: 41963 } attrs { promote: false } } peers { permanent_uuid: "7cb70b70a1944a069f2e1ef2c66c7b19" member_type: VOTER last_known_addr { host: "127.20.171.124" port: 42363 } attrs { promote: false } } }
I20260807 10:36:56.963049 28871 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9d9adcde3d254acda7f28fb66fbc417c [sys.catalog]: This master's current role is: LEADER
I20260807 10:36:56.963550 28862 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7cb70b70a1944a069f2e1ef2c66c7b19 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "9d9adcde3d254acda7f28fb66fbc417c" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "a3ba955fde1542b8a0187d9fd7a0052c" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 45569 } } peers { permanent_uuid: "9d9adcde3d254acda7f28fb66fbc417c" member_type: VOTER last_known_addr { host: "127.20.171.125" port: 41963 } attrs { promote: false } } peers { permanent_uuid: "7cb70b70a1944a069f2e1ef2c66c7b19" member_type: VOTER last_known_addr { host: "127.20.171.124" port: 42363 } attrs { promote: false } } }
I20260807 10:36:56.963814 28862 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7cb70b70a1944a069f2e1ef2c66c7b19 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 10:36:56.964097 28875 mvcc.cc:205] Tried to move back new op lower bound from 7315861573450362880 to 7315861573239599104. Current Snapshot: MvccSnapshot[applied={T|T < 7315861573450362880}]
I20260807 10:36:56.980374 28865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:56.971608 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.67:37807 (local address 127.0.0.1:59294)
0807 10:36:56.971893 (+ 285us) negotiation.cc:107] Waiting for socket to connect
0807 10:36:56.971913 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0807 10:36:56.972022 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:36:56.974693 (+ 2671us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:36:56.974697 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:36:56.974732 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:36:56.974910 (+ 178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:56.974921 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:56.976405 (+ 1484us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:56.976409 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:56.978263 (+ 1854us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:56.978276 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:56.979581 (+ 1305us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:56.979586 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:56.979745 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:56.979776 (+ 31us) client_negotiation.cc:769] Sending connection context
0807 10:36:56.979868 (+ 92us) client_negotiation.cc:240] Negotiation successful
0807 10:36:56.979999 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142,"mutex_wait_us":33}
I20260807 10:36:56.980667 28880 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:56.971763 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59294 (local address 127.20.171.67:37807)
0807 10:36:56.974115 (+ 2352us) spinlock_profiling.cc:243] Waited 1.19 ms on lock 0x60c000097b80. stack: 00007f9f2a84a66e 00007f9f2a84a430 00007f9f298d15ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007f9f3d731775 00007f9f2a8901d3 00007f9f2a89391b 00007f9f2a893798 00000000009edb7c 00007f9f2a86eeae 00007f9f2db486da 00007f9f26ade61e
0807 10:36:56.974284 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:56.974292 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:56.974319 (+ 27us) server_negotiation.cc:407] Connection header received
0807 10:36:56.974408 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:56.974416 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:56.974514 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:56.974651 (+ 137us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:36:56.975107 (+ 456us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:56.976294 (+ 1187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:56.978412 (+ 2118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:56.979406 (+ 994us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:56.979529 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:56.979602 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:56.979895 (+ 293us) server_negotiation.cc:299] Negotiation successful
0807 10:36:56.980067 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":600,"spinlock_wait_cycles":2747776,"thread_start_us":475,"threads_started":1}
I20260807 10:36:56.981469 28866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:56.972090 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.65:42425 (local address 127.0.0.1:59354)
0807 10:36:56.972460 (+ 370us) negotiation.cc:107] Waiting for socket to connect
0807 10:36:56.972476 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 10:36:56.972750 (+ 274us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:36:56.975512 (+ 2762us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:36:56.975516 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:36:56.975544 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:36:56.975879 (+ 335us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:56.975888 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:56.977346 (+ 1458us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:56.977350 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:56.979122 (+ 1772us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:56.979131 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:56.980700 (+ 1569us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:56.980706 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:56.980896 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:56.980926 (+ 30us) client_negotiation.cc:769] Sending connection context
0807 10:36:56.980995 (+ 69us) client_negotiation.cc:240] Negotiation successful
0807 10:36:56.981129 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":284,"mutex_wait_us":8}
I20260807 10:36:56.981490 28715 tablet_service.cc:1467] Processing CreateTablet for tablet 8efed4e8d0944767af9a0652b2dfc14a (DEFAULT_TABLE table=test-table [id=ad514446e30a4396b6d5fe7856828618]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:36:56.981931 28882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:56.972530 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59354 (local address 127.20.171.65:42425)
0807 10:36:56.975185 (+ 2655us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:56.975214 (+ 29us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:56.975229 (+ 15us) server_negotiation.cc:407] Connection header received
0807 10:36:56.975287 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:56.975290 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:56.975388 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:56.975489 (+ 101us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:36:56.976025 (+ 536us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:56.977159 (+ 1134us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:56.979286 (+ 2127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:56.980446 (+ 1160us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:56.981364 (+ 918us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:56.981454 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:56.981511 (+ 57us) server_negotiation.cc:299] Negotiation successful
0807 10:36:56.981636 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2543,"thread_start_us":2434,"threads_started":1}
I20260807 10:36:56.981964 28715 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8efed4e8d0944767af9a0652b2dfc14a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:36:56.982264 28883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:56.972971 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33434 (local address 127.20.171.66:45441)
0807 10:36:56.973731 (+ 760us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:56.973736 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:56.973751 (+ 15us) server_negotiation.cc:407] Connection header received
0807 10:36:56.973827 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:56.973868 (+ 41us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:56.973949 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:56.974178 (+ 229us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:36:56.974993 (+ 815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:56.976164 (+ 1171us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:56.978843 (+ 2679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:56.979930 (+ 1087us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:56.980067 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:56.980168 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:56.981768 (+ 1600us) server_negotiation.cc:299] Negotiation successful
0807 10:36:56.981909 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":615,"thread_start_us":480,"threads_started":1}
I20260807 10:36:56.981256 28881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:56.972498 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.66:45441 (local address 127.0.0.1:33434)
0807 10:36:56.973106 (+ 608us) negotiation.cc:107] Waiting for socket to connect
0807 10:36:56.973122 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 10:36:56.973576 (+ 454us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:36:56.974374 (+ 798us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:36:56.974381 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:36:56.974407 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:36:56.974792 (+ 385us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:56.974803 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:56.976335 (+ 1532us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:56.976341 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:56.978674 (+ 2333us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:56.978688 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:56.980363 (+ 1675us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:56.980370 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:56.980566 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:56.980596 (+ 30us) client_negotiation.cc:769] Sending connection context
0807 10:36:56.980712 (+ 116us) client_negotiation.cc:240] Negotiation successful
0807 10:36:56.980859 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":479,"mutex_wait_us":49,"thread_start_us":792,"threads_started":1}
I20260807 10:36:56.982672 28428 tablet_service.cc:1467] Processing CreateTablet for tablet 8efed4e8d0944767af9a0652b2dfc14a (DEFAULT_TABLE table=test-table [id=ad514446e30a4396b6d5fe7856828618]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:36:56.983153 28428 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8efed4e8d0944767af9a0652b2dfc14a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:36:56.983340 28571 tablet_service.cc:1467] Processing CreateTablet for tablet 8efed4e8d0944767af9a0652b2dfc14a (DEFAULT_TABLE table=test-table [id=ad514446e30a4396b6d5fe7856828618]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:36:56.983747 28571 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8efed4e8d0944767af9a0652b2dfc14a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:36:56.989154 28884 tablet_bootstrap.cc:492] T 8efed4e8d0944767af9a0652b2dfc14a P 0ee4d53fcb5c47acbc12ef3ba680766a: Bootstrap starting.
I20260807 10:36:56.990424 28886 tablet_bootstrap.cc:492] T 8efed4e8d0944767af9a0652b2dfc14a P 13625247901b4ad7a38dae319a093281: Bootstrap starting.
I20260807 10:36:56.991214 28885 tablet_bootstrap.cc:492] T 8efed4e8d0944767af9a0652b2dfc14a P c04827968c1b4c469f0b4cbf1bf63c3d: Bootstrap starting.
I20260807 10:36:56.991525 28884 tablet_bootstrap.cc:654] T 8efed4e8d0944767af9a0652b2dfc14a P 0ee4d53fcb5c47acbc12ef3ba680766a: Neither blocks nor log segments found. Creating new log.
I20260807 10:36:56.992056 28886 tablet_bootstrap.cc:654] T 8efed4e8d0944767af9a0652b2dfc14a P 13625247901b4ad7a38dae319a093281: Neither blocks nor log segments found. Creating new log.
I20260807 10:36:56.992962 28885 tablet_bootstrap.cc:654] T 8efed4e8d0944767af9a0652b2dfc14a P c04827968c1b4c469f0b4cbf1bf63c3d: Neither blocks nor log segments found. Creating new log.
I20260807 10:36:56.995147 28884 tablet_bootstrap.cc:492] T 8efed4e8d0944767af9a0652b2dfc14a P 0ee4d53fcb5c47acbc12ef3ba680766a: No bootstrap required, opened a new log
I20260807 10:36:56.995312 28884 ts_tablet_manager.cc:1397] T 8efed4e8d0944767af9a0652b2dfc14a P 0ee4d53fcb5c47acbc12ef3ba680766a: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260807 10:36:56.995334 28886 tablet_bootstrap.cc:492] T 8efed4e8d0944767af9a0652b2dfc14a P 13625247901b4ad7a38dae319a093281: No bootstrap required, opened a new log
I20260807 10:36:56.995496 28886 ts_tablet_manager.cc:1397] T 8efed4e8d0944767af9a0652b2dfc14a P 13625247901b4ad7a38dae319a093281: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260807 10:36:56.995919 28885 tablet_bootstrap.cc:492] T 8efed4e8d0944767af9a0652b2dfc14a P c04827968c1b4c469f0b4cbf1bf63c3d: No bootstrap required, opened a new log
I20260807 10:36:56.996053 28885 ts_tablet_manager.cc:1397] T 8efed4e8d0944767af9a0652b2dfc14a P c04827968c1b4c469f0b4cbf1bf63c3d: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260807 10:36:56.996112 28884 raft_consensus.cc:348] T 8efed4e8d0944767af9a0652b2dfc14a P 0ee4d53fcb5c47acbc12ef3ba680766a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ee4d53fcb5c47acbc12ef3ba680766a" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 37807 } } peers { permanent_uuid: "c04827968c1b4c469f0b4cbf1bf63c3d" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 42425 } } peers { permanent_uuid: "13625247901b4ad7a38dae319a093281" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 45441 } }
I20260807 10:36:56.996400 28884 raft_consensus.cc:374] T 8efed4e8d0944767af9a0652b2dfc14a P 0ee4d53fcb5c47acbc12ef3ba680766a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:36:56.996246 28886 raft_consensus.cc:348] T 8efed4e8d0944767af9a0652b2dfc14a P 13625247901b4ad7a38dae319a093281 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ee4d53fcb5c47acbc12ef3ba680766a" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 37807 } } peers { permanent_uuid: "c04827968c1b4c469f0b4cbf1bf63c3d" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 42425 } } peers { permanent_uuid: "13625247901b4ad7a38dae319a093281" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 45441 } }
I20260807 10:36:56.996490 28884 raft_consensus.cc:729] T 8efed4e8d0944767af9a0652b2dfc14a P 0ee4d53fcb5c47acbc12ef3ba680766a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ee4d53fcb5c47acbc12ef3ba680766a, State: Initialized, Role: FOLLOWER
I20260807 10:36:56.996555 28886 raft_consensus.cc:374] T 8efed4e8d0944767af9a0652b2dfc14a P 13625247901b4ad7a38dae319a093281 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:36:56.996640 28886 raft_consensus.cc:729] T 8efed4e8d0944767af9a0652b2dfc14a P 13625247901b4ad7a38dae319a093281 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13625247901b4ad7a38dae319a093281, State: Initialized, Role: FOLLOWER
I20260807 10:36:56.996719 28884 consensus_queue.cc:260] T 8efed4e8d0944767af9a0652b2dfc14a P 0ee4d53fcb5c47acbc12ef3ba680766a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ee4d53fcb5c47acbc12ef3ba680766a" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 37807 } } peers { permanent_uuid: "c04827968c1b4c469f0b4cbf1bf63c3d" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 42425 } } peers { permanent_uuid: "13625247901b4ad7a38dae319a093281" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 45441 } }
I20260807 10:36:56.996891 28886 consensus_queue.cc:260] T 8efed4e8d0944767af9a0652b2dfc14a P 13625247901b4ad7a38dae319a093281 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ee4d53fcb5c47acbc12ef3ba680766a" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 37807 } } peers { permanent_uuid: "c04827968c1b4c469f0b4cbf1bf63c3d" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 42425 } } peers { permanent_uuid: "13625247901b4ad7a38dae319a093281" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 45441 } }
I20260807 10:36:56.997006 28885 raft_consensus.cc:348] T 8efed4e8d0944767af9a0652b2dfc14a P c04827968c1b4c469f0b4cbf1bf63c3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ee4d53fcb5c47acbc12ef3ba680766a" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 37807 } } peers { permanent_uuid: "c04827968c1b4c469f0b4cbf1bf63c3d" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 42425 } } peers { permanent_uuid: "13625247901b4ad7a38dae319a093281" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 45441 } }
I20260807 10:36:56.997284 28885 raft_consensus.cc:374] T 8efed4e8d0944767af9a0652b2dfc14a P c04827968c1b4c469f0b4cbf1bf63c3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:36:56.997376 28885 raft_consensus.cc:729] T 8efed4e8d0944767af9a0652b2dfc14a P c04827968c1b4c469f0b4cbf1bf63c3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c04827968c1b4c469f0b4cbf1bf63c3d, State: Initialized, Role: FOLLOWER
I20260807 10:36:56.997578 28884 ts_tablet_manager.cc:1428] T 8efed4e8d0944767af9a0652b2dfc14a P 0ee4d53fcb5c47acbc12ef3ba680766a: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260807 10:36:56.997664 28885 consensus_queue.cc:260] T 8efed4e8d0944767af9a0652b2dfc14a P c04827968c1b4c469f0b4cbf1bf63c3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ee4d53fcb5c47acbc12ef3ba680766a" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 37807 } } peers { permanent_uuid: "c04827968c1b4c469f0b4cbf1bf63c3d" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 42425 } } peers { permanent_uuid: "13625247901b4ad7a38dae319a093281" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 45441 } }
I20260807 10:36:57.001936 28784 heartbeater.cc:503] Master 127.20.171.125:41963 was elected leader, sending a full tablet report...
I20260807 10:36:57.007779 28886 ts_tablet_manager.cc:1428] T 8efed4e8d0944767af9a0652b2dfc14a P 13625247901b4ad7a38dae319a093281: Time spent starting tablet: real 0.012s user 0.006s sys 0.005s
I20260807 10:36:57.011554 28885 ts_tablet_manager.cc:1428] T 8efed4e8d0944767af9a0652b2dfc14a P c04827968c1b4c469f0b4cbf1bf63c3d: Time spent starting tablet: real 0.015s user 0.004s sys 0.004s
I20260807 10:36:57.013190 28894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:57.008527 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:45569 (local address 127.20.171.66:58015)
0807 10:36:57.012720 (+ 4193us) negotiation.cc:107] Waiting for socket to connect
0807 10:36:57.012889 (+ 169us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.126:45569: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":4042,"threads_started":1}
I20260807 10:36:57.013255 28640 heartbeater.cc:503] Master 127.20.171.125:41963 was elected leader, sending a full tablet report...
I20260807 10:36:57.015864 28894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:57.015275 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:45569 (local address 127.20.171.66:51545)
0807 10:36:57.015574 (+ 299us) negotiation.cc:107] Waiting for socket to connect
0807 10:36:57.015675 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.126:45569: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":152}
I20260807 10:36:57.016224 28497 heartbeater.cc:503] Master 127.20.171.125:41963 was elected leader, sending a full tablet report...
I20260807 10:36:57.018251 28892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:56.998181 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:45569 (local address 127.20.171.67:40849)
0807 10:36:57.017757 (+ 19576us) negotiation.cc:107] Waiting for socket to connect
0807 10:36:57.017922 (+ 165us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.126:45569: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":19405,"thread_start_us":19263,"threads_started":1}
I20260807 10:36:57.018414 28895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:57.011931 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:45569 (local address 127.20.171.65:42541)
0807 10:36:57.017918 (+ 5987us) negotiation.cc:107] Waiting for socket to connect
0807 10:36:57.018094 (+ 176us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.126:45569: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":5857,"thread_start_us":5704,"threads_started":1}
I20260807 10:36:57.019454 28892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:57.019076 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:45569 (local address 127.20.171.67:35859)
0807 10:36:57.019243 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0807 10:36:57.019323 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.126:45569: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260807 10:36:57.019452 28895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:57.019083 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:45569 (local address 127.20.171.65:37225)
0807 10:36:57.019251 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0807 10:36:57.019323 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.126:45569: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
I20260807 10:36:57.083637 28891 raft_consensus.cc:482] T 8efed4e8d0944767af9a0652b2dfc14a P 13625247901b4ad7a38dae319a093281 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 10:36:57.083896 28891 raft_consensus.cc:504] T 8efed4e8d0944767af9a0652b2dfc14a P 13625247901b4ad7a38dae319a093281 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ee4d53fcb5c47acbc12ef3ba680766a" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 37807 } } peers { permanent_uuid: "c04827968c1b4c469f0b4cbf1bf63c3d" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 42425 } } peers { permanent_uuid: "13625247901b4ad7a38dae319a093281" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 45441 } }
I20260807 10:36:57.085899 28891 leader_election.cc:288] T 8efed4e8d0944767af9a0652b2dfc14a P 13625247901b4ad7a38dae319a093281 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ee4d53fcb5c47acbc12ef3ba680766a (127.20.171.67:37807), c04827968c1b4c469f0b4cbf1bf63c3d (127.20.171.65:42425)
I20260807 10:36:57.093446 28882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:57.086963 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.66:49689 (local address 127.20.171.65:42425)
0807 10:36:57.087307 (+ 344us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:57.087313 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:57.087700 (+ 387us) server_negotiation.cc:407] Connection header received
0807 10:36:57.087902 (+ 202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:57.087908 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:57.087982 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:57.088072 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:36:57.088573 (+ 501us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:57.089368 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:57.091444 (+ 2076us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:57.092559 (+ 1115us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:57.092727 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:57.092797 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:57.093086 (+ 289us) server_negotiation.cc:299] Negotiation successful
0807 10:36:57.093214 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":167}
I20260807 10:36:57.093477 28896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:57.086664 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.65:42425 (local address 127.20.171.66:49689)
0807 10:36:57.087584 (+ 920us) negotiation.cc:107] Waiting for socket to connect
0807 10:36:57.087601 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 10:36:57.087761 (+ 160us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:36:57.088106 (+ 345us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:36:57.088109 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:36:57.088134 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:36:57.088427 (+ 293us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:57.088435 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:57.089483 (+ 1048us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:57.089488 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:57.091305 (+ 1817us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:57.091314 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:57.092780 (+ 1466us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:57.092785 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:57.092939 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:57.092961 (+ 22us) client_negotiation.cc:769] Sending connection context
0807 10:36:57.093059 (+ 98us) client_negotiation.cc:240] Negotiation successful
0807 10:36:57.093175 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":791,"thread_start_us":613,"threads_started":1}
I20260807 10:36:57.093576 28880 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:57.086327 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.66:59961 (local address 127.20.171.67:37807)
0807 10:36:57.086525 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:57.086531 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:57.086553 (+ 22us) server_negotiation.cc:407] Connection header received
0807 10:36:57.086827 (+ 274us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:57.086834 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:57.086910 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:57.087009 (+ 99us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:36:57.087952 (+ 943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:57.089002 (+ 1050us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:57.091229 (+ 2227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:57.092327 (+ 1098us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:57.092470 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:57.092541 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:57.093253 (+ 712us) server_negotiation.cc:299] Negotiation successful
0807 10:36:57.093377 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260807 10:36:57.094172 28894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:57.086250 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.67:37807 (local address 127.20.171.66:59961)
0807 10:36:57.086433 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0807 10:36:57.086452 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 10:36:57.086591 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:36:57.087398 (+ 807us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:36:57.087402 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:36:57.087446 (+ 44us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:36:57.087774 (+ 328us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:57.087787 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:57.089117 (+ 1330us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:57.089120 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:57.091078 (+ 1958us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:36:57.091092 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:36:57.092529 (+ 1437us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:36:57.092535 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:36:57.093067 (+ 532us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:57.093105 (+ 38us) client_negotiation.cc:769] Sending connection context
0807 10:36:57.093798 (+ 693us) client_negotiation.cc:240] Negotiation successful
0807 10:36:57.093951 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":59,"mutex_wait_us":1}
I20260807 10:36:57.094434 28449 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8efed4e8d0944767af9a0652b2dfc14a" candidate_uuid: "13625247901b4ad7a38dae319a093281" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c04827968c1b4c469f0b4cbf1bf63c3d" is_pre_election: true
I20260807 10:36:57.094939 28449 raft_consensus.cc:2454] T 8efed4e8d0944767af9a0652b2dfc14a P c04827968c1b4c469f0b4cbf1bf63c3d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 13625247901b4ad7a38dae319a093281 in term 0.
I20260807 10:36:57.095127 28737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8efed4e8d0944767af9a0652b2dfc14a" candidate_uuid: "13625247901b4ad7a38dae319a093281" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ee4d53fcb5c47acbc12ef3ba680766a" is_pre_election: true
I20260807 10:36:57.095432 28737 raft_consensus.cc:2454] T 8efed4e8d0944767af9a0652b2dfc14a P 0ee4d53fcb5c47acbc12ef3ba680766a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 13625247901b4ad7a38dae319a093281 in term 0.
I20260807 10:36:57.095613 28523 leader_election.cc:302] T 8efed4e8d0944767af9a0652b2dfc14a P 13625247901b4ad7a38dae319a093281 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13625247901b4ad7a38dae319a093281, c04827968c1b4c469f0b4cbf1bf63c3d; no voters:
I20260807 10:36:57.096028 28891 raft_consensus.cc:2781] T 8efed4e8d0944767af9a0652b2dfc14a P 13625247901b4ad7a38dae319a093281 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 10:36:57.096177 28891 raft_consensus.cc:482] T 8efed4e8d0944767af9a0652b2dfc14a P 13625247901b4ad7a38dae319a093281 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 10:36:57.096319 28891 raft_consensus.cc:3037] T 8efed4e8d0944767af9a0652b2dfc14a P 13625247901b4ad7a38dae319a093281 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:36:57.098620 28891 raft_consensus.cc:504] T 8efed4e8d0944767af9a0652b2dfc14a P 13625247901b4ad7a38dae319a093281 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ee4d53fcb5c47acbc12ef3ba680766a" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 37807 } } peers { permanent_uuid: "c04827968c1b4c469f0b4cbf1bf63c3d" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 42425 } } peers { permanent_uuid: "13625247901b4ad7a38dae319a093281" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 45441 } }
I20260807 10:36:57.099310 28891 leader_election.cc:288] T 8efed4e8d0944767af9a0652b2dfc14a P 13625247901b4ad7a38dae319a093281 [CANDIDATE]: Term 1 election: Requested vote from peers 0ee4d53fcb5c47acbc12ef3ba680766a (127.20.171.67:37807), c04827968c1b4c469f0b4cbf1bf63c3d (127.20.171.65:42425)
I20260807 10:36:57.099740 28737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8efed4e8d0944767af9a0652b2dfc14a" candidate_uuid: "13625247901b4ad7a38dae319a093281" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ee4d53fcb5c47acbc12ef3ba680766a"
I20260807 10:36:57.099831 28449 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8efed4e8d0944767af9a0652b2dfc14a" candidate_uuid: "13625247901b4ad7a38dae319a093281" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c04827968c1b4c469f0b4cbf1bf63c3d"
I20260807 10:36:57.099959 28737 raft_consensus.cc:3037] T 8efed4e8d0944767af9a0652b2dfc14a P 0ee4d53fcb5c47acbc12ef3ba680766a [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:36:57.100009 28449 raft_consensus.cc:3037] T 8efed4e8d0944767af9a0652b2dfc14a P c04827968c1b4c469f0b4cbf1bf63c3d [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:36:57.102890 28737 raft_consensus.cc:2454] T 8efed4e8d0944767af9a0652b2dfc14a P 0ee4d53fcb5c47acbc12ef3ba680766a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13625247901b4ad7a38dae319a093281 in term 1.
I20260807 10:36:57.102893 28449 raft_consensus.cc:2454] T 8efed4e8d0944767af9a0652b2dfc14a P c04827968c1b4c469f0b4cbf1bf63c3d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13625247901b4ad7a38dae319a093281 in term 1.
I20260807 10:36:57.103286 28523 leader_election.cc:302] T 8efed4e8d0944767af9a0652b2dfc14a P 13625247901b4ad7a38dae319a093281 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13625247901b4ad7a38dae319a093281, c04827968c1b4c469f0b4cbf1bf63c3d; no voters:
I20260807 10:36:57.103574 28891 raft_consensus.cc:2781] T 8efed4e8d0944767af9a0652b2dfc14a P 13625247901b4ad7a38dae319a093281 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:36:57.104063 28891 raft_consensus.cc:686] T 8efed4e8d0944767af9a0652b2dfc14a P 13625247901b4ad7a38dae319a093281 [term 1 LEADER]: Becoming Leader. State: Replica: 13625247901b4ad7a38dae319a093281, State: Running, Role: LEADER
I20260807 10:36:57.104497 28891 consensus_queue.cc:237] T 8efed4e8d0944767af9a0652b2dfc14a P 13625247901b4ad7a38dae319a093281 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ee4d53fcb5c47acbc12ef3ba680766a" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 37807 } } peers { permanent_uuid: "c04827968c1b4c469f0b4cbf1bf63c3d" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 42425 } } peers { permanent_uuid: "13625247901b4ad7a38dae319a093281" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 45441 } }
I20260807 10:36:57.105006 28894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:57.104622 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:45569 (local address 127.20.171.66:47791)
0807 10:36:57.104777 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0807 10:36:57.104869 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.126:45569: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260807 10:36:57.108068 28105 catalog_manager.cc:5495] T 8efed4e8d0944767af9a0652b2dfc14a P 13625247901b4ad7a38dae319a093281 reported cstate change: term changed from 0 to 1, leader changed from <none> to 13625247901b4ad7a38dae319a093281 (127.20.171.66). New cstate: current_term: 1 leader_uuid: "13625247901b4ad7a38dae319a093281" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ee4d53fcb5c47acbc12ef3ba680766a" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 37807 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c04827968c1b4c469f0b4cbf1bf63c3d" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 42425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "13625247901b4ad7a38dae319a093281" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 45441 } health_report { overall_health: HEALTHY } } }
I20260807 10:36:57.133605 28883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:57.129026 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33446 (local address 127.20.171.66:45441)
0807 10:36:57.129234 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:57.129239 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:57.129255 (+ 16us) server_negotiation.cc:407] Connection header received
0807 10:36:57.129368 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:57.129372 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:57.129458 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:57.129580 (+ 122us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 10:36:57.129896 (+ 316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:57.130563 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:57.131715 (+ 1152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:57.132095 (+ 380us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:57.132182 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:57.132624 (+ 442us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 10:36:57.133133 (+ 509us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 10:36:57.133238 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:57.133346 (+ 108us) server_negotiation.cc:299] Negotiation successful
0807 10:36:57.133407 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260807 10:36:57.137856 28737 raft_consensus.cc:1261] T 8efed4e8d0944767af9a0652b2dfc14a P 0ee4d53fcb5c47acbc12ef3ba680766a [term 1 FOLLOWER]: Refusing update from remote peer 13625247901b4ad7a38dae319a093281: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 10:36:57.138118 28449 raft_consensus.cc:1261] T 8efed4e8d0944767af9a0652b2dfc14a P c04827968c1b4c469f0b4cbf1bf63c3d [term 1 FOLLOWER]: Refusing update from remote peer 13625247901b4ad7a38dae319a093281: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 10:36:57.138576 28897 consensus_queue.cc:1035] T 8efed4e8d0944767af9a0652b2dfc14a P 13625247901b4ad7a38dae319a093281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ee4d53fcb5c47acbc12ef3ba680766a" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 37807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 10:36:57.139017 28891 consensus_queue.cc:1035] T 8efed4e8d0944767af9a0652b2dfc14a P 13625247901b4ad7a38dae319a093281 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c04827968c1b4c469f0b4cbf1bf63c3d" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 42425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 10:36:57.141275 28895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:57.140815 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:45569 (local address 127.20.171.65:54025)
0807 10:36:57.140995 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0807 10:36:57.141119 (+ 124us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.126:45569: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
I20260807 10:36:57.141863 28892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:57.140815 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:45569 (local address 127.20.171.67:39053)
0807 10:36:57.141569 (+ 754us) negotiation.cc:107] Waiting for socket to connect
0807 10:36:57.141688 (+ 119us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.126:45569: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":636}
I20260807 10:36:57.147781 28900 mvcc.cc:205] Tried to move back new op lower bound from 7315861574189137920 to 7315861574064054272. Current Snapshot: MvccSnapshot[applied={T|T < 7315861574189137920}]
I20260807 10:36:57.150182 28892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:57.149563 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:45569 (local address 127.20.171.67:52971)
0807 10:36:57.149850 (+ 287us) negotiation.cc:107] Waiting for socket to connect
0807 10:36:57.149972 (+ 122us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.126:45569: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":149}
I20260807 10:36:57.154742 28894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:57.153775 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:45569 (local address 127.20.171.66:38319)
0807 10:36:57.154382 (+ 607us) negotiation.cc:107] Waiting for socket to connect
0807 10:36:57.154502 (+ 120us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.126:45569: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":414}
I20260807 10:36:57.156095 28895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:57.151182 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:45569 (local address 127.20.171.65:43475)
0807 10:36:57.151460 (+ 278us) negotiation.cc:107] Waiting for socket to connect
0807 10:36:57.151561 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.126:45569: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":152}
I20260807 10:36:57.167833 28104 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41930:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 10:36:57.168090 28104 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41930:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 10:36:57.173672 28104 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9d9adcde3d254acda7f28fb66fbc417c: Sending DeleteTablet for 3 replicas of tablet 8efed4e8d0944767af9a0652b2dfc14a
I20260807 10:36:57.174647 28715 tablet_service.cc:1514] Processing DeleteTablet for tablet 8efed4e8d0944767af9a0652b2dfc14a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:36:57 UTC) from {username='oryx', principal='oryx/127.20.171.125@KRBTEST.COM'} at 127.0.0.1:59294
I20260807 10:36:57.174762 28428 tablet_service.cc:1514] Processing DeleteTablet for tablet 8efed4e8d0944767af9a0652b2dfc14a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:36:57 UTC) from {username='oryx', principal='oryx/127.20.171.125@KRBTEST.COM'} at 127.0.0.1:59354
I20260807 10:36:57.175376 28571 tablet_service.cc:1514] Processing DeleteTablet for tablet 8efed4e8d0944767af9a0652b2dfc14a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:36:57 UTC) from {username='oryx', principal='oryx/127.20.171.125@KRBTEST.COM'} at 127.0.0.1:33434
I20260807 10:36:57.176378 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 28271
I20260807 10:36:57.187829 28909 tablet_replica.cc:330] T 8efed4e8d0944767af9a0652b2dfc14a P 0ee4d53fcb5c47acbc12ef3ba680766a: stopping tablet replica
I20260807 10:36:57.188459 28911 tablet_replica.cc:330] T 8efed4e8d0944767af9a0652b2dfc14a P 13625247901b4ad7a38dae319a093281: stopping tablet replica
I20260807 10:36:57.188824 28911 raft_consensus.cc:2229] T 8efed4e8d0944767af9a0652b2dfc14a P 13625247901b4ad7a38dae319a093281 [term 1 LEADER]: Raft consensus shutting down.
I20260807 10:36:57.189208 28909 raft_consensus.cc:2229] T 8efed4e8d0944767af9a0652b2dfc14a P 0ee4d53fcb5c47acbc12ef3ba680766a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 10:36:57.189564 28909 raft_consensus.cc:2258] T 8efed4e8d0944767af9a0652b2dfc14a P 0ee4d53fcb5c47acbc12ef3ba680766a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:36:57.189599 28910 tablet_replica.cc:330] T 8efed4e8d0944767af9a0652b2dfc14a P c04827968c1b4c469f0b4cbf1bf63c3d: stopping tablet replica
I20260807 10:36:57.189777 28910 raft_consensus.cc:2229] T 8efed4e8d0944767af9a0652b2dfc14a P c04827968c1b4c469f0b4cbf1bf63c3d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 10:36:57.190078 28910 raft_consensus.cc:2258] T 8efed4e8d0944767af9a0652b2dfc14a P c04827968c1b4c469f0b4cbf1bf63c3d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:36:57.190305 28911 raft_consensus.cc:2258] T 8efed4e8d0944767af9a0652b2dfc14a P 13625247901b4ad7a38dae319a093281 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:36:57.191270 28909 ts_tablet_manager.cc:1905] T 8efed4e8d0944767af9a0652b2dfc14a P 0ee4d53fcb5c47acbc12ef3ba680766a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 10:36:57.191314 28910 ts_tablet_manager.cc:1905] T 8efed4e8d0944767af9a0652b2dfc14a P c04827968c1b4c469f0b4cbf1bf63c3d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 10:36:57.195758 28911 ts_tablet_manager.cc:1905] T 8efed4e8d0944767af9a0652b2dfc14a P 13625247901b4ad7a38dae319a093281: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 10:36:57.196974 28909 ts_tablet_manager.cc:1918] T 8efed4e8d0944767af9a0652b2dfc14a P 0ee4d53fcb5c47acbc12ef3ba680766a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 10:36:57.197118 28909 log.cc:1196] T 8efed4e8d0944767af9a0652b2dfc14a P 0ee4d53fcb5c47acbc12ef3ba680766a: Deleting WAL directory at /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/ts-2/wal/wals/8efed4e8d0944767af9a0652b2dfc14a
I20260807 10:36:57.197600 28909 ts_tablet_manager.cc:1939] T 8efed4e8d0944767af9a0652b2dfc14a P 0ee4d53fcb5c47acbc12ef3ba680766a: Deleting consensus metadata
I20260807 10:36:57.198781 28089 catalog_manager.cc:4841] TS 0ee4d53fcb5c47acbc12ef3ba680766a (127.20.171.67:37807): tablet 8efed4e8d0944767af9a0652b2dfc14a (table test-table [id=ad514446e30a4396b6d5fe7856828618]) successfully deleted
I20260807 10:36:57.199754 28910 ts_tablet_manager.cc:1918] T 8efed4e8d0944767af9a0652b2dfc14a P c04827968c1b4c469f0b4cbf1bf63c3d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 10:36:57.199909 28910 log.cc:1196] T 8efed4e8d0944767af9a0652b2dfc14a P c04827968c1b4c469f0b4cbf1bf63c3d: Deleting WAL directory at /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/ts-0/wal/wals/8efed4e8d0944767af9a0652b2dfc14a
I20260807 10:36:57.200531 28910 ts_tablet_manager.cc:1939] T 8efed4e8d0944767af9a0652b2dfc14a P c04827968c1b4c469f0b4cbf1bf63c3d: Deleting consensus metadata
I20260807 10:36:57.201828 28089 catalog_manager.cc:4841] TS c04827968c1b4c469f0b4cbf1bf63c3d (127.20.171.65:42425): tablet 8efed4e8d0944767af9a0652b2dfc14a (table test-table [id=ad514446e30a4396b6d5fe7856828618]) successfully deleted
I20260807 10:36:57.204319 28911 ts_tablet_manager.cc:1918] T 8efed4e8d0944767af9a0652b2dfc14a P 13625247901b4ad7a38dae319a093281: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 10:36:57.204483 28911 log.cc:1196] T 8efed4e8d0944767af9a0652b2dfc14a P 13625247901b4ad7a38dae319a093281: Deleting WAL directory at /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786098956060137-21165-0/minicluster-data/ts-1/wal/wals/8efed4e8d0944767af9a0652b2dfc14a
I20260807 10:36:57.204970 28911 ts_tablet_manager.cc:1939] T 8efed4e8d0944767af9a0652b2dfc14a P 13625247901b4ad7a38dae319a093281: Deleting consensus metadata
I20260807 10:36:57.206164 28091 catalog_manager.cc:4841] TS 13625247901b4ad7a38dae319a093281 (127.20.171.66:45441): tablet 8efed4e8d0944767af9a0652b2dfc14a (table test-table [id=ad514446e30a4396b6d5fe7856828618]) successfully deleted
I20260807 10:36:57.206934 28882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:57.177185 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59366 (local address 127.20.171.65:42425)
0807 10:36:57.177362 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:57.177367 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:57.188747 (+ 11380us) server_negotiation.cc:407] Connection header received
0807 10:36:57.188945 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:57.188950 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:57.189028 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:57.189125 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:36:57.191404 (+ 2279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:57.192492 (+ 1088us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:57.194120 (+ 1628us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:57.194780 (+ 660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:57.194911 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:57.198898 (+ 3987us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:36:57.198915 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:36:57.198935 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:36:57.198981 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:36:57.203334 (+ 4353us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:57.204228 (+ 894us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:57.204237 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:57.204240 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:57.204431 (+ 191us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:57.204951 (+ 520us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:57.204959 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:57.204964 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:57.205482 (+ 518us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:36:57.205777 (+ 295us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:57.206285 (+ 508us) server_negotiation.cc:299] Negotiation successful
0807 10:36:57.206507 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260807 10:36:57.207556 28490 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:36:57.329177 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 28271
I20260807 10:36:57.361464 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 28507
I20260807 10:36:57.375521 28883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:57.362301 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33458 (local address 127.20.171.66:45441)
0807 10:36:57.362509 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:57.362515 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:57.362597 (+ 82us) server_negotiation.cc:407] Connection header received
0807 10:36:57.362821 (+ 224us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:57.362826 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:57.362920 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:57.363027 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:36:57.364518 (+ 1491us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:57.365341 (+ 823us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:57.366599 (+ 1258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:57.367033 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:57.367181 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:57.369797 (+ 2616us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:36:57.369817 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:36:57.369835 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:36:57.369875 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:36:57.372818 (+ 2943us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:57.373403 (+ 585us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:57.373412 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:57.373420 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:57.373547 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:57.373926 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:57.373932 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:57.373936 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:57.374302 (+ 366us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:36:57.374637 (+ 335us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:57.374936 (+ 299us) server_negotiation.cc:299] Negotiation successful
0807 10:36:57.375171 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":95}
I20260807 10:36:57.376309 28633 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:36:57.492350 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 28507
I20260807 10:36:57.516505 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 28652
I20260807 10:36:57.529358 28880 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:57.517279 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59310 (local address 127.20.171.67:37807)
0807 10:36:57.517446 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:57.517450 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:57.517467 (+ 17us) server_negotiation.cc:407] Connection header received
0807 10:36:57.517645 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:57.517649 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:57.517711 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:57.517800 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:36:57.518997 (+ 1197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:57.519665 (+ 668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:57.521110 (+ 1445us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:57.521478 (+ 368us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:57.521560 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:57.524049 (+ 2489us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:36:57.524065 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:36:57.524082 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:36:57.524128 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:36:57.526803 (+ 2675us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:57.527475 (+ 672us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:57.527481 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:57.527483 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:57.527608 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:57.527903 (+ 295us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:57.527906 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:57.527908 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:57.528246 (+ 338us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:36:57.528552 (+ 306us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:57.528812 (+ 260us) server_negotiation.cc:299] Negotiation successful
0807 10:36:57.528984 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260807 10:36:57.530045 28777 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:36:57.569530 28916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:57.568753 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:45569 (local address 127.0.0.1:37854)
0807 10:36:57.569252 (+ 499us) negotiation.cc:107] Waiting for socket to connect
0807 10:36:57.569365 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.126:45569: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":361,"thread_start_us":255,"threads_started":1}
I20260807 10:36:57.570772 28916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:57.570451 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:45569 (local address 127.0.0.1:37866)
0807 10:36:57.570591 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0807 10:36:57.570662 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.126:45569: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260807 10:36:57.622640 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 28652
I20260807 10:36:57.643141 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 27965
I20260807 10:36:57.644356 28135 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:36:57.765991 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 27965
I20260807 10:36:57.792074 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 28068
I20260807 10:36:57.793128 28338 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:36:57.907671 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 28068
2026-08-07T10:36:57Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (10454 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786098956060137-21165-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 10:36:58 dist-test-slave-0b58 krb5kdc[28922](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 10:36:58 dist-test-slave-0b58 krb5kdc[28922](info): set up 2 sockets
Aug 07 10:36:58 dist-test-slave-0b58 krb5kdc[28922](info): commencing operation
krb5kdc: starting...
W20260807 10:36:58.997630 21165 mini_kdc.cc:121] Time spent starting KDC: real 1.044s user 0.000s sys 0.034s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786098956060137-21165-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786098956060137-21165-0/krb5kdc/test-user.keytab.
Aug 07 10:36:59 dist-test-slave-0b58 krb5kdc[28922](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099019, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T10:36:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T10:36:59Z Disabled control of system clock
WARNING: no policy specified for oryx/127.20.171.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.20.171.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.20.171.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786098956060137-21165-0/krb5kdc/oryx_127.20.171.126.keytab.
Entry for principal oryx/127.20.171.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786098956060137-21165-0/krb5kdc/oryx_127.20.171.126.keytab.
I20260807 10:36:59.267405 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786098956060137-21165-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786098956060137-21165-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786098956060137-21165-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.171.126:38447
--webserver_interface=127.20.171.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786098956060137-21165-0/krb5kdc/oryx_127.20.171.126.keytab
--principal=oryx/127.20.171.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.171.84:38961
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.171.126:38447
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786098956060137-21165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786098956060137-21165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786098956060137-21165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:36:59.611213 28937 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:36:59.611636 28937 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:36:59.611797 28937 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:36:59.619167 28937 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 10:36:59.619300 28937 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260807 10:36:59.619392 28937 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:36:59.619510 28937 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:36:59.619596 28937 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 10:36:59.619705 28937 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 10:36:59.630162 28937 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.171.84:38961
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786098956060137-21165-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786098956060137-21165-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.171.126:38447
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786098956060137-21165-0/krb5kdc/oryx_127.20.171.126.keytab
--principal=oryx/127.20.171.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.171.126:38447
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.171.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786098956060137-21165-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:36:59.631835 28937 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:36:59.633256 28937 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:36:59.645313 28943 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:36:59.645234 28942 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:36:59.645277 28945 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:36:59.646054 28937 server_base.cc:1034] running on GCE node
I20260807 10:36:59.646868 28937 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:36:59.648240 28937 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:36:59.649537 28937 hybrid_clock.cc:648] HybridClock initialized: now 1786099019649477 us; error 38 us; skew 500 ppm
I20260807 10:36:59.649896 28937 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:36:59 dist-test-slave-0b58 krb5kdc[28922](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099019, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.171.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:36:59.653223 28937 init.cc:377] Logged in from keytab as oryx/127.20.171.126@KRBTEST.COM (short username oryx)
I20260807 10:36:59.654736 28937 webserver.cc:460] Webserver started at http://127.20.171.126:46315/ using document root <none> and password file <none>
I20260807 10:36:59.655490 28937 fs_manager.cc:359] Metadata directory not provided
I20260807 10:36:59.655606 28937 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:36:59.655944 28937 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:36:59.658977 28937 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786098956060137-21165-0/minicluster-data/master-0/data/instance:
uuid: "afbbf2687d4748f4a90abc23e7f73be8"
format_stamp: "Formatted at 2026-08-07 10:36:59 on dist-test-slave-0b58"
server_key: "1562d3d374e86eaa9e745189e802a797"
server_key_iv: "4a164fc1bc2da4997866bf2784680836"
server_key_version: "encryptionkey@0"
I20260807 10:36:59.659811 28937 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786098956060137-21165-0/minicluster-data/master-0/wal/instance:
uuid: "afbbf2687d4748f4a90abc23e7f73be8"
format_stamp: "Formatted at 2026-08-07 10:36:59 on dist-test-slave-0b58"
server_key: "1562d3d374e86eaa9e745189e802a797"
server_key_iv: "4a164fc1bc2da4997866bf2784680836"
server_key_version: "encryptionkey@0"
I20260807 10:36:59.665066 28937 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260807 10:36:59.668588 28953 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:36:59.669937 28937 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260807 10:36:59.670142 28937 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786098956060137-21165-0/minicluster-data/master-0/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786098956060137-21165-0/minicluster-data/master-0/wal
uuid: "afbbf2687d4748f4a90abc23e7f73be8"
format_stamp: "Formatted at 2026-08-07 10:36:59 on dist-test-slave-0b58"
server_key: "1562d3d374e86eaa9e745189e802a797"
server_key_iv: "4a164fc1bc2da4997866bf2784680836"
server_key_version: "encryptionkey@0"
I20260807 10:36:59.670398 28937 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786098956060137-21165-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786098956060137-21165-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786098956060137-21165-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:36:59.695237 28937 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:36:59.699170 28937 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:36:59.699491 28937 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:36:59.722049 28937 rpc_server.cc:307] RPC server started. Bound to: 127.20.171.126:38447
I20260807 10:36:59.722069 29015 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.171.126:38447 every 8 connection(s)
I20260807 10:36:59.723421 28937 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
I20260807 10:36:59.727211 29016 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:36:59.733873 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 28937
I20260807 10:36:59.734102 21165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786098956060137-21165-0/minicluster-data/master-0/wal/instance
I20260807 10:36:59.734794 21165 external_mini_cluster.cc:1428] Setting key 3f48f9f95ec24480b45e7ba3c2288dbd
I20260807 10:36:59.737825 29016 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P afbbf2687d4748f4a90abc23e7f73be8: Bootstrap starting.
I20260807 10:36:59.740942 29016 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P afbbf2687d4748f4a90abc23e7f73be8: Neither blocks nor log segments found. Creating new log.
I20260807 10:36:59.741925 29016 log.cc:824] T 00000000000000000000000000000000 P afbbf2687d4748f4a90abc23e7f73be8: Log is configured to *not* fsync() on all Append() calls
I20260807 10:36:59.744679 29016 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P afbbf2687d4748f4a90abc23e7f73be8: No bootstrap required, opened a new log
Aug 07 10:36:59 dist-test-slave-0b58 krb5kdc[28922](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099019, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.20.171.126@KRBTEST.COM
I20260807 10:36:59.753038 29016 raft_consensus.cc:348] T 00000000000000000000000000000000 P afbbf2687d4748f4a90abc23e7f73be8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "afbbf2687d4748f4a90abc23e7f73be8" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 38447 } }
I20260807 10:36:59.753414 29016 raft_consensus.cc:374] T 00000000000000000000000000000000 P afbbf2687d4748f4a90abc23e7f73be8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:36:59.753528 29016 raft_consensus.cc:729] T 00000000000000000000000000000000 P afbbf2687d4748f4a90abc23e7f73be8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afbbf2687d4748f4a90abc23e7f73be8, State: Initialized, Role: FOLLOWER
I20260807 10:36:59.754204 29016 consensus_queue.cc:260] T 00000000000000000000000000000000 P afbbf2687d4748f4a90abc23e7f73be8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "afbbf2687d4748f4a90abc23e7f73be8" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 38447 } }
I20260807 10:36:59.754444 29016 raft_consensus.cc:388] T 00000000000000000000000000000000 P afbbf2687d4748f4a90abc23e7f73be8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 10:36:59.754634 29016 raft_consensus.cc:482] T 00000000000000000000000000000000 P afbbf2687d4748f4a90abc23e7f73be8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 10:36:59.754837 29016 raft_consensus.cc:3037] T 00000000000000000000000000000000 P afbbf2687d4748f4a90abc23e7f73be8 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:36:59.757292 29016 raft_consensus.cc:504] T 00000000000000000000000000000000 P afbbf2687d4748f4a90abc23e7f73be8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "afbbf2687d4748f4a90abc23e7f73be8" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 38447 } }
I20260807 10:36:59.757411 29019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:36:59.736874 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37084 (local address 127.20.171.126:38447)
0807 10:36:59.737725 (+ 851us) server_negotiation.cc:206] Beginning negotiation
0807 10:36:59.737736 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 10:36:59.737775 (+ 39us) server_negotiation.cc:407] Connection header received
0807 10:36:59.739516 (+ 1741us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:36:59.739537 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:36:59.739885 (+ 348us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:36:59.740248 (+ 363us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:36:59.741873 (+ 1625us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:59.743348 (+ 1475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:59.744678 (+ 1330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:36:59.745410 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:36:59.745601 (+ 191us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:36:59.749845 (+ 4244us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:36:59.749852 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:36:59.749867 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:36:59.749905 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:36:59.753088 (+ 3183us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:59.753915 (+ 827us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:59.753922 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:59.753928 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:59.754109 (+ 181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:36:59.754575 (+ 466us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:36:59.754580 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:36:59.754582 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:36:59.755194 (+ 612us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:36:59.755580 (+ 386us) server_negotiation.cc:1035] Waiting for connection context
0807 10:36:59.755998 (+ 418us) server_negotiation.cc:299] Negotiation successful
0807 10:36:59.756477 (+ 479us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":648,"thread_start_us":438,"threads_started":1}
I20260807 10:36:59.757920 29016 leader_election.cc:302] T 00000000000000000000000000000000 P afbbf2687d4748f4a90abc23e7f73be8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: afbbf2687d4748f4a90abc23e7f73be8; no voters:
I20260807 10:36:59.758584 29016 leader_election.cc:288] T 00000000000000000000000000000000 P afbbf2687d4748f4a90abc23e7f73be8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 10:36:59.758702 29021 raft_consensus.cc:2781] T 00000000000000000000000000000000 P afbbf2687d4748f4a90abc23e7f73be8 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:36:59.759863 29021 raft_consensus.cc:686] T 00000000000000000000000000000000 P afbbf2687d4748f4a90abc23e7f73be8 [term 1 LEADER]: Becoming Leader. State: Replica: afbbf2687d4748f4a90abc23e7f73be8, State: Running, Role: LEADER
I20260807 10:36:59.760507 29021 consensus_queue.cc:237] T 00000000000000000000000000000000 P afbbf2687d4748f4a90abc23e7f73be8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "afbbf2687d4748f4a90abc23e7f73be8" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 38447 } }
I20260807 10:36:59.760730 29016 sys_catalog.cc:564] T 00000000000000000000000000000000 P afbbf2687d4748f4a90abc23e7f73be8 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 10:36:59.763243 29023 sys_catalog.cc:455] T 00000000000000000000000000000000 P afbbf2687d4748f4a90abc23e7f73be8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader afbbf2687d4748f4a90abc23e7f73be8. Latest consensus state: current_term: 1 leader_uuid: "afbbf2687d4748f4a90abc23e7f73be8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "afbbf2687d4748f4a90abc23e7f73be8" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 38447 } } }
I20260807 10:36:59.763620 29023 sys_catalog.cc:458] T 00000000000000000000000000000000 P afbbf2687d4748f4a90abc23e7f73be8 [sys.catalog]: This master's current role is: LEADER
I20260807 10:36:59.764212 29022 sys_catalog.cc:455] T 00000000000000000000000000000000 P afbbf2687d4748f4a90abc23e7f73be8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "afbbf2687d4748f4a90abc23e7f73be8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "afbbf2687d4748f4a90abc23e7f73be8" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 38447 } } }
I20260807 10:36:59.764570 29022 sys_catalog.cc:458] T 00000000000000000000000000000000 P afbbf2687d4748f4a90abc23e7f73be8 [sys.catalog]: This master's current role is: LEADER
I20260807 10:36:59.764662 29029 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 10:36:59.771193 29029 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 10:36:59.781009 29029 catalog_manager.cc:1347] Generated new cluster ID: ed0ad24b1e67426287b24c47006703ed
I20260807 10:36:59.781123 29029 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 10:36:59.826471 29029 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 10:36:59.827841 29029 catalog_manager.cc:1504] Loading token signing keys...
I20260807 10:36:59.835351 29029 catalog_manager.cc:5868] T 00000000000000000000000000000000 P afbbf2687d4748f4a90abc23e7f73be8: Generated new TSK 0
I20260807 10:36:59.836206 29029 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.20.171.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.20.171.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.20.171.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786098956060137-21165-0/krb5kdc/oryx_127.20.171.65.keytab.
Entry for principal oryx/127.20.171.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786098956060137-21165-0/krb5kdc/oryx_127.20.171.65.keytab.
I20260807 10:36:59.902256 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786098956060137-21165-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786098956060137-21165-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786098956060137-21165-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786098956060137-21165-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.171.65:0
--local_ip_for_outbound_sockets=127.20.171.65
--webserver_interface=127.20.171.65
--webserver_port=0
--tserver_master_addrs=127.20.171.126:38447
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786098956060137-21165-0/krb5kdc/oryx_127.20.171.65.keytab
--principal=oryx/127.20.171.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.171.84:38961
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786098956060137-21165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786098956060137-21165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786098956060137-21165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:37:00.244751 29043 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:37:00.245005 29043 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:37:00.245193 29043 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:37:00.252193 29043 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:37:00.252353 29043 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:37:00.252465 29043 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 10:37:00.252627 29043 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.171.65
I20260807 10:37:00.262540 29043 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.171.84:38961
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786098956060137-21165-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786098956060137-21165-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786098956060137-21165-0/krb5kdc/oryx_127.20.171.65.keytab
--principal=oryx/127.20.171.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.171.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786098956060137-21165-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.171.65
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.20.171.126:38447
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.171.65
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786098956060137-21165-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:37:00.263840 29043 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:37:00.265292 29043 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:37:00.278726 29051 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:37:00.278801 29049 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:37:00.278855 29048 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:37:00.279510 29043 server_base.cc:1034] running on GCE node
I20260807 10:37:00.280032 29043 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:37:00.280926 29043 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:37:00.282142 29043 hybrid_clock.cc:648] HybridClock initialized: now 1786099020282092 us; error 30 us; skew 500 ppm
I20260807 10:37:00.282398 29043 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:37:00 dist-test-slave-0b58 krb5kdc[28922](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099020, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.171.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:37:00.285586 29043 init.cc:377] Logged in from keytab as oryx/127.20.171.65@KRBTEST.COM (short username oryx)
I20260807 10:37:00.286906 29043 webserver.cc:460] Webserver started at http://127.20.171.65:37659/ using document root <none> and password file <none>
I20260807 10:37:00.287539 29043 fs_manager.cc:359] Metadata directory not provided
I20260807 10:37:00.287621 29043 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:37:00.287894 29043 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:37:00.290711 29043 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786098956060137-21165-0/minicluster-data/ts-0/data/instance:
uuid: "4c66026400c2412c9a10d80634b29bc3"
format_stamp: "Formatted at 2026-08-07 10:37:00 on dist-test-slave-0b58"
server_key: "f2d9e3cbcad3df83613d536416c88a90"
server_key_iv: "d5aa551d84f71c53cf7fa0f7115850e5"
server_key_version: "encryptionkey@0"
I20260807 10:37:00.291499 29043 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786098956060137-21165-0/minicluster-data/ts-0/wal/instance:
uuid: "4c66026400c2412c9a10d80634b29bc3"
format_stamp: "Formatted at 2026-08-07 10:37:00 on dist-test-slave-0b58"
server_key: "f2d9e3cbcad3df83613d536416c88a90"
server_key_iv: "d5aa551d84f71c53cf7fa0f7115850e5"
server_key_version: "encryptionkey@0"
I20260807 10:37:00.296509 29043 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.002s
I20260807 10:37:00.299741 29058 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:37:00.301038 29043 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 10:37:00.301205 29043 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786098956060137-21165-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786098956060137-21165-0/minicluster-data/ts-0/wal
uuid: "4c66026400c2412c9a10d80634b29bc3"
format_stamp: "Formatted at 2026-08-07 10:37:00 on dist-test-slave-0b58"
server_key: "f2d9e3cbcad3df83613d536416c88a90"
server_key_iv: "d5aa551d84f71c53cf7fa0f7115850e5"
server_key_version: "encryptionkey@0"
I20260807 10:37:00.301412 29043 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786098956060137-21165-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786098956060137-21165-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786098956060137-21165-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:37:00.334025 29043 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:37:00.338651 29043 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:37:00.338935 29043 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:37:00.341692 29043 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:37:00.341815 29043 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:37:00.342011 29043 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:37:00.342106 29043 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 07 10:37:00 dist-test-slave-0b58 krb5kdc[28922](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099020, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.171.65@KRBTEST.COM for oryx/127.20.171.126@KRBTEST.COM
I20260807 10:37:00.366667 29067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:37:00.342150 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.65:47123 (local address 127.20.171.126:38447)
0807 10:37:00.342742 (+ 592us) server_negotiation.cc:206] Beginning negotiation
0807 10:37:00.342752 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 10:37:00.343930 (+ 1178us) server_negotiation.cc:407] Connection header received
0807 10:37:00.346215 (+ 2285us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:37:00.346224 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:37:00.346332 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:37:00.346476 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:37:00.348881 (+ 2405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:00.349878 (+ 997us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:00.353414 (+ 3536us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:00.353854 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:00.354054 (+ 200us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:00.359010 (+ 4956us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:37:00.359016 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:37:00.359019 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:37:00.359053 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:37:00.362404 (+ 3351us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:37:00.363495 (+ 1091us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:37:00.363499 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:37:00.363501 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:37:00.363681 (+ 180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:37:00.364446 (+ 765us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:37:00.364452 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:37:00.364456 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:37:00.364780 (+ 324us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:37:00.364965 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0807 10:37:00.365980 (+ 1015us) server_negotiation.cc:299] Negotiation successful
0807 10:37:00.366252 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":428,"thread_start_us":270,"threads_started":1}
I20260807 10:37:00.367892 29069 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:37:00.342776 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:38447 (local address 127.20.171.65:47123)
0807 10:37:00.343755 (+ 979us) negotiation.cc:107] Waiting for socket to connect
0807 10:37:00.343803 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0807 10:37:00.345829 (+ 2026us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:37:00.346771 (+ 942us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:37:00.346788 (+ 17us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:37:00.347764 (+ 976us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:37:00.348681 (+ 917us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:00.348706 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:00.350094 (+ 1388us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:00.350102 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:00.353228 (+ 3126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:00.353251 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:00.354418 (+ 1167us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:00.354425 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:00.354760 (+ 335us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:00.355630 (+ 870us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:37:00.355672 (+ 42us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:37:00.358753 (+ 3081us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:37:00.362578 (+ 3825us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:37:00.362590 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:37:00.362612 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:37:00.363319 (+ 707us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:37:00.363818 (+ 499us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:37:00.363825 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:37:00.363832 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:37:00.364242 (+ 410us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:37:00.365066 (+ 824us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:37:00.365078 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:37:00.365590 (+ 512us) client_negotiation.cc:769] Sending connection context
0807 10:37:00.365856 (+ 266us) client_negotiation.cc:240] Negotiation successful
0807 10:37:00.366480 (+ 624us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":710,"thread_start_us":506,"threads_started":1}
I20260807 10:37:00.388043 29135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:37:00.374295 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:38447 (local address 127.20.171.65:49259)
0807 10:37:00.375019 (+ 724us) negotiation.cc:107] Waiting for socket to connect
0807 10:37:00.375038 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 10:37:00.375216 (+ 178us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:37:00.375640 (+ 424us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:37:00.375644 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:37:00.376230 (+ 586us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:37:00.376827 (+ 597us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:00.376839 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:00.377808 (+ 969us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:00.377814 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:00.378764 (+ 950us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:00.378775 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:00.379498 (+ 723us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:00.379506 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:00.379657 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:00.380334 (+ 677us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:37:00.380369 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:37:00.381463 (+ 1094us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:37:00.385231 (+ 3768us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:37:00.385238 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:37:00.385245 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:37:00.385747 (+ 502us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:37:00.386161 (+ 414us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:37:00.386166 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:37:00.386170 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:37:00.386307 (+ 137us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:37:00.386984 (+ 677us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:37:00.386988 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:37:00.387225 (+ 237us) client_negotiation.cc:769] Sending connection context
0807 10:37:00.387421 (+ 196us) client_negotiation.cc:240] Negotiation successful
0807 10:37:00.387724 (+ 303us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":579,"thread_start_us":450,"threads_started":1}
I20260807 10:37:00.388374 29067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:37:00.374169 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.65:49259 (local address 127.20.171.126:38447)
0807 10:37:00.374348 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0807 10:37:00.374354 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:37:00.375132 (+ 778us) server_negotiation.cc:407] Connection header received
0807 10:37:00.375439 (+ 307us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:37:00.375443 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:37:00.375516 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:37:00.375614 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:37:00.376991 (+ 1377us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:00.377674 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:00.378912 (+ 1238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:00.379311 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:00.379445 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:00.381651 (+ 2206us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:37:00.381663 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:37:00.381667 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:37:00.381698 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:37:00.385038 (+ 3340us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:37:00.385885 (+ 847us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:37:00.385889 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:37:00.385891 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:37:00.386020 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:37:00.386426 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:37:00.386432 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:37:00.386435 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:37:00.386829 (+ 394us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:37:00.387019 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0807 10:37:00.387591 (+ 572us) server_negotiation.cc:299] Negotiation successful
0807 10:37:00.387889 (+ 298us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260807 10:37:00.395843 29043 rpc_server.cc:307] RPC server started. Bound to: 127.20.171.65:34279
I20260807 10:37:00.395870 29181 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.171.65:34279 every 8 connection(s)
I20260807 10:37:00.397100 29043 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786098956060137-21165-0/minicluster-data/ts-0/data/info.pb
I20260807 10:37:00.399322 29182 heartbeater.cc:347] Connected to a master server at 127.20.171.126:38447
I20260807 10:37:00.399554 29182 heartbeater.cc:464] Registering TS with master...
I20260807 10:37:00.400218 29182 heartbeater.cc:511] Master 127.20.171.126:38447 requested a full tablet report, sending...
I20260807 10:37:00.400807 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 29043
I20260807 10:37:00.401033 21165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786098956060137-21165-0/minicluster-data/ts-0/wal/instance
I20260807 10:37:00.401872 21165 external_mini_cluster.cc:1428] Setting key d8f3c9e1e0f9f5a94b17794e3ce2a0ba
I20260807 10:37:00.402693 28970 ts_manager.cc:194] Registered new tserver with Master: 4c66026400c2412c9a10d80634b29bc3 (127.20.171.65:34279)
I20260807 10:37:00.404376 28970 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.20.171.65@KRBTEST.COM'} at 127.20.171.65:47123
WARNING: no policy specified for oryx/127.20.171.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.20.171.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.20.171.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786098956060137-21165-0/krb5kdc/oryx_127.20.171.66.keytab.
Entry for principal oryx/127.20.171.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786098956060137-21165-0/krb5kdc/oryx_127.20.171.66.keytab.
I20260807 10:37:00.460891 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786098956060137-21165-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786098956060137-21165-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786098956060137-21165-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786098956060137-21165-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.171.66:0
--local_ip_for_outbound_sockets=127.20.171.66
--webserver_interface=127.20.171.66
--webserver_port=0
--tserver_master_addrs=127.20.171.126:38447
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786098956060137-21165-0/krb5kdc/oryx_127.20.171.66.keytab
--principal=oryx/127.20.171.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.171.84:38961
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786098956060137-21165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786098956060137-21165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786098956060137-21165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:37:00.796981 29186 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:37:00.797322 29186 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:37:00.797497 29186 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:37:00.804716 29186 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:37:00.804880 29186 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:37:00.805027 29186 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 10:37:00.805166 29186 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.171.66
I20260807 10:37:00.815244 29186 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.171.84:38961
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786098956060137-21165-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786098956060137-21165-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786098956060137-21165-0/krb5kdc/oryx_127.20.171.66.keytab
--principal=oryx/127.20.171.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.171.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786098956060137-21165-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.171.66
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.20.171.126:38447
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.171.66
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786098956060137-21165-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:37:00.816709 29186 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:37:00.818053 29186 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:37:00.831293 29191 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:37:00.831254 29192 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:37:00.831338 29194 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:37:00.832558 29186 server_base.cc:1034] running on GCE node
I20260807 10:37:00.833230 29186 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:37:00.834172 29186 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:37:00.835417 29186 hybrid_clock.cc:648] HybridClock initialized: now 1786099020835347 us; error 26 us; skew 500 ppm
I20260807 10:37:00.835791 29186 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:37:00 dist-test-slave-0b58 krb5kdc[28922](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099020, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.171.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:37:00.843259 29186 init.cc:377] Logged in from keytab as oryx/127.20.171.66@KRBTEST.COM (short username oryx)
I20260807 10:37:00.844906 29186 webserver.cc:460] Webserver started at http://127.20.171.66:38241/ using document root <none> and password file <none>
I20260807 10:37:00.845606 29186 fs_manager.cc:359] Metadata directory not provided
I20260807 10:37:00.845692 29186 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:37:00.845968 29186 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:37:00.849032 29186 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786098956060137-21165-0/minicluster-data/ts-1/data/instance:
uuid: "eca3d074c7af444494d3aa580f6be541"
format_stamp: "Formatted at 2026-08-07 10:37:00 on dist-test-slave-0b58"
server_key: "6fe1b8dca0ec31804aea357ad16967ff"
server_key_iv: "ced1fd867c2e3a47a79fea3b833690cb"
server_key_version: "encryptionkey@0"
I20260807 10:37:00.849774 29186 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786098956060137-21165-0/minicluster-data/ts-1/wal/instance:
uuid: "eca3d074c7af444494d3aa580f6be541"
format_stamp: "Formatted at 2026-08-07 10:37:00 on dist-test-slave-0b58"
server_key: "6fe1b8dca0ec31804aea357ad16967ff"
server_key_iv: "ced1fd867c2e3a47a79fea3b833690cb"
server_key_version: "encryptionkey@0"
I20260807 10:37:00.855000 29186 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.003s
I20260807 10:37:00.858785 29201 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:37:00.860206 29186 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260807 10:37:00.860395 29186 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786098956060137-21165-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786098956060137-21165-0/minicluster-data/ts-1/wal
uuid: "eca3d074c7af444494d3aa580f6be541"
format_stamp: "Formatted at 2026-08-07 10:37:00 on dist-test-slave-0b58"
server_key: "6fe1b8dca0ec31804aea357ad16967ff"
server_key_iv: "ced1fd867c2e3a47a79fea3b833690cb"
server_key_version: "encryptionkey@0"
I20260807 10:37:00.860636 29186 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786098956060137-21165-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786098956060137-21165-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786098956060137-21165-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:37:00.873456 29186 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:37:00.877620 29186 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:37:00.877919 29186 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:37:00.880682 29186 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:37:00.880800 29186 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:37:00.880949 29186 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:37:00.881022 29186 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 07 10:37:00 dist-test-slave-0b58 krb5kdc[28922](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099020, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.171.66@KRBTEST.COM for oryx/127.20.171.126@KRBTEST.COM
I20260807 10:37:00.903307 29067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:37:00.881089 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.66:47875 (local address 127.20.171.126:38447)
0807 10:37:00.881296 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0807 10:37:00.881303 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:37:00.882665 (+ 1362us) server_negotiation.cc:407] Connection header received
0807 10:37:00.884701 (+ 2036us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:37:00.884707 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:37:00.884807 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:37:00.884919 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:37:00.887150 (+ 2231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:00.888371 (+ 1221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:00.890913 (+ 2542us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:00.891555 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:00.891696 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:00.896230 (+ 4534us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:37:00.896236 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:37:00.896240 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:37:00.896332 (+ 92us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:37:00.899391 (+ 3059us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:37:00.900132 (+ 741us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:37:00.900137 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:37:00.900141 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:37:00.900341 (+ 200us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:37:00.900961 (+ 620us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:37:00.900970 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:37:00.900976 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:37:00.901444 (+ 468us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:37:00.901611 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0807 10:37:00.902370 (+ 759us) server_negotiation.cc:299] Negotiation successful
0807 10:37:00.902705 (+ 335us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260807 10:37:00.903785 29211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:37:00.881713 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:38447 (local address 127.20.171.66:47875)
0807 10:37:00.882501 (+ 788us) negotiation.cc:107] Waiting for socket to connect
0807 10:37:00.882544 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0807 10:37:00.884420 (+ 1876us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:37:00.885155 (+ 735us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:37:00.885163 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:37:00.885965 (+ 802us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:37:00.886934 (+ 969us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:00.886965 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:00.888546 (+ 1581us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:00.888551 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:00.890759 (+ 2208us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:00.890772 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:00.891815 (+ 1043us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:00.891823 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:00.892040 (+ 217us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:00.892822 (+ 782us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:37:00.892848 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:37:00.895920 (+ 3072us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:37:00.899526 (+ 3606us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:37:00.899535 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:37:00.899549 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:37:00.899997 (+ 448us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:37:00.900471 (+ 474us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:37:00.900476 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:37:00.900480 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:37:00.900798 (+ 318us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:37:00.901615 (+ 817us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:37:00.901623 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:37:00.901962 (+ 339us) client_negotiation.cc:769] Sending connection context
0807 10:37:00.902197 (+ 235us) client_negotiation.cc:240] Negotiation successful
0807 10:37:00.902581 (+ 384us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":548,"thread_start_us":337,"threads_started":1}
I20260807 10:37:00.927641 29067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:37:00.910761 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.66:44213 (local address 127.20.171.126:38447)
0807 10:37:00.910963 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0807 10:37:00.910971 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 10:37:00.911895 (+ 924us) server_negotiation.cc:407] Connection header received
0807 10:37:00.912075 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:37:00.912079 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:37:00.912156 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:37:00.912233 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:37:00.913911 (+ 1678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:00.914967 (+ 1056us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:00.917063 (+ 2096us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:00.917508 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:00.917769 (+ 261us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:00.920528 (+ 2759us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:37:00.920534 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:37:00.920539 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:37:00.920574 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:37:00.924357 (+ 3783us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:37:00.925251 (+ 894us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:37:00.925255 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:37:00.925257 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:37:00.925415 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:37:00.925867 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:37:00.925874 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:37:00.925876 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:37:00.926288 (+ 412us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:37:00.926481 (+ 193us) server_negotiation.cc:1035] Waiting for connection context
0807 10:37:00.927064 (+ 583us) server_negotiation.cc:299] Negotiation successful
0807 10:37:00.927289 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260807 10:37:00.927769 29260 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:37:00.910824 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:38447 (local address 127.20.171.66:44213)
0807 10:37:00.911767 (+ 943us) negotiation.cc:107] Waiting for socket to connect
0807 10:37:00.911792 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0807 10:37:00.911960 (+ 168us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:37:00.912317 (+ 357us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:37:00.912324 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:37:00.913144 (+ 820us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:37:00.913738 (+ 594us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:00.913756 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:00.915107 (+ 1351us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:00.915119 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:00.916914 (+ 1795us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:00.916927 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:00.917834 (+ 907us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:00.917840 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:00.918136 (+ 296us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:00.918924 (+ 788us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:37:00.918955 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:37:00.920291 (+ 1336us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:37:00.924508 (+ 4217us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:37:00.924513 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:37:00.924521 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:37:00.925117 (+ 596us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:37:00.925524 (+ 407us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:37:00.925528 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:37:00.925531 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:37:00.925717 (+ 186us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:37:00.926564 (+ 847us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:37:00.926571 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:37:00.926790 (+ 219us) client_negotiation.cc:769] Sending connection context
0807 10:37:00.926961 (+ 171us) client_negotiation.cc:240] Negotiation successful
0807 10:37:00.927289 (+ 328us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":742,"thread_start_us":542,"threads_started":1}
I20260807 10:37:00.935750 29186 rpc_server.cc:307] RPC server started. Bound to: 127.20.171.66:32883
I20260807 10:37:00.935770 29323 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.171.66:32883 every 8 connection(s)
I20260807 10:37:00.936968 29186 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786098956060137-21165-0/minicluster-data/ts-1/data/info.pb
I20260807 10:37:00.938956 29324 heartbeater.cc:347] Connected to a master server at 127.20.171.126:38447
I20260807 10:37:00.939224 29324 heartbeater.cc:464] Registering TS with master...
I20260807 10:37:00.939263 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 29186
I20260807 10:37:00.939437 21165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786098956060137-21165-0/minicluster-data/ts-1/wal/instance
I20260807 10:37:00.939946 29324 heartbeater.cc:511] Master 127.20.171.126:38447 requested a full tablet report, sending...
I20260807 10:37:00.939976 21165 external_mini_cluster.cc:1428] Setting key 45cb92f68ac61baa60c01f50fb434dd5
I20260807 10:37:00.941382 28969 ts_manager.cc:194] Registered new tserver with Master: eca3d074c7af444494d3aa580f6be541 (127.20.171.66:32883)
I20260807 10:37:00.942201 28969 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.20.171.66@KRBTEST.COM'} at 127.20.171.66:47875
WARNING: no policy specified for oryx/127.20.171.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.20.171.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.20.171.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786098956060137-21165-0/krb5kdc/oryx_127.20.171.67.keytab.
Entry for principal oryx/127.20.171.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786098956060137-21165-0/krb5kdc/oryx_127.20.171.67.keytab.
I20260807 10:37:00.995676 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786098956060137-21165-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786098956060137-21165-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786098956060137-21165-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786098956060137-21165-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.171.67:0
--local_ip_for_outbound_sockets=127.20.171.67
--webserver_interface=127.20.171.67
--webserver_port=0
--tserver_master_addrs=127.20.171.126:38447
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786098956060137-21165-0/krb5kdc/oryx_127.20.171.67.keytab
--principal=oryx/127.20.171.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.171.84:38961
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786098956060137-21165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786098956060137-21165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786098956060137-21165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:37:01.320914 29328 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:37:01.321213 29328 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:37:01.321384 29328 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:37:01.328509 29328 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:37:01.328653 29328 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:37:01.328799 29328 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 10:37:01.328943 29328 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.171.67
I20260807 10:37:01.337973 29328 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.171.84:38961
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786098956060137-21165-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786098956060137-21165-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786098956060137-21165-0/krb5kdc/oryx_127.20.171.67.keytab
--principal=oryx/127.20.171.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.171.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786098956060137-21165-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.171.67
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.20.171.126:38447
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.171.67
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786098956060137-21165-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:37:01.339180 29328 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:37:01.340443 29328 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:37:01.352794 29333 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:37:01.352941 29334 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:37:01.352985 29336 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:37:01.353998 29328 server_base.cc:1034] running on GCE node
I20260807 10:37:01.354688 29328 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:37:01.355628 29328 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:37:01.356930 29328 hybrid_clock.cc:648] HybridClock initialized: now 1786099021356847 us; error 60 us; skew 500 ppm
I20260807 10:37:01.357264 29328 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:37:01 dist-test-slave-0b58 krb5kdc[28922](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099021, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.171.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:37:01.360059 29328 init.cc:377] Logged in from keytab as oryx/127.20.171.67@KRBTEST.COM (short username oryx)
I20260807 10:37:01.361572 29328 webserver.cc:460] Webserver started at http://127.20.171.67:43259/ using document root <none> and password file <none>
I20260807 10:37:01.362306 29328 fs_manager.cc:359] Metadata directory not provided
I20260807 10:37:01.362424 29328 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:37:01.362725 29328 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:37:01.365689 29328 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786098956060137-21165-0/minicluster-data/ts-2/data/instance:
uuid: "833cd6ffd2a343ecbad6317bdea2f9e3"
format_stamp: "Formatted at 2026-08-07 10:37:01 on dist-test-slave-0b58"
server_key: "81ce6c26c967e156a1f8b3450c11054d"
server_key_iv: "7611f6c687499285f2f25d60280a912b"
server_key_version: "encryptionkey@0"
I20260807 10:37:01.366513 29328 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786098956060137-21165-0/minicluster-data/ts-2/wal/instance:
uuid: "833cd6ffd2a343ecbad6317bdea2f9e3"
format_stamp: "Formatted at 2026-08-07 10:37:01 on dist-test-slave-0b58"
server_key: "81ce6c26c967e156a1f8b3450c11054d"
server_key_iv: "7611f6c687499285f2f25d60280a912b"
server_key_version: "encryptionkey@0"
I20260807 10:37:01.371637 29328 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260807 10:37:01.375150 29344 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:37:01.376483 29328 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260807 10:37:01.376653 29328 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786098956060137-21165-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786098956060137-21165-0/minicluster-data/ts-2/wal
uuid: "833cd6ffd2a343ecbad6317bdea2f9e3"
format_stamp: "Formatted at 2026-08-07 10:37:01 on dist-test-slave-0b58"
server_key: "81ce6c26c967e156a1f8b3450c11054d"
server_key_iv: "7611f6c687499285f2f25d60280a912b"
server_key_version: "encryptionkey@0"
I20260807 10:37:01.376869 29328 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786098956060137-21165-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786098956060137-21165-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786098956060137-21165-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:37:01.390828 29328 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:37:01.394511 29328 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:37:01.394786 29328 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:37:01.400427 29328 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:37:01.400544 29328 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:37:01.400688 29328 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:37:01.400760 29328 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:37:01.407963 29182 heartbeater.cc:503] Master 127.20.171.126:38447 was elected leader, sending a full tablet report...
Aug 07 10:37:01 dist-test-slave-0b58 krb5kdc[28922](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099021, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.171.67@KRBTEST.COM for oryx/127.20.171.126@KRBTEST.COM
I20260807 10:37:01.418994 29067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:37:01.397971 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.67:48395 (local address 127.20.171.126:38447)
0807 10:37:01.398158 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0807 10:37:01.398164 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:37:01.399351 (+ 1187us) server_negotiation.cc:407] Connection header received
0807 10:37:01.401784 (+ 2433us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:37:01.401790 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:37:01.401897 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:37:01.402000 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:37:01.403592 (+ 1592us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:01.404814 (+ 1222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:01.407550 (+ 2736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:01.408144 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:01.408317 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:01.412673 (+ 4356us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:37:01.412677 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:37:01.412680 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:37:01.412711 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:37:01.415422 (+ 2711us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:37:01.416113 (+ 691us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:37:01.416121 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:37:01.416127 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:37:01.416325 (+ 198us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:37:01.416988 (+ 663us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:37:01.416996 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:37:01.417002 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:37:01.417342 (+ 340us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:37:01.417502 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0807 10:37:01.418375 (+ 873us) server_negotiation.cc:299] Negotiation successful
0807 10:37:01.418609 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260807 10:37:01.420411 29352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:37:01.398418 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:38447 (local address 127.20.171.67:48395)
0807 10:37:01.399190 (+ 772us) negotiation.cc:107] Waiting for socket to connect
0807 10:37:01.399230 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0807 10:37:01.401514 (+ 2284us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:37:01.402358 (+ 844us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:37:01.402365 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:37:01.402851 (+ 486us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:37:01.403403 (+ 552us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:01.403419 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:01.405009 (+ 1590us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:01.405013 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:01.407293 (+ 2280us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:01.407315 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:01.408429 (+ 1114us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:01.408436 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:01.408725 (+ 289us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:01.409600 (+ 875us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:37:01.409638 (+ 38us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:37:01.412449 (+ 2811us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:37:01.415567 (+ 3118us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:37:01.415575 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:37:01.415589 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:37:01.415993 (+ 404us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:37:01.416465 (+ 472us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:37:01.416473 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:37:01.416484 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:37:01.416845 (+ 361us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:37:01.417478 (+ 633us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:37:01.417485 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:37:01.417901 (+ 416us) client_negotiation.cc:769] Sending connection context
0807 10:37:01.418265 (+ 364us) client_negotiation.cc:240] Negotiation successful
0807 10:37:01.418800 (+ 535us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":541,"thread_start_us":358,"threads_started":1}
I20260807 10:37:01.442770 29067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:37:01.426255 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.67:40927 (local address 127.20.171.126:38447)
0807 10:37:01.426434 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0807 10:37:01.426441 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:37:01.427030 (+ 589us) server_negotiation.cc:407] Connection header received
0807 10:37:01.427129 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:37:01.427137 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:37:01.427246 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:37:01.427370 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:37:01.428398 (+ 1028us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:01.429574 (+ 1176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:01.431701 (+ 2127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:01.432437 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:01.432582 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:01.435709 (+ 3127us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:37:01.435718 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:37:01.435724 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:37:01.435771 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:37:01.439309 (+ 3538us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:37:01.440340 (+ 1031us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:37:01.440347 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:37:01.440352 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:37:01.440540 (+ 188us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:37:01.441033 (+ 493us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:37:01.441041 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:37:01.441046 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:37:01.441516 (+ 470us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:37:01.441662 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0807 10:37:01.442363 (+ 701us) server_negotiation.cc:299] Negotiation successful
0807 10:37:01.442525 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260807 10:37:01.443228 29395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:37:01.426367 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:38447 (local address 127.20.171.67:40927)
0807 10:37:01.426920 (+ 553us) negotiation.cc:107] Waiting for socket to connect
0807 10:37:01.426935 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 10:37:01.427035 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:37:01.427382 (+ 347us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:37:01.427386 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:37:01.427824 (+ 438us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:37:01.428176 (+ 352us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:01.428193 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:01.429734 (+ 1541us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:01.429742 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:01.431566 (+ 1824us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:01.431578 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:01.432654 (+ 1076us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:01.432661 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:01.432982 (+ 321us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:01.433901 (+ 919us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:37:01.433933 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:37:01.435426 (+ 1493us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:37:01.439441 (+ 4015us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:37:01.439447 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:37:01.439454 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:37:01.440108 (+ 654us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:37:01.440676 (+ 568us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:37:01.440681 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:37:01.440684 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:37:01.440897 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:37:01.441754 (+ 857us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:37:01.441762 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:37:01.442070 (+ 308us) client_negotiation.cc:769] Sending connection context
0807 10:37:01.442265 (+ 195us) client_negotiation.cc:240] Negotiation successful
0807 10:37:01.442643 (+ 378us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":436,"thread_start_us":309,"threads_started":1}
I20260807 10:37:01.453083 29328 rpc_server.cc:307] RPC server started. Bound to: 127.20.171.67:44071
I20260807 10:37:01.453105 29463 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.171.67:44071 every 8 connection(s)
I20260807 10:37:01.454337 29328 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786098956060137-21165-0/minicluster-data/ts-2/data/info.pb
I20260807 10:37:01.456547 29464 heartbeater.cc:347] Connected to a master server at 127.20.171.126:38447
I20260807 10:37:01.456797 29464 heartbeater.cc:464] Registering TS with master...
I20260807 10:37:01.457446 29464 heartbeater.cc:511] Master 127.20.171.126:38447 requested a full tablet report, sending...
I20260807 10:37:01.458786 28969 ts_manager.cc:194] Registered new tserver with Master: 833cd6ffd2a343ecbad6317bdea2f9e3 (127.20.171.67:44071)
I20260807 10:37:01.459654 28969 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.20.171.67@KRBTEST.COM'} at 127.20.171.67:48395
I20260807 10:37:01.462268 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 29328
I20260807 10:37:01.462448 21165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786098956060137-21165-0/minicluster-data/ts-2/wal/instance
I20260807 10:37:01.462885 21165 external_mini_cluster.cc:1428] Setting key abe4460ce34dcb7c8bd2996f263b2f67
I20260807 10:37:01.465863 21165 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 07 10:37:01 dist-test-slave-0b58 krb5kdc[28922](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099021, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 07 10:37:01 dist-test-slave-0b58 krb5kdc[28922](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.20.171.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 10:37:01 dist-test-slave-0b58 krb5kdc[28922](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.20.171.126@KRBTEST.COM, Server not found in Kerberos database
W20260807 10:37:01.525852 29067 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:37:01.515522 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39940 (local address 127.20.171.126:38447)
0807 10:37:01.515785 (+ 263us) server_negotiation.cc:206] Beginning negotiation
0807 10:37:01.515796 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 10:37:01.515925 (+ 129us) server_negotiation.cc:407] Connection header received
0807 10:37:01.516080 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:37:01.516084 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:37:01.516151 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:37:01.516236 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:37:01.517588 (+ 1352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:01.518342 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:01.519541 (+ 1199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:01.519946 (+ 405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:01.520035 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:01.525589 (+ 5554us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39940: BlockingRecv error: recv got EOF from 127.0.0.1:39940 (error 108)
Metrics: {"server-negotiator.queue_time_us":85}
Aug 07 10:37:01 dist-test-slave-0b58 krb5kdc[28922](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099021, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.20.171.126@KRBTEST.COM
I20260807 10:37:01.542615 29067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:37:01.529183 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39948 (local address 127.20.171.126:38447)
0807 10:37:01.529421 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0807 10:37:01.529428 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:37:01.529677 (+ 249us) server_negotiation.cc:407] Connection header received
0807 10:37:01.529888 (+ 211us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:37:01.529893 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:37:01.529968 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:37:01.530074 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:37:01.531195 (+ 1121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:01.531927 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:01.533256 (+ 1329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:01.533684 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:01.533846 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:01.537601 (+ 3755us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:37:01.537606 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:37:01.537609 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:37:01.537640 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:37:01.540004 (+ 2364us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:37:01.540720 (+ 716us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:37:01.540726 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:37:01.540729 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:37:01.540865 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:37:01.541250 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:37:01.541254 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:37:01.541255 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:37:01.541523 (+ 268us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:37:01.541838 (+ 315us) server_negotiation.cc:1035] Waiting for connection context
0807 10:37:01.542084 (+ 246us) server_negotiation.cc:299] Negotiation successful
0807 10:37:01.542301 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260807 10:37:01.546593 28969 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39948:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 10:37:01.553473 28969 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 10:37:01.580793 29486 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:37:01.566398 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.66:32883 (local address 127.0.0.1:35436)
0807 10:37:01.567389 (+ 991us) negotiation.cc:107] Waiting for socket to connect
0807 10:37:01.567480 (+ 91us) client_negotiation.cc:174] Beginning negotiation
0807 10:37:01.567728 (+ 248us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:37:01.569803 (+ 2075us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:37:01.569815 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:37:01.569862 (+ 47us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:37:01.570423 (+ 561us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:01.570447 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:01.573506 (+ 3059us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:01.573515 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:01.576767 (+ 3252us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:01.576787 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:01.579321 (+ 2534us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:01.579330 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:01.579602 (+ 272us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:01.579679 (+ 77us) client_negotiation.cc:769] Sending connection context
0807 10:37:01.579807 (+ 128us) client_negotiation.cc:240] Negotiation successful
0807 10:37:01.580109 (+ 302us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":642,"mutex_wait_us":1,"thread_start_us":1290,"threads_started":1}
I20260807 10:37:01.582546 29488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:37:01.566933 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35436 (local address 127.20.171.66:32883)
0807 10:37:01.568626 (+ 1693us) server_negotiation.cc:206] Beginning negotiation
0807 10:37:01.568635 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 10:37:01.568665 (+ 30us) server_negotiation.cc:407] Connection header received
0807 10:37:01.568825 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:37:01.568836 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:37:01.569102 (+ 266us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:37:01.569781 (+ 679us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:37:01.571327 (+ 1546us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:01.573302 (+ 1975us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:01.577055 (+ 3753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:01.579010 (+ 1955us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:01.581494 (+ 2484us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:01.581787 (+ 293us) server_negotiation.cc:1035] Waiting for connection context
0807 10:37:01.581876 (+ 89us) server_negotiation.cc:299] Negotiation successful
0807 10:37:01.582109 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1494,"thread_start_us":1361,"threads_started":1}
I20260807 10:37:01.583067 29485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:37:01.566447 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.65:34279 (local address 127.0.0.1:59396)
0807 10:37:01.568079 (+ 1632us) negotiation.cc:107] Waiting for socket to connect
0807 10:37:01.568101 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0807 10:37:01.568254 (+ 153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:37:01.572385 (+ 4131us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:37:01.572393 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:37:01.572432 (+ 39us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:37:01.573008 (+ 576us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:01.573022 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:01.575537 (+ 2515us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:01.575546 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:01.578629 (+ 3083us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:01.578649 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:01.581938 (+ 3289us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:01.581947 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:01.582239 (+ 292us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:01.582295 (+ 56us) client_negotiation.cc:769] Sending connection context
0807 10:37:01.582394 (+ 99us) client_negotiation.cc:240] Negotiation successful
0807 10:37:01.582588 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1468,"spinlock_wait_cycles":1280,"thread_start_us":413,"threads_started":1}
I20260807 10:37:01.583839 29487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:37:01.566522 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59396 (local address 127.20.171.65:34279)
0807 10:37:01.570153 (+ 3631us) server_negotiation.cc:206] Beginning negotiation
0807 10:37:01.570165 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 10:37:01.570199 (+ 34us) server_negotiation.cc:407] Connection header received
0807 10:37:01.570328 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:37:01.570339 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:37:01.570601 (+ 262us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:37:01.570848 (+ 247us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:37:01.573268 (+ 2420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:01.575283 (+ 2015us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:01.578878 (+ 3595us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:01.581281 (+ 2403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:01.581469 (+ 188us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:01.581745 (+ 276us) server_negotiation.cc:1035] Waiting for connection context
0807 10:37:01.583132 (+ 1387us) server_negotiation.cc:299] Negotiation successful
0807 10:37:01.583420 (+ 288us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3426,"thread_start_us":2919,"threads_started":1}
I20260807 10:37:01.587814 29252 tablet_service.cc:1467] Processing CreateTablet for tablet 89b8bc3c27d64daa849fca3ddc610817 (DEFAULT_TABLE table=test-table [id=d9656f8abe254570898496819c22db8a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:37:01.588032 29110 tablet_service.cc:1467] Processing CreateTablet for tablet 89b8bc3c27d64daa849fca3ddc610817 (DEFAULT_TABLE table=test-table [id=d9656f8abe254570898496819c22db8a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:37:01.589435 29252 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 89b8bc3c27d64daa849fca3ddc610817. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:37:01.589464 29110 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 89b8bc3c27d64daa849fca3ddc610817. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:37:01.592492 29486 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:37:01.568966 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.67:44071 (local address 127.0.0.1:59888)
0807 10:37:01.581117 (+ 12151us) negotiation.cc:107] Waiting for socket to connect
0807 10:37:01.581142 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0807 10:37:01.581283 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:37:01.585562 (+ 4279us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:37:01.585567 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:37:01.585600 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:37:01.585797 (+ 197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:01.585810 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:01.587882 (+ 2072us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:01.587887 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:01.589769 (+ 1882us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:01.589786 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:01.591624 (+ 1838us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:01.591632 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:01.591832 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:01.591871 (+ 39us) client_negotiation.cc:769] Sending connection context
0807 10:37:01.591962 (+ 91us) client_negotiation.cc:240] Negotiation successful
0807 10:37:01.592127 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12015,"thread_start_us":15357,"threads_started":1}
I20260807 10:37:01.593726 29490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:37:01.569459 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59888 (local address 127.20.171.67:44071)
0807 10:37:01.584865 (+ 15406us) server_negotiation.cc:206] Beginning negotiation
0807 10:37:01.584889 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0807 10:37:01.584930 (+ 41us) server_negotiation.cc:407] Connection header received
0807 10:37:01.585029 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:37:01.585034 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:37:01.585322 (+ 288us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:37:01.585546 (+ 224us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:37:01.586001 (+ 455us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:01.587690 (+ 1689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:01.589951 (+ 2261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:01.591439 (+ 1488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:01.591588 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:01.593129 (+ 1541us) server_negotiation.cc:1035] Waiting for connection context
0807 10:37:01.593214 (+ 85us) server_negotiation.cc:299] Negotiation successful
0807 10:37:01.593380 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14324,"thread_start_us":14113,"threads_started":1}
I20260807 10:37:01.597759 29399 tablet_service.cc:1467] Processing CreateTablet for tablet 89b8bc3c27d64daa849fca3ddc610817 (DEFAULT_TABLE table=test-table [id=d9656f8abe254570898496819c22db8a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:37:01.599407 29399 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 89b8bc3c27d64daa849fca3ddc610817. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:37:01.603581 29491 tablet_bootstrap.cc:492] T 89b8bc3c27d64daa849fca3ddc610817 P eca3d074c7af444494d3aa580f6be541: Bootstrap starting.
I20260807 10:37:01.605623 29492 tablet_bootstrap.cc:492] T 89b8bc3c27d64daa849fca3ddc610817 P 4c66026400c2412c9a10d80634b29bc3: Bootstrap starting.
I20260807 10:37:01.607748 29491 tablet_bootstrap.cc:654] T 89b8bc3c27d64daa849fca3ddc610817 P eca3d074c7af444494d3aa580f6be541: Neither blocks nor log segments found. Creating new log.
I20260807 10:37:01.609155 29491 log.cc:824] T 89b8bc3c27d64daa849fca3ddc610817 P eca3d074c7af444494d3aa580f6be541: Log is configured to *not* fsync() on all Append() calls
I20260807 10:37:01.609300 29492 tablet_bootstrap.cc:654] T 89b8bc3c27d64daa849fca3ddc610817 P 4c66026400c2412c9a10d80634b29bc3: Neither blocks nor log segments found. Creating new log.
I20260807 10:37:01.610445 29492 log.cc:824] T 89b8bc3c27d64daa849fca3ddc610817 P 4c66026400c2412c9a10d80634b29bc3: Log is configured to *not* fsync() on all Append() calls
I20260807 10:37:01.612607 29491 tablet_bootstrap.cc:492] T 89b8bc3c27d64daa849fca3ddc610817 P eca3d074c7af444494d3aa580f6be541: No bootstrap required, opened a new log
I20260807 10:37:01.612892 29491 ts_tablet_manager.cc:1397] T 89b8bc3c27d64daa849fca3ddc610817 P eca3d074c7af444494d3aa580f6be541: Time spent bootstrapping tablet: real 0.010s user 0.005s sys 0.003s
I20260807 10:37:01.615053 29492 tablet_bootstrap.cc:492] T 89b8bc3c27d64daa849fca3ddc610817 P 4c66026400c2412c9a10d80634b29bc3: No bootstrap required, opened a new log
I20260807 10:37:01.615417 29492 ts_tablet_manager.cc:1397] T 89b8bc3c27d64daa849fca3ddc610817 P 4c66026400c2412c9a10d80634b29bc3: Time spent bootstrapping tablet: real 0.010s user 0.004s sys 0.005s
I20260807 10:37:01.618113 29495 tablet_bootstrap.cc:492] T 89b8bc3c27d64daa849fca3ddc610817 P 833cd6ffd2a343ecbad6317bdea2f9e3: Bootstrap starting.
I20260807 10:37:01.621119 29495 tablet_bootstrap.cc:654] T 89b8bc3c27d64daa849fca3ddc610817 P 833cd6ffd2a343ecbad6317bdea2f9e3: Neither blocks nor log segments found. Creating new log.
I20260807 10:37:01.622229 29495 log.cc:824] T 89b8bc3c27d64daa849fca3ddc610817 P 833cd6ffd2a343ecbad6317bdea2f9e3: Log is configured to *not* fsync() on all Append() calls
I20260807 10:37:01.624925 29491 raft_consensus.cc:348] T 89b8bc3c27d64daa849fca3ddc610817 P eca3d074c7af444494d3aa580f6be541 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c66026400c2412c9a10d80634b29bc3" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 34279 } } peers { permanent_uuid: "eca3d074c7af444494d3aa580f6be541" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 32883 } } peers { permanent_uuid: "833cd6ffd2a343ecbad6317bdea2f9e3" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 44071 } }
I20260807 10:37:01.625422 29495 tablet_bootstrap.cc:492] T 89b8bc3c27d64daa849fca3ddc610817 P 833cd6ffd2a343ecbad6317bdea2f9e3: No bootstrap required, opened a new log
I20260807 10:37:01.625519 29491 raft_consensus.cc:374] T 89b8bc3c27d64daa849fca3ddc610817 P eca3d074c7af444494d3aa580f6be541 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:37:01.625675 29491 raft_consensus.cc:729] T 89b8bc3c27d64daa849fca3ddc610817 P eca3d074c7af444494d3aa580f6be541 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eca3d074c7af444494d3aa580f6be541, State: Initialized, Role: FOLLOWER
I20260807 10:37:01.626305 29495 ts_tablet_manager.cc:1397] T 89b8bc3c27d64daa849fca3ddc610817 P 833cd6ffd2a343ecbad6317bdea2f9e3: Time spent bootstrapping tablet: real 0.008s user 0.007s sys 0.000s
I20260807 10:37:01.626360 29491 consensus_queue.cc:260] T 89b8bc3c27d64daa849fca3ddc610817 P eca3d074c7af444494d3aa580f6be541 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c66026400c2412c9a10d80634b29bc3" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 34279 } } peers { permanent_uuid: "eca3d074c7af444494d3aa580f6be541" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 32883 } } peers { permanent_uuid: "833cd6ffd2a343ecbad6317bdea2f9e3" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 44071 } }
I20260807 10:37:01.626566 29492 raft_consensus.cc:348] T 89b8bc3c27d64daa849fca3ddc610817 P 4c66026400c2412c9a10d80634b29bc3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c66026400c2412c9a10d80634b29bc3" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 34279 } } peers { permanent_uuid: "eca3d074c7af444494d3aa580f6be541" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 32883 } } peers { permanent_uuid: "833cd6ffd2a343ecbad6317bdea2f9e3" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 44071 } }
I20260807 10:37:01.627044 29492 raft_consensus.cc:374] T 89b8bc3c27d64daa849fca3ddc610817 P 4c66026400c2412c9a10d80634b29bc3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:37:01.627224 29492 raft_consensus.cc:729] T 89b8bc3c27d64daa849fca3ddc610817 P 4c66026400c2412c9a10d80634b29bc3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c66026400c2412c9a10d80634b29bc3, State: Initialized, Role: FOLLOWER
I20260807 10:37:01.627724 29324 heartbeater.cc:503] Master 127.20.171.126:38447 was elected leader, sending a full tablet report...
I20260807 10:37:01.628409 29491 ts_tablet_manager.cc:1428] T 89b8bc3c27d64daa849fca3ddc610817 P eca3d074c7af444494d3aa580f6be541: Time spent starting tablet: real 0.015s user 0.010s sys 0.004s
I20260807 10:37:01.629065 29492 consensus_queue.cc:260] T 89b8bc3c27d64daa849fca3ddc610817 P 4c66026400c2412c9a10d80634b29bc3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c66026400c2412c9a10d80634b29bc3" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 34279 } } peers { permanent_uuid: "eca3d074c7af444494d3aa580f6be541" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 32883 } } peers { permanent_uuid: "833cd6ffd2a343ecbad6317bdea2f9e3" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 44071 } }
I20260807 10:37:01.630836 29492 ts_tablet_manager.cc:1428] T 89b8bc3c27d64daa849fca3ddc610817 P 4c66026400c2412c9a10d80634b29bc3: Time spent starting tablet: real 0.015s user 0.013s sys 0.000s
I20260807 10:37:01.636088 29495 raft_consensus.cc:348] T 89b8bc3c27d64daa849fca3ddc610817 P 833cd6ffd2a343ecbad6317bdea2f9e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c66026400c2412c9a10d80634b29bc3" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 34279 } } peers { permanent_uuid: "eca3d074c7af444494d3aa580f6be541" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 32883 } } peers { permanent_uuid: "833cd6ffd2a343ecbad6317bdea2f9e3" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 44071 } }
I20260807 10:37:01.636551 29495 raft_consensus.cc:374] T 89b8bc3c27d64daa849fca3ddc610817 P 833cd6ffd2a343ecbad6317bdea2f9e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:37:01.636665 29495 raft_consensus.cc:729] T 89b8bc3c27d64daa849fca3ddc610817 P 833cd6ffd2a343ecbad6317bdea2f9e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 833cd6ffd2a343ecbad6317bdea2f9e3, State: Initialized, Role: FOLLOWER
I20260807 10:37:01.637216 29495 consensus_queue.cc:260] T 89b8bc3c27d64daa849fca3ddc610817 P 833cd6ffd2a343ecbad6317bdea2f9e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c66026400c2412c9a10d80634b29bc3" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 34279 } } peers { permanent_uuid: "eca3d074c7af444494d3aa580f6be541" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 32883 } } peers { permanent_uuid: "833cd6ffd2a343ecbad6317bdea2f9e3" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 44071 } }
I20260807 10:37:01.638192 29464 heartbeater.cc:503] Master 127.20.171.126:38447 was elected leader, sending a full tablet report...
I20260807 10:37:01.638797 29495 ts_tablet_manager.cc:1428] T 89b8bc3c27d64daa849fca3ddc610817 P 833cd6ffd2a343ecbad6317bdea2f9e3: Time spent starting tablet: real 0.012s user 0.011s sys 0.000s
W20260807 10:37:01.650074 29183 tablet.cc:2369] T 89b8bc3c27d64daa849fca3ddc610817 P 4c66026400c2412c9a10d80634b29bc3: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 10:37:01.688968 29325 tablet.cc:2369] T 89b8bc3c27d64daa849fca3ddc610817 P eca3d074c7af444494d3aa580f6be541: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 10:37:01.706014 29465 tablet.cc:2369] T 89b8bc3c27d64daa849fca3ddc610817 P 833cd6ffd2a343ecbad6317bdea2f9e3: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 10:37:01.768218 29497 raft_consensus.cc:482] T 89b8bc3c27d64daa849fca3ddc610817 P eca3d074c7af444494d3aa580f6be541 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 10:37:01.768615 29497 raft_consensus.cc:504] T 89b8bc3c27d64daa849fca3ddc610817 P eca3d074c7af444494d3aa580f6be541 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c66026400c2412c9a10d80634b29bc3" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 34279 } } peers { permanent_uuid: "eca3d074c7af444494d3aa580f6be541" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 32883 } } peers { permanent_uuid: "833cd6ffd2a343ecbad6317bdea2f9e3" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 44071 } }
I20260807 10:37:01.770356 29497 leader_election.cc:288] T 89b8bc3c27d64daa849fca3ddc610817 P eca3d074c7af444494d3aa580f6be541 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c66026400c2412c9a10d80634b29bc3 (127.20.171.65:34279), 833cd6ffd2a343ecbad6317bdea2f9e3 (127.20.171.67:44071)
I20260807 10:37:01.778028 29487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:37:01.770989 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.66:43895 (local address 127.20.171.65:34279)
0807 10:37:01.771313 (+ 324us) server_negotiation.cc:206] Beginning negotiation
0807 10:37:01.771320 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:37:01.771647 (+ 327us) server_negotiation.cc:407] Connection header received
0807 10:37:01.771904 (+ 257us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:37:01.771909 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:37:01.771983 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:37:01.772102 (+ 119us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:37:01.772734 (+ 632us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:01.773443 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:01.775617 (+ 2174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:01.776819 (+ 1202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:01.776971 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:01.777053 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0807 10:37:01.777650 (+ 597us) server_negotiation.cc:299] Negotiation successful
0807 10:37:01.777776 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":141}
I20260807 10:37:01.778064 29490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:37:01.771056 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.66:35573 (local address 127.20.171.67:44071)
0807 10:37:01.771483 (+ 427us) server_negotiation.cc:206] Beginning negotiation
0807 10:37:01.771489 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:37:01.772101 (+ 612us) server_negotiation.cc:407] Connection header received
0807 10:37:01.772361 (+ 260us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:37:01.772366 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:37:01.772423 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:37:01.772522 (+ 99us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:37:01.773118 (+ 596us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:01.773901 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:01.775877 (+ 1976us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:01.777101 (+ 1224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:01.777270 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:01.777360 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0807 10:37:01.777684 (+ 324us) server_negotiation.cc:299] Negotiation successful
0807 10:37:01.777809 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":294}
I20260807 10:37:01.778241 29501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:37:01.770750 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.65:34279 (local address 127.20.171.66:43895)
0807 10:37:01.771528 (+ 778us) negotiation.cc:107] Waiting for socket to connect
0807 10:37:01.771554 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0807 10:37:01.771748 (+ 194us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:37:01.772133 (+ 385us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:37:01.772138 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:37:01.772163 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:37:01.772577 (+ 414us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:01.772588 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:01.773576 (+ 988us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:01.773582 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:01.775473 (+ 1891us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:01.775485 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:01.777230 (+ 1745us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:01.777250 (+ 20us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:01.777467 (+ 217us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:01.777511 (+ 44us) client_negotiation.cc:769] Sending connection context
0807 10:37:01.777586 (+ 75us) client_negotiation.cc:240] Negotiation successful
0807 10:37:01.777735 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":649,"mutex_wait_us":27,"thread_start_us":887,"threads_started":1}
I20260807 10:37:01.778280 29500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:37:01.770762 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.67:44071 (local address 127.20.171.66:35573)
0807 10:37:01.771969 (+ 1207us) negotiation.cc:107] Waiting for socket to connect
0807 10:37:01.771982 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 10:37:01.772162 (+ 180us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:37:01.772547 (+ 385us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:37:01.772552 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:37:01.772580 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:37:01.772949 (+ 369us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:01.772958 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:01.774054 (+ 1096us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:01.774059 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:01.775678 (+ 1619us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:01.775722 (+ 44us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:01.777332 (+ 1610us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:01.777340 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:01.777468 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:01.777518 (+ 50us) client_negotiation.cc:769] Sending connection context
0807 10:37:01.777627 (+ 109us) client_negotiation.cc:240] Negotiation successful
0807 10:37:01.777763 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1099,"mutex_wait_us":100,"thread_start_us":414,"threads_started":1}
I20260807 10:37:01.779410 29137 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89b8bc3c27d64daa849fca3ddc610817" candidate_uuid: "eca3d074c7af444494d3aa580f6be541" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c66026400c2412c9a10d80634b29bc3" is_pre_election: true
I20260807 10:37:01.779884 29137 raft_consensus.cc:2454] T 89b8bc3c27d64daa849fca3ddc610817 P 4c66026400c2412c9a10d80634b29bc3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eca3d074c7af444494d3aa580f6be541 in term 0.
I20260807 10:37:01.780623 29203 leader_election.cc:302] T 89b8bc3c27d64daa849fca3ddc610817 P eca3d074c7af444494d3aa580f6be541 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c66026400c2412c9a10d80634b29bc3, eca3d074c7af444494d3aa580f6be541; no voters:
I20260807 10:37:01.780768 29419 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89b8bc3c27d64daa849fca3ddc610817" candidate_uuid: "eca3d074c7af444494d3aa580f6be541" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "833cd6ffd2a343ecbad6317bdea2f9e3" is_pre_election: true
I20260807 10:37:01.781087 29497 raft_consensus.cc:2781] T 89b8bc3c27d64daa849fca3ddc610817 P eca3d074c7af444494d3aa580f6be541 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 10:37:01.781268 29497 raft_consensus.cc:482] T 89b8bc3c27d64daa849fca3ddc610817 P eca3d074c7af444494d3aa580f6be541 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 10:37:01.781390 29497 raft_consensus.cc:3037] T 89b8bc3c27d64daa849fca3ddc610817 P eca3d074c7af444494d3aa580f6be541 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:37:01.781335 29419 raft_consensus.cc:2454] T 89b8bc3c27d64daa849fca3ddc610817 P 833cd6ffd2a343ecbad6317bdea2f9e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eca3d074c7af444494d3aa580f6be541 in term 0.
I20260807 10:37:01.783706 29497 raft_consensus.cc:504] T 89b8bc3c27d64daa849fca3ddc610817 P eca3d074c7af444494d3aa580f6be541 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c66026400c2412c9a10d80634b29bc3" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 34279 } } peers { permanent_uuid: "eca3d074c7af444494d3aa580f6be541" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 32883 } } peers { permanent_uuid: "833cd6ffd2a343ecbad6317bdea2f9e3" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 44071 } }
I20260807 10:37:01.784382 29497 leader_election.cc:288] T 89b8bc3c27d64daa849fca3ddc610817 P eca3d074c7af444494d3aa580f6be541 [CANDIDATE]: Term 1 election: Requested vote from peers 4c66026400c2412c9a10d80634b29bc3 (127.20.171.65:34279), 833cd6ffd2a343ecbad6317bdea2f9e3 (127.20.171.67:44071)
I20260807 10:37:01.784863 29419 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89b8bc3c27d64daa849fca3ddc610817" candidate_uuid: "eca3d074c7af444494d3aa580f6be541" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "833cd6ffd2a343ecbad6317bdea2f9e3"
I20260807 10:37:01.784866 29137 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89b8bc3c27d64daa849fca3ddc610817" candidate_uuid: "eca3d074c7af444494d3aa580f6be541" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c66026400c2412c9a10d80634b29bc3"
I20260807 10:37:01.785049 29419 raft_consensus.cc:3037] T 89b8bc3c27d64daa849fca3ddc610817 P 833cd6ffd2a343ecbad6317bdea2f9e3 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:37:01.785075 29137 raft_consensus.cc:3037] T 89b8bc3c27d64daa849fca3ddc610817 P 4c66026400c2412c9a10d80634b29bc3 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:37:01.787299 29419 raft_consensus.cc:2454] T 89b8bc3c27d64daa849fca3ddc610817 P 833cd6ffd2a343ecbad6317bdea2f9e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eca3d074c7af444494d3aa580f6be541 in term 1.
I20260807 10:37:01.787354 29137 raft_consensus.cc:2454] T 89b8bc3c27d64daa849fca3ddc610817 P 4c66026400c2412c9a10d80634b29bc3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eca3d074c7af444494d3aa580f6be541 in term 1.
I20260807 10:37:01.787796 29202 leader_election.cc:302] T 89b8bc3c27d64daa849fca3ddc610817 P eca3d074c7af444494d3aa580f6be541 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 833cd6ffd2a343ecbad6317bdea2f9e3, eca3d074c7af444494d3aa580f6be541; no voters:
I20260807 10:37:01.788131 29497 raft_consensus.cc:2781] T 89b8bc3c27d64daa849fca3ddc610817 P eca3d074c7af444494d3aa580f6be541 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:37:01.788596 29497 raft_consensus.cc:686] T 89b8bc3c27d64daa849fca3ddc610817 P eca3d074c7af444494d3aa580f6be541 [term 1 LEADER]: Becoming Leader. State: Replica: eca3d074c7af444494d3aa580f6be541, State: Running, Role: LEADER
I20260807 10:37:01.789177 29497 consensus_queue.cc:237] T 89b8bc3c27d64daa849fca3ddc610817 P eca3d074c7af444494d3aa580f6be541 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c66026400c2412c9a10d80634b29bc3" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 34279 } } peers { permanent_uuid: "eca3d074c7af444494d3aa580f6be541" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 32883 } } peers { permanent_uuid: "833cd6ffd2a343ecbad6317bdea2f9e3" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 44071 } }
I20260807 10:37:01.793995 28969 catalog_manager.cc:5495] T 89b8bc3c27d64daa849fca3ddc610817 P eca3d074c7af444494d3aa580f6be541 reported cstate change: term changed from 0 to 1, leader changed from <none> to eca3d074c7af444494d3aa580f6be541 (127.20.171.66). New cstate: current_term: 1 leader_uuid: "eca3d074c7af444494d3aa580f6be541" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c66026400c2412c9a10d80634b29bc3" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 34279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eca3d074c7af444494d3aa580f6be541" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 32883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "833cd6ffd2a343ecbad6317bdea2f9e3" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 44071 } health_report { overall_health: UNKNOWN } } }
I20260807 10:37:01.835269 29488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:37:01.830069 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35452 (local address 127.20.171.66:32883)
0807 10:37:01.830278 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0807 10:37:01.830288 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 10:37:01.830306 (+ 18us) server_negotiation.cc:407] Connection header received
0807 10:37:01.830491 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:37:01.830495 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:37:01.830572 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:37:01.830689 (+ 117us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 10:37:01.831006 (+ 317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:01.831698 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:01.833267 (+ 1569us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:01.833684 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:01.833775 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:01.834174 (+ 399us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 10:37:01.834694 (+ 520us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 10:37:01.834798 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0807 10:37:01.834893 (+ 95us) server_negotiation.cc:299] Negotiation successful
0807 10:37:01.834956 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260807 10:37:01.843528 29137 raft_consensus.cc:1261] T 89b8bc3c27d64daa849fca3ddc610817 P 4c66026400c2412c9a10d80634b29bc3 [term 1 FOLLOWER]: Refusing update from remote peer eca3d074c7af444494d3aa580f6be541: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 10:37:01.843526 29419 raft_consensus.cc:1261] T 89b8bc3c27d64daa849fca3ddc610817 P 833cd6ffd2a343ecbad6317bdea2f9e3 [term 1 FOLLOWER]: Refusing update from remote peer eca3d074c7af444494d3aa580f6be541: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 10:37:01.844656 29502 consensus_queue.cc:1035] T 89b8bc3c27d64daa849fca3ddc610817 P eca3d074c7af444494d3aa580f6be541 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c66026400c2412c9a10d80634b29bc3" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 34279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 10:37:01.845026 29497 consensus_queue.cc:1035] T 89b8bc3c27d64daa849fca3ddc610817 P eca3d074c7af444494d3aa580f6be541 [LEADER]: Connected to new peer: Peer: permanent_uuid: "833cd6ffd2a343ecbad6317bdea2f9e3" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 44071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 10:37:01.869796 28970 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39948:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 10:37:01.870042 28970 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39948:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 10:37:01.873744 28970 catalog_manager.cc:5782] T 00000000000000000000000000000000 P afbbf2687d4748f4a90abc23e7f73be8: Sending DeleteTablet for 3 replicas of tablet 89b8bc3c27d64daa849fca3ddc610817
I20260807 10:37:01.874903 29110 tablet_service.cc:1514] Processing DeleteTablet for tablet 89b8bc3c27d64daa849fca3ddc610817 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:37:01 UTC) from {username='oryx', principal='oryx/127.20.171.126@KRBTEST.COM'} at 127.0.0.1:59396
I20260807 10:37:01.875049 29399 tablet_service.cc:1514] Processing DeleteTablet for tablet 89b8bc3c27d64daa849fca3ddc610817 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:37:01 UTC) from {username='oryx', principal='oryx/127.20.171.126@KRBTEST.COM'} at 127.0.0.1:59888
I20260807 10:37:01.875643 29252 tablet_service.cc:1514] Processing DeleteTablet for tablet 89b8bc3c27d64daa849fca3ddc610817 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:37:01 UTC) from {username='oryx', principal='oryx/127.20.171.126@KRBTEST.COM'} at 127.0.0.1:35436
I20260807 10:37:01.876818 28970 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39948:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 10:37:01.877666 28970 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 10:37:01.880962 29516 tablet_replica.cc:330] T 89b8bc3c27d64daa849fca3ddc610817 P 833cd6ffd2a343ecbad6317bdea2f9e3: stopping tablet replica
I20260807 10:37:01.881460 29516 raft_consensus.cc:2229] T 89b8bc3c27d64daa849fca3ddc610817 P 833cd6ffd2a343ecbad6317bdea2f9e3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 10:37:01.883935 29517 tablet_replica.cc:330] T 89b8bc3c27d64daa849fca3ddc610817 P eca3d074c7af444494d3aa580f6be541: stopping tablet replica
I20260807 10:37:01.884465 29517 raft_consensus.cc:2229] T 89b8bc3c27d64daa849fca3ddc610817 P eca3d074c7af444494d3aa580f6be541 [term 1 LEADER]: Raft consensus shutting down.
I20260807 10:37:01.885360 29516 raft_consensus.cc:2258] T 89b8bc3c27d64daa849fca3ddc610817 P 833cd6ffd2a343ecbad6317bdea2f9e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:37:01.885529 29109 tablet_service.cc:1467] Processing CreateTablet for tablet 2bd8398a305f4843bd71b7e2e82138ef (DEFAULT_TABLE table=test-table [id=f3f14cd98ce14543a7ffdab12fdd9dcd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:37:01.886102 29109 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2bd8398a305f4843bd71b7e2e82138ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:37:01.886224 29517 raft_consensus.cc:2258] T 89b8bc3c27d64daa849fca3ddc610817 P eca3d074c7af444494d3aa580f6be541 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:37:01.886264 29399 tablet_service.cc:1467] Processing CreateTablet for tablet 2bd8398a305f4843bd71b7e2e82138ef (DEFAULT_TABLE table=test-table [id=f3f14cd98ce14543a7ffdab12fdd9dcd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:37:01.886937 29399 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2bd8398a305f4843bd71b7e2e82138ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:37:01.888703 29516 ts_tablet_manager.cc:1905] T 89b8bc3c27d64daa849fca3ddc610817 P 833cd6ffd2a343ecbad6317bdea2f9e3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 10:37:01.888907 29517 ts_tablet_manager.cc:1905] T 89b8bc3c27d64daa849fca3ddc610817 P eca3d074c7af444494d3aa580f6be541: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 10:37:01.893074 29252 tablet_service.cc:1467] Processing CreateTablet for tablet 2bd8398a305f4843bd71b7e2e82138ef (DEFAULT_TABLE table=test-table [id=f3f14cd98ce14543a7ffdab12fdd9dcd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:37:01.893553 29252 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2bd8398a305f4843bd71b7e2e82138ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:37:01.896139 29516 ts_tablet_manager.cc:1918] T 89b8bc3c27d64daa849fca3ddc610817 P 833cd6ffd2a343ecbad6317bdea2f9e3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 10:37:01.896349 29516 log.cc:1196] T 89b8bc3c27d64daa849fca3ddc610817 P 833cd6ffd2a343ecbad6317bdea2f9e3: Deleting WAL directory at /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786098956060137-21165-0/minicluster-data/ts-2/wal/wals/89b8bc3c27d64daa849fca3ddc610817
I20260807 10:37:01.896530 29492 tablet_bootstrap.cc:492] T 2bd8398a305f4843bd71b7e2e82138ef P 4c66026400c2412c9a10d80634b29bc3: Bootstrap starting.
I20260807 10:37:01.896891 29516 ts_tablet_manager.cc:1939] T 89b8bc3c27d64daa849fca3ddc610817 P 833cd6ffd2a343ecbad6317bdea2f9e3: Deleting consensus metadata
I20260807 10:37:01.898274 29492 tablet_bootstrap.cc:654] T 2bd8398a305f4843bd71b7e2e82138ef P 4c66026400c2412c9a10d80634b29bc3: Neither blocks nor log segments found. Creating new log.
I20260807 10:37:01.899039 28954 catalog_manager.cc:4841] TS 833cd6ffd2a343ecbad6317bdea2f9e3 (127.20.171.67:44071): tablet 89b8bc3c27d64daa849fca3ddc610817 (table test-table [id=d9656f8abe254570898496819c22db8a]) successfully deleted
I20260807 10:37:01.899425 29517 ts_tablet_manager.cc:1918] T 89b8bc3c27d64daa849fca3ddc610817 P eca3d074c7af444494d3aa580f6be541: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 10:37:01.899726 29517 log.cc:1196] T 89b8bc3c27d64daa849fca3ddc610817 P eca3d074c7af444494d3aa580f6be541: Deleting WAL directory at /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786098956060137-21165-0/minicluster-data/ts-1/wal/wals/89b8bc3c27d64daa849fca3ddc610817
I20260807 10:37:01.900395 29517 ts_tablet_manager.cc:1939] T 89b8bc3c27d64daa849fca3ddc610817 P eca3d074c7af444494d3aa580f6be541: Deleting consensus metadata
I20260807 10:37:01.902601 28954 catalog_manager.cc:4841] TS eca3d074c7af444494d3aa580f6be541 (127.20.171.66:32883): tablet 89b8bc3c27d64daa849fca3ddc610817 (table test-table [id=d9656f8abe254570898496819c22db8a]) successfully deleted
I20260807 10:37:01.904546 29495 tablet_bootstrap.cc:492] T 2bd8398a305f4843bd71b7e2e82138ef P 833cd6ffd2a343ecbad6317bdea2f9e3: Bootstrap starting.
I20260807 10:37:01.906301 29495 tablet_bootstrap.cc:654] T 2bd8398a305f4843bd71b7e2e82138ef P 833cd6ffd2a343ecbad6317bdea2f9e3: Neither blocks nor log segments found. Creating new log.
I20260807 10:37:01.906939 29491 tablet_bootstrap.cc:492] T 2bd8398a305f4843bd71b7e2e82138ef P eca3d074c7af444494d3aa580f6be541: Bootstrap starting.
I20260807 10:37:01.907439 29492 tablet_bootstrap.cc:492] T 2bd8398a305f4843bd71b7e2e82138ef P 4c66026400c2412c9a10d80634b29bc3: No bootstrap required, opened a new log
I20260807 10:37:01.907610 29492 ts_tablet_manager.cc:1397] T 2bd8398a305f4843bd71b7e2e82138ef P 4c66026400c2412c9a10d80634b29bc3: Time spent bootstrapping tablet: real 0.011s user 0.001s sys 0.005s
I20260807 10:37:01.907653 29515 tablet_replica.cc:330] T 89b8bc3c27d64daa849fca3ddc610817 P 4c66026400c2412c9a10d80634b29bc3: stopping tablet replica
I20260807 10:37:01.908104 29515 raft_consensus.cc:2229] T 89b8bc3c27d64daa849fca3ddc610817 P 4c66026400c2412c9a10d80634b29bc3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 10:37:01.908615 29515 raft_consensus.cc:2258] T 89b8bc3c27d64daa849fca3ddc610817 P 4c66026400c2412c9a10d80634b29bc3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:37:01.908509 29492 raft_consensus.cc:348] T 2bd8398a305f4843bd71b7e2e82138ef P 4c66026400c2412c9a10d80634b29bc3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c66026400c2412c9a10d80634b29bc3" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 34279 } } peers { permanent_uuid: "eca3d074c7af444494d3aa580f6be541" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 32883 } } peers { permanent_uuid: "833cd6ffd2a343ecbad6317bdea2f9e3" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 44071 } }
I20260807 10:37:01.908747 29492 raft_consensus.cc:374] T 2bd8398a305f4843bd71b7e2e82138ef P 4c66026400c2412c9a10d80634b29bc3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:37:01.908843 29492 raft_consensus.cc:729] T 2bd8398a305f4843bd71b7e2e82138ef P 4c66026400c2412c9a10d80634b29bc3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c66026400c2412c9a10d80634b29bc3, State: Initialized, Role: FOLLOWER
I20260807 10:37:01.909081 29491 tablet_bootstrap.cc:654] T 2bd8398a305f4843bd71b7e2e82138ef P eca3d074c7af444494d3aa580f6be541: Neither blocks nor log segments found. Creating new log.
I20260807 10:37:01.909145 29492 consensus_queue.cc:260] T 2bd8398a305f4843bd71b7e2e82138ef P 4c66026400c2412c9a10d80634b29bc3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c66026400c2412c9a10d80634b29bc3" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 34279 } } peers { permanent_uuid: "eca3d074c7af444494d3aa580f6be541" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 32883 } } peers { permanent_uuid: "833cd6ffd2a343ecbad6317bdea2f9e3" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 44071 } }
I20260807 10:37:01.911509 29515 ts_tablet_manager.cc:1905] T 89b8bc3c27d64daa849fca3ddc610817 P 4c66026400c2412c9a10d80634b29bc3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 10:37:01.912616 29492 ts_tablet_manager.cc:1428] T 2bd8398a305f4843bd71b7e2e82138ef P 4c66026400c2412c9a10d80634b29bc3: Time spent starting tablet: real 0.005s user 0.000s sys 0.002s
I20260807 10:37:01.917037 29495 tablet_bootstrap.cc:492] T 2bd8398a305f4843bd71b7e2e82138ef P 833cd6ffd2a343ecbad6317bdea2f9e3: No bootstrap required, opened a new log
I20260807 10:37:01.917223 29495 ts_tablet_manager.cc:1397] T 2bd8398a305f4843bd71b7e2e82138ef P 833cd6ffd2a343ecbad6317bdea2f9e3: Time spent bootstrapping tablet: real 0.013s user 0.000s sys 0.004s
I20260807 10:37:01.917851 29491 tablet_bootstrap.cc:492] T 2bd8398a305f4843bd71b7e2e82138ef P eca3d074c7af444494d3aa580f6be541: No bootstrap required, opened a new log
I20260807 10:37:01.918025 29491 ts_tablet_manager.cc:1397] T 2bd8398a305f4843bd71b7e2e82138ef P eca3d074c7af444494d3aa580f6be541: Time spent bootstrapping tablet: real 0.011s user 0.000s sys 0.009s
I20260807 10:37:01.918049 29495 raft_consensus.cc:348] T 2bd8398a305f4843bd71b7e2e82138ef P 833cd6ffd2a343ecbad6317bdea2f9e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c66026400c2412c9a10d80634b29bc3" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 34279 } } peers { permanent_uuid: "eca3d074c7af444494d3aa580f6be541" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 32883 } } peers { permanent_uuid: "833cd6ffd2a343ecbad6317bdea2f9e3" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 44071 } }
I20260807 10:37:01.918288 29495 raft_consensus.cc:374] T 2bd8398a305f4843bd71b7e2e82138ef P 833cd6ffd2a343ecbad6317bdea2f9e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:37:01.918385 29495 raft_consensus.cc:729] T 2bd8398a305f4843bd71b7e2e82138ef P 833cd6ffd2a343ecbad6317bdea2f9e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 833cd6ffd2a343ecbad6317bdea2f9e3, State: Initialized, Role: FOLLOWER
I20260807 10:37:01.918675 29495 consensus_queue.cc:260] T 2bd8398a305f4843bd71b7e2e82138ef P 833cd6ffd2a343ecbad6317bdea2f9e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c66026400c2412c9a10d80634b29bc3" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 34279 } } peers { permanent_uuid: "eca3d074c7af444494d3aa580f6be541" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 32883 } } peers { permanent_uuid: "833cd6ffd2a343ecbad6317bdea2f9e3" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 44071 } }
I20260807 10:37:01.918817 29491 raft_consensus.cc:348] T 2bd8398a305f4843bd71b7e2e82138ef P eca3d074c7af444494d3aa580f6be541 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c66026400c2412c9a10d80634b29bc3" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 34279 } } peers { permanent_uuid: "eca3d074c7af444494d3aa580f6be541" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 32883 } } peers { permanent_uuid: "833cd6ffd2a343ecbad6317bdea2f9e3" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 44071 } }
I20260807 10:37:01.919045 29491 raft_consensus.cc:374] T 2bd8398a305f4843bd71b7e2e82138ef P eca3d074c7af444494d3aa580f6be541 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:37:01.919135 29491 raft_consensus.cc:729] T 2bd8398a305f4843bd71b7e2e82138ef P eca3d074c7af444494d3aa580f6be541 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eca3d074c7af444494d3aa580f6be541, State: Initialized, Role: FOLLOWER
I20260807 10:37:01.919374 29495 ts_tablet_manager.cc:1428] T 2bd8398a305f4843bd71b7e2e82138ef P 833cd6ffd2a343ecbad6317bdea2f9e3: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260807 10:37:01.919384 29491 consensus_queue.cc:260] T 2bd8398a305f4843bd71b7e2e82138ef P eca3d074c7af444494d3aa580f6be541 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c66026400c2412c9a10d80634b29bc3" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 34279 } } peers { permanent_uuid: "eca3d074c7af444494d3aa580f6be541" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 32883 } } peers { permanent_uuid: "833cd6ffd2a343ecbad6317bdea2f9e3" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 44071 } }
I20260807 10:37:01.920008 29491 ts_tablet_manager.cc:1428] T 2bd8398a305f4843bd71b7e2e82138ef P eca3d074c7af444494d3aa580f6be541: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260807 10:37:01.924228 29515 ts_tablet_manager.cc:1918] T 89b8bc3c27d64daa849fca3ddc610817 P 4c66026400c2412c9a10d80634b29bc3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 10:37:01.924439 29515 log.cc:1196] T 89b8bc3c27d64daa849fca3ddc610817 P 4c66026400c2412c9a10d80634b29bc3: Deleting WAL directory at /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786098956060137-21165-0/minicluster-data/ts-0/wal/wals/89b8bc3c27d64daa849fca3ddc610817
I20260807 10:37:01.924984 29515 ts_tablet_manager.cc:1939] T 89b8bc3c27d64daa849fca3ddc610817 P 4c66026400c2412c9a10d80634b29bc3: Deleting consensus metadata
I20260807 10:37:01.926900 28955 catalog_manager.cc:4841] TS 4c66026400c2412c9a10d80634b29bc3 (127.20.171.65:34279): tablet 89b8bc3c27d64daa849fca3ddc610817 (table test-table [id=d9656f8abe254570898496819c22db8a]) successfully deleted
I20260807 10:37:01.955113 29498 raft_consensus.cc:482] T 2bd8398a305f4843bd71b7e2e82138ef P 4c66026400c2412c9a10d80634b29bc3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 10:37:01.955344 29498 raft_consensus.cc:504] T 2bd8398a305f4843bd71b7e2e82138ef P 4c66026400c2412c9a10d80634b29bc3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c66026400c2412c9a10d80634b29bc3" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 34279 } } peers { permanent_uuid: "eca3d074c7af444494d3aa580f6be541" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 32883 } } peers { permanent_uuid: "833cd6ffd2a343ecbad6317bdea2f9e3" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 44071 } }
I20260807 10:37:01.957154 29498 leader_election.cc:288] T 2bd8398a305f4843bd71b7e2e82138ef P 4c66026400c2412c9a10d80634b29bc3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eca3d074c7af444494d3aa580f6be541 (127.20.171.66:32883), 833cd6ffd2a343ecbad6317bdea2f9e3 (127.20.171.67:44071)
I20260807 10:37:01.965201 29488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:37:01.957657 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.65:43623 (local address 127.20.171.66:32883)
0807 10:37:01.957832 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0807 10:37:01.957838 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:37:01.958386 (+ 548us) server_negotiation.cc:407] Connection header received
0807 10:37:01.958695 (+ 309us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:37:01.958701 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:37:01.958818 (+ 117us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:37:01.958893 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:37:01.959726 (+ 833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:01.960572 (+ 846us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:01.962731 (+ 2159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:01.964024 (+ 1293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:01.964194 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:01.964297 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0807 10:37:01.964712 (+ 415us) server_negotiation.cc:299] Negotiation successful
0807 10:37:01.964852 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260807 10:37:01.965341 29521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:37:01.957606 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.66:32883 (local address 127.20.171.65:43623)
0807 10:37:01.958275 (+ 669us) negotiation.cc:107] Waiting for socket to connect
0807 10:37:01.958299 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0807 10:37:01.958504 (+ 205us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:37:01.959118 (+ 614us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:37:01.959123 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:37:01.959161 (+ 38us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:37:01.959561 (+ 400us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:01.959572 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:01.960722 (+ 1150us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:01.960727 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:01.962563 (+ 1836us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:01.962576 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:01.964295 (+ 1719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:01.964305 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:01.964502 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:01.964562 (+ 60us) client_negotiation.cc:769] Sending connection context
0807 10:37:01.964655 (+ 93us) client_negotiation.cc:240] Negotiation successful
0807 10:37:01.964804 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":535,"spinlock_wait_cycles":4480,"thread_start_us":352,"threads_started":1}
I20260807 10:37:01.966259 29277 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2bd8398a305f4843bd71b7e2e82138ef" candidate_uuid: "4c66026400c2412c9a10d80634b29bc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eca3d074c7af444494d3aa580f6be541" is_pre_election: true
I20260807 10:37:01.966794 29277 raft_consensus.cc:2454] T 2bd8398a305f4843bd71b7e2e82138ef P eca3d074c7af444494d3aa580f6be541 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c66026400c2412c9a10d80634b29bc3 in term 0.
I20260807 10:37:01.967537 29059 leader_election.cc:302] T 2bd8398a305f4843bd71b7e2e82138ef P 4c66026400c2412c9a10d80634b29bc3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c66026400c2412c9a10d80634b29bc3, eca3d074c7af444494d3aa580f6be541; no voters:
I20260807 10:37:01.967929 29490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:37:01.958516 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.65:46449 (local address 127.20.171.67:44071)
0807 10:37:01.958700 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0807 10:37:01.958705 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:37:01.959318 (+ 613us) server_negotiation.cc:407] Connection header received
0807 10:37:01.959480 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:37:01.959485 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:37:01.959565 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:37:01.959666 (+ 101us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:37:01.961475 (+ 1809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:01.962649 (+ 1174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:01.964969 (+ 2320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:01.966166 (+ 1197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:01.966300 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:01.966379 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0807 10:37:01.967482 (+ 1103us) server_negotiation.cc:299] Negotiation successful
0807 10:37:01.967652 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260807 10:37:01.967952 29498 raft_consensus.cc:2781] T 2bd8398a305f4843bd71b7e2e82138ef P 4c66026400c2412c9a10d80634b29bc3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 10:37:01.968075 29498 raft_consensus.cc:482] T 2bd8398a305f4843bd71b7e2e82138ef P 4c66026400c2412c9a10d80634b29bc3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 10:37:01.968186 29498 raft_consensus.cc:3037] T 2bd8398a305f4843bd71b7e2e82138ef P 4c66026400c2412c9a10d80634b29bc3 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:37:01.968817 29522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:37:01.958364 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.67:44071 (local address 127.20.171.65:46449)
0807 10:37:01.959183 (+ 819us) negotiation.cc:107] Waiting for socket to connect
0807 10:37:01.959202 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 10:37:01.959340 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:37:01.960770 (+ 1430us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:37:01.960779 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:37:01.960806 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:37:01.961257 (+ 451us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:01.961270 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:01.962759 (+ 1489us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:01.962763 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:01.964786 (+ 2023us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:01.964801 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:01.967034 (+ 2233us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:01.967041 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:01.967270 (+ 229us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:01.967303 (+ 33us) client_negotiation.cc:769] Sending connection context
0807 10:37:01.968224 (+ 921us) client_negotiation.cc:240] Negotiation successful
0807 10:37:01.968423 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":674,"thread_start_us":462,"threads_started":1}
I20260807 10:37:01.969491 29419 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2bd8398a305f4843bd71b7e2e82138ef" candidate_uuid: "4c66026400c2412c9a10d80634b29bc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "833cd6ffd2a343ecbad6317bdea2f9e3" is_pre_election: true
I20260807 10:37:01.969739 29419 raft_consensus.cc:2454] T 2bd8398a305f4843bd71b7e2e82138ef P 833cd6ffd2a343ecbad6317bdea2f9e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c66026400c2412c9a10d80634b29bc3 in term 0.
I20260807 10:37:01.971299 29498 raft_consensus.cc:504] T 2bd8398a305f4843bd71b7e2e82138ef P 4c66026400c2412c9a10d80634b29bc3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c66026400c2412c9a10d80634b29bc3" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 34279 } } peers { permanent_uuid: "eca3d074c7af444494d3aa580f6be541" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 32883 } } peers { permanent_uuid: "833cd6ffd2a343ecbad6317bdea2f9e3" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 44071 } }
I20260807 10:37:01.971954 29498 leader_election.cc:288] T 2bd8398a305f4843bd71b7e2e82138ef P 4c66026400c2412c9a10d80634b29bc3 [CANDIDATE]: Term 1 election: Requested vote from peers eca3d074c7af444494d3aa580f6be541 (127.20.171.66:32883), 833cd6ffd2a343ecbad6317bdea2f9e3 (127.20.171.67:44071)
I20260807 10:37:01.972499 29419 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2bd8398a305f4843bd71b7e2e82138ef" candidate_uuid: "4c66026400c2412c9a10d80634b29bc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "833cd6ffd2a343ecbad6317bdea2f9e3"
I20260807 10:37:01.972527 29277 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2bd8398a305f4843bd71b7e2e82138ef" candidate_uuid: "4c66026400c2412c9a10d80634b29bc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eca3d074c7af444494d3aa580f6be541"
I20260807 10:37:01.972703 29419 raft_consensus.cc:3037] T 2bd8398a305f4843bd71b7e2e82138ef P 833cd6ffd2a343ecbad6317bdea2f9e3 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:37:01.972741 29277 raft_consensus.cc:3037] T 2bd8398a305f4843bd71b7e2e82138ef P eca3d074c7af444494d3aa580f6be541 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:37:01.975020 29419 raft_consensus.cc:2454] T 2bd8398a305f4843bd71b7e2e82138ef P 833cd6ffd2a343ecbad6317bdea2f9e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c66026400c2412c9a10d80634b29bc3 in term 1.
I20260807 10:37:01.975490 29059 leader_election.cc:302] T 2bd8398a305f4843bd71b7e2e82138ef P 4c66026400c2412c9a10d80634b29bc3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c66026400c2412c9a10d80634b29bc3, 833cd6ffd2a343ecbad6317bdea2f9e3; no voters:
I20260807 10:37:01.975783 29498 raft_consensus.cc:2781] T 2bd8398a305f4843bd71b7e2e82138ef P 4c66026400c2412c9a10d80634b29bc3 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:37:01.976089 29277 raft_consensus.cc:2454] T 2bd8398a305f4843bd71b7e2e82138ef P eca3d074c7af444494d3aa580f6be541 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c66026400c2412c9a10d80634b29bc3 in term 1.
I20260807 10:37:01.976416 29498 raft_consensus.cc:686] T 2bd8398a305f4843bd71b7e2e82138ef P 4c66026400c2412c9a10d80634b29bc3 [term 1 LEADER]: Becoming Leader. State: Replica: 4c66026400c2412c9a10d80634b29bc3, State: Running, Role: LEADER
I20260807 10:37:01.976845 29498 consensus_queue.cc:237] T 2bd8398a305f4843bd71b7e2e82138ef P 4c66026400c2412c9a10d80634b29bc3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c66026400c2412c9a10d80634b29bc3" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 34279 } } peers { permanent_uuid: "eca3d074c7af444494d3aa580f6be541" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 32883 } } peers { permanent_uuid: "833cd6ffd2a343ecbad6317bdea2f9e3" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 44071 } }
I20260807 10:37:01.980685 28970 catalog_manager.cc:5495] T 2bd8398a305f4843bd71b7e2e82138ef P 4c66026400c2412c9a10d80634b29bc3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4c66026400c2412c9a10d80634b29bc3 (127.20.171.65). New cstate: current_term: 1 leader_uuid: "4c66026400c2412c9a10d80634b29bc3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c66026400c2412c9a10d80634b29bc3" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 34279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eca3d074c7af444494d3aa580f6be541" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 32883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "833cd6ffd2a343ecbad6317bdea2f9e3" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 44071 } health_report { overall_health: UNKNOWN } } }
Aug 07 10:37:02 dist-test-slave-0b58 krb5kdc[28922](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099019, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.171.126@KRBTEST.COM for oryx/127.20.171.126@KRBTEST.COM
I20260807 10:37:02.030129 29067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:37:02.014847 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39964 (local address 127.20.171.126:38447)
0807 10:37:02.015123 (+ 276us) server_negotiation.cc:206] Beginning negotiation
0807 10:37:02.015130 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:37:02.015690 (+ 560us) server_negotiation.cc:407] Connection header received
0807 10:37:02.015858 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:37:02.015865 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:37:02.015960 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:37:02.016072 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:37:02.017293 (+ 1221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:02.018421 (+ 1128us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:02.019654 (+ 1233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:02.020352 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:02.020481 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:02.024111 (+ 3630us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:37:02.024118 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:37:02.024123 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:37:02.024159 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:37:02.027208 (+ 3049us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:37:02.028033 (+ 825us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:37:02.028038 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:37:02.028043 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:37:02.028168 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:37:02.028558 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:37:02.028565 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:37:02.028568 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:37:02.028824 (+ 256us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:37:02.028994 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0807 10:37:02.029407 (+ 413us) server_negotiation.cc:299] Negotiation successful
0807 10:37:02.029769 (+ 362us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":155,"server-negotiator.queue_time_us":115}
I20260807 10:37:02.030190 29530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:37:02.014864 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:38447 (local address 127.0.0.1:39964)
0807 10:37:02.015574 (+ 710us) negotiation.cc:107] Waiting for socket to connect
0807 10:37:02.015594 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0807 10:37:02.015742 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:37:02.016112 (+ 370us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:37:02.016115 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:37:02.016880 (+ 765us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:37:02.017137 (+ 257us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:02.017146 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:02.018573 (+ 1427us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:02.018577 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:02.019517 (+ 940us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:02.019527 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:02.020528 (+ 1001us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:02.020533 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:02.020662 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:02.021377 (+ 715us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:37:02.021394 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:37:02.023919 (+ 2525us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:37:02.027335 (+ 3416us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:37:02.027348 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:37:02.027356 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:37:02.027910 (+ 554us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:37:02.028301 (+ 391us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:37:02.028307 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:37:02.028313 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:37:02.028456 (+ 143us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:37:02.028949 (+ 493us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:37:02.028963 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:37:02.029139 (+ 176us) client_negotiation.cc:769] Sending connection context
0807 10:37:02.029306 (+ 167us) client_negotiation.cc:240] Negotiation successful
0807 10:37:02.029629 (+ 323us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":572,"thread_start_us":410,"threads_started":1}
I20260807 10:37:02.035283 28970 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.20.171.126@KRBTEST.COM'} at 127.0.0.1:39964:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260807 10:37:02.036464 28970 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 10:37:02.043349 29110 tablet_service.cc:1467] Processing CreateTablet for tablet 0f0cf0389f7f4d71ad1a36ac25d97c62 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=7b4d445d4cae470482d9b04c3462f141]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 10:37:02.043509 29252 tablet_service.cc:1467] Processing CreateTablet for tablet 0f0cf0389f7f4d71ad1a36ac25d97c62 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=7b4d445d4cae470482d9b04c3462f141]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 10:37:02.043987 29110 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0f0cf0389f7f4d71ad1a36ac25d97c62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:37:02.044142 29252 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0f0cf0389f7f4d71ad1a36ac25d97c62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:37:02.045059 29399 tablet_service.cc:1467] Processing CreateTablet for tablet 0f0cf0389f7f4d71ad1a36ac25d97c62 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=7b4d445d4cae470482d9b04c3462f141]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 10:37:02.045568 29399 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0f0cf0389f7f4d71ad1a36ac25d97c62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:37:02.051709 29491 tablet_bootstrap.cc:492] T 0f0cf0389f7f4d71ad1a36ac25d97c62 P eca3d074c7af444494d3aa580f6be541: Bootstrap starting.
I20260807 10:37:02.053630 29491 tablet_bootstrap.cc:654] T 0f0cf0389f7f4d71ad1a36ac25d97c62 P eca3d074c7af444494d3aa580f6be541: Neither blocks nor log segments found. Creating new log.
I20260807 10:37:02.054768 29495 tablet_bootstrap.cc:492] T 0f0cf0389f7f4d71ad1a36ac25d97c62 P 833cd6ffd2a343ecbad6317bdea2f9e3: Bootstrap starting.
I20260807 10:37:02.056560 29495 tablet_bootstrap.cc:654] T 0f0cf0389f7f4d71ad1a36ac25d97c62 P 833cd6ffd2a343ecbad6317bdea2f9e3: Neither blocks nor log segments found. Creating new log.
I20260807 10:37:02.057610 29492 tablet_bootstrap.cc:492] T 0f0cf0389f7f4d71ad1a36ac25d97c62 P 4c66026400c2412c9a10d80634b29bc3: Bootstrap starting.
I20260807 10:37:02.058678 29491 tablet_bootstrap.cc:492] T 0f0cf0389f7f4d71ad1a36ac25d97c62 P eca3d074c7af444494d3aa580f6be541: No bootstrap required, opened a new log
I20260807 10:37:02.058876 29491 ts_tablet_manager.cc:1397] T 0f0cf0389f7f4d71ad1a36ac25d97c62 P eca3d074c7af444494d3aa580f6be541: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260807 10:37:02.059248 29492 tablet_bootstrap.cc:654] T 0f0cf0389f7f4d71ad1a36ac25d97c62 P 4c66026400c2412c9a10d80634b29bc3: Neither blocks nor log segments found. Creating new log.
I20260807 10:37:02.059604 29491 raft_consensus.cc:348] T 0f0cf0389f7f4d71ad1a36ac25d97c62 P eca3d074c7af444494d3aa580f6be541 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c66026400c2412c9a10d80634b29bc3" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 34279 } } peers { permanent_uuid: "eca3d074c7af444494d3aa580f6be541" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 32883 } } peers { permanent_uuid: "833cd6ffd2a343ecbad6317bdea2f9e3" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 44071 } }
I20260807 10:37:02.059890 29491 raft_consensus.cc:374] T 0f0cf0389f7f4d71ad1a36ac25d97c62 P eca3d074c7af444494d3aa580f6be541 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:37:02.059978 29491 raft_consensus.cc:729] T 0f0cf0389f7f4d71ad1a36ac25d97c62 P eca3d074c7af444494d3aa580f6be541 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eca3d074c7af444494d3aa580f6be541, State: Initialized, Role: FOLLOWER
I20260807 10:37:02.060537 29491 consensus_queue.cc:260] T 0f0cf0389f7f4d71ad1a36ac25d97c62 P eca3d074c7af444494d3aa580f6be541 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c66026400c2412c9a10d80634b29bc3" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 34279 } } peers { permanent_uuid: "eca3d074c7af444494d3aa580f6be541" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 32883 } } peers { permanent_uuid: "833cd6ffd2a343ecbad6317bdea2f9e3" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 44071 } }
I20260807 10:37:02.061076 29497 tablet_replica.cc:439] T 0f0cf0389f7f4d71ad1a36ac25d97c62 P eca3d074c7af444494d3aa580f6be541: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c66026400c2412c9a10d80634b29bc3" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 34279 } } peers { permanent_uuid: "eca3d074c7af444494d3aa580f6be541" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 32883 } } peers { permanent_uuid: "833cd6ffd2a343ecbad6317bdea2f9e3" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 44071 } } }
I20260807 10:37:02.061360 29497 tablet_replica.cc:442] T 0f0cf0389f7f4d71ad1a36ac25d97c62 P eca3d074c7af444494d3aa580f6be541: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 10:37:02.062008 29495 tablet_bootstrap.cc:492] T 0f0cf0389f7f4d71ad1a36ac25d97c62 P 833cd6ffd2a343ecbad6317bdea2f9e3: No bootstrap required, opened a new log
I20260807 10:37:02.062201 29495 ts_tablet_manager.cc:1397] T 0f0cf0389f7f4d71ad1a36ac25d97c62 P 833cd6ffd2a343ecbad6317bdea2f9e3: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.004s
I20260807 10:37:02.062989 29495 raft_consensus.cc:348] T 0f0cf0389f7f4d71ad1a36ac25d97c62 P 833cd6ffd2a343ecbad6317bdea2f9e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c66026400c2412c9a10d80634b29bc3" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 34279 } } peers { permanent_uuid: "eca3d074c7af444494d3aa580f6be541" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 32883 } } peers { permanent_uuid: "833cd6ffd2a343ecbad6317bdea2f9e3" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 44071 } }
I20260807 10:37:02.063185 29491 ts_tablet_manager.cc:1428] T 0f0cf0389f7f4d71ad1a36ac25d97c62 P eca3d074c7af444494d3aa580f6be541: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260807 10:37:02.063256 29495 raft_consensus.cc:374] T 0f0cf0389f7f4d71ad1a36ac25d97c62 P 833cd6ffd2a343ecbad6317bdea2f9e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:37:02.063334 29495 raft_consensus.cc:729] T 0f0cf0389f7f4d71ad1a36ac25d97c62 P 833cd6ffd2a343ecbad6317bdea2f9e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 833cd6ffd2a343ecbad6317bdea2f9e3, State: Initialized, Role: FOLLOWER
I20260807 10:37:02.063619 29495 consensus_queue.cc:260] T 0f0cf0389f7f4d71ad1a36ac25d97c62 P 833cd6ffd2a343ecbad6317bdea2f9e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c66026400c2412c9a10d80634b29bc3" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 34279 } } peers { permanent_uuid: "eca3d074c7af444494d3aa580f6be541" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 32883 } } peers { permanent_uuid: "833cd6ffd2a343ecbad6317bdea2f9e3" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 44071 } }
I20260807 10:37:02.064455 29495 ts_tablet_manager.cc:1428] T 0f0cf0389f7f4d71ad1a36ac25d97c62 P 833cd6ffd2a343ecbad6317bdea2f9e3: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260807 10:37:02.064514 29499 tablet_replica.cc:439] T 0f0cf0389f7f4d71ad1a36ac25d97c62 P 833cd6ffd2a343ecbad6317bdea2f9e3: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c66026400c2412c9a10d80634b29bc3" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 34279 } } peers { permanent_uuid: "eca3d074c7af444494d3aa580f6be541" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 32883 } } peers { permanent_uuid: "833cd6ffd2a343ecbad6317bdea2f9e3" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 44071 } } }
I20260807 10:37:02.064888 29499 tablet_replica.cc:442] T 0f0cf0389f7f4d71ad1a36ac25d97c62 P 833cd6ffd2a343ecbad6317bdea2f9e3: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 10:37:02.067876 29492 tablet_bootstrap.cc:492] T 0f0cf0389f7f4d71ad1a36ac25d97c62 P 4c66026400c2412c9a10d80634b29bc3: No bootstrap required, opened a new log
I20260807 10:37:02.068053 29492 ts_tablet_manager.cc:1397] T 0f0cf0389f7f4d71ad1a36ac25d97c62 P 4c66026400c2412c9a10d80634b29bc3: Time spent bootstrapping tablet: real 0.011s user 0.001s sys 0.005s
I20260807 10:37:02.068858 29492 raft_consensus.cc:348] T 0f0cf0389f7f4d71ad1a36ac25d97c62 P 4c66026400c2412c9a10d80634b29bc3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c66026400c2412c9a10d80634b29bc3" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 34279 } } peers { permanent_uuid: "eca3d074c7af444494d3aa580f6be541" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 32883 } } peers { permanent_uuid: "833cd6ffd2a343ecbad6317bdea2f9e3" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 44071 } }
I20260807 10:37:02.069111 29492 raft_consensus.cc:374] T 0f0cf0389f7f4d71ad1a36ac25d97c62 P 4c66026400c2412c9a10d80634b29bc3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:37:02.069190 29492 raft_consensus.cc:729] T 0f0cf0389f7f4d71ad1a36ac25d97c62 P 4c66026400c2412c9a10d80634b29bc3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c66026400c2412c9a10d80634b29bc3, State: Initialized, Role: FOLLOWER
I20260807 10:37:02.069432 29492 consensus_queue.cc:260] T 0f0cf0389f7f4d71ad1a36ac25d97c62 P 4c66026400c2412c9a10d80634b29bc3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c66026400c2412c9a10d80634b29bc3" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 34279 } } peers { permanent_uuid: "eca3d074c7af444494d3aa580f6be541" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 32883 } } peers { permanent_uuid: "833cd6ffd2a343ecbad6317bdea2f9e3" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 44071 } }
I20260807 10:37:02.069959 29498 tablet_replica.cc:439] T 0f0cf0389f7f4d71ad1a36ac25d97c62 P 4c66026400c2412c9a10d80634b29bc3: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c66026400c2412c9a10d80634b29bc3" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 34279 } } peers { permanent_uuid: "eca3d074c7af444494d3aa580f6be541" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 32883 } } peers { permanent_uuid: "833cd6ffd2a343ecbad6317bdea2f9e3" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 44071 } } }
I20260807 10:37:02.070286 29498 tablet_replica.cc:442] T 0f0cf0389f7f4d71ad1a36ac25d97c62 P 4c66026400c2412c9a10d80634b29bc3: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 10:37:02.070643 29492 ts_tablet_manager.cc:1428] T 0f0cf0389f7f4d71ad1a36ac25d97c62 P 4c66026400c2412c9a10d80634b29bc3: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260807 10:37:02.129987 29498 raft_consensus.cc:482] T 0f0cf0389f7f4d71ad1a36ac25d97c62 P 4c66026400c2412c9a10d80634b29bc3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 10:37:02.130224 29498 raft_consensus.cc:504] T 0f0cf0389f7f4d71ad1a36ac25d97c62 P 4c66026400c2412c9a10d80634b29bc3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c66026400c2412c9a10d80634b29bc3" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 34279 } } peers { permanent_uuid: "eca3d074c7af444494d3aa580f6be541" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 32883 } } peers { permanent_uuid: "833cd6ffd2a343ecbad6317bdea2f9e3" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 44071 } }
I20260807 10:37:02.130918 29498 leader_election.cc:288] T 0f0cf0389f7f4d71ad1a36ac25d97c62 P 4c66026400c2412c9a10d80634b29bc3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eca3d074c7af444494d3aa580f6be541 (127.20.171.66:32883), 833cd6ffd2a343ecbad6317bdea2f9e3 (127.20.171.67:44071)
I20260807 10:37:02.131595 29277 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f0cf0389f7f4d71ad1a36ac25d97c62" candidate_uuid: "4c66026400c2412c9a10d80634b29bc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eca3d074c7af444494d3aa580f6be541" is_pre_election: true
I20260807 10:37:02.131654 29419 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f0cf0389f7f4d71ad1a36ac25d97c62" candidate_uuid: "4c66026400c2412c9a10d80634b29bc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "833cd6ffd2a343ecbad6317bdea2f9e3" is_pre_election: true
I20260807 10:37:02.131892 29277 raft_consensus.cc:2454] T 0f0cf0389f7f4d71ad1a36ac25d97c62 P eca3d074c7af444494d3aa580f6be541 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c66026400c2412c9a10d80634b29bc3 in term 0.
I20260807 10:37:02.131964 29419 raft_consensus.cc:2454] T 0f0cf0389f7f4d71ad1a36ac25d97c62 P 833cd6ffd2a343ecbad6317bdea2f9e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c66026400c2412c9a10d80634b29bc3 in term 0.
I20260807 10:37:02.132526 29059 leader_election.cc:302] T 0f0cf0389f7f4d71ad1a36ac25d97c62 P 4c66026400c2412c9a10d80634b29bc3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c66026400c2412c9a10d80634b29bc3, eca3d074c7af444494d3aa580f6be541; no voters:
I20260807 10:37:02.132855 29498 raft_consensus.cc:2781] T 0f0cf0389f7f4d71ad1a36ac25d97c62 P 4c66026400c2412c9a10d80634b29bc3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 10:37:02.132965 29498 raft_consensus.cc:482] T 0f0cf0389f7f4d71ad1a36ac25d97c62 P 4c66026400c2412c9a10d80634b29bc3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 10:37:02.133106 29498 raft_consensus.cc:3037] T 0f0cf0389f7f4d71ad1a36ac25d97c62 P 4c66026400c2412c9a10d80634b29bc3 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:37:02.135195 29498 raft_consensus.cc:504] T 0f0cf0389f7f4d71ad1a36ac25d97c62 P 4c66026400c2412c9a10d80634b29bc3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c66026400c2412c9a10d80634b29bc3" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 34279 } } peers { permanent_uuid: "eca3d074c7af444494d3aa580f6be541" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 32883 } } peers { permanent_uuid: "833cd6ffd2a343ecbad6317bdea2f9e3" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 44071 } }
I20260807 10:37:02.135820 29498 leader_election.cc:288] T 0f0cf0389f7f4d71ad1a36ac25d97c62 P 4c66026400c2412c9a10d80634b29bc3 [CANDIDATE]: Term 1 election: Requested vote from peers eca3d074c7af444494d3aa580f6be541 (127.20.171.66:32883), 833cd6ffd2a343ecbad6317bdea2f9e3 (127.20.171.67:44071)
I20260807 10:37:02.136206 29277 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f0cf0389f7f4d71ad1a36ac25d97c62" candidate_uuid: "4c66026400c2412c9a10d80634b29bc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eca3d074c7af444494d3aa580f6be541"
I20260807 10:37:02.136328 29419 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f0cf0389f7f4d71ad1a36ac25d97c62" candidate_uuid: "4c66026400c2412c9a10d80634b29bc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "833cd6ffd2a343ecbad6317bdea2f9e3"
I20260807 10:37:02.136525 29277 raft_consensus.cc:3037] T 0f0cf0389f7f4d71ad1a36ac25d97c62 P eca3d074c7af444494d3aa580f6be541 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:37:02.136592 29419 raft_consensus.cc:3037] T 0f0cf0389f7f4d71ad1a36ac25d97c62 P 833cd6ffd2a343ecbad6317bdea2f9e3 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:37:02.138770 29277 raft_consensus.cc:2454] T 0f0cf0389f7f4d71ad1a36ac25d97c62 P eca3d074c7af444494d3aa580f6be541 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c66026400c2412c9a10d80634b29bc3 in term 1.
I20260807 10:37:02.139199 29059 leader_election.cc:302] T 0f0cf0389f7f4d71ad1a36ac25d97c62 P 4c66026400c2412c9a10d80634b29bc3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c66026400c2412c9a10d80634b29bc3, eca3d074c7af444494d3aa580f6be541; no voters:
I20260807 10:37:02.139485 29498 raft_consensus.cc:2781] T 0f0cf0389f7f4d71ad1a36ac25d97c62 P 4c66026400c2412c9a10d80634b29bc3 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:37:02.139621 29419 raft_consensus.cc:2454] T 0f0cf0389f7f4d71ad1a36ac25d97c62 P 833cd6ffd2a343ecbad6317bdea2f9e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c66026400c2412c9a10d80634b29bc3 in term 1.
I20260807 10:37:02.139680 29498 raft_consensus.cc:686] T 0f0cf0389f7f4d71ad1a36ac25d97c62 P 4c66026400c2412c9a10d80634b29bc3 [term 1 LEADER]: Becoming Leader. State: Replica: 4c66026400c2412c9a10d80634b29bc3, State: Running, Role: LEADER
I20260807 10:37:02.139933 29498 consensus_queue.cc:237] T 0f0cf0389f7f4d71ad1a36ac25d97c62 P 4c66026400c2412c9a10d80634b29bc3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c66026400c2412c9a10d80634b29bc3" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 34279 } } peers { permanent_uuid: "eca3d074c7af444494d3aa580f6be541" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 32883 } } peers { permanent_uuid: "833cd6ffd2a343ecbad6317bdea2f9e3" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 44071 } }
I20260807 10:37:02.141800 29523 tablet_replica.cc:439] T 0f0cf0389f7f4d71ad1a36ac25d97c62 P 4c66026400c2412c9a10d80634b29bc3: TxnStatusTablet state changed. Reason: New leader 4c66026400c2412c9a10d80634b29bc3. Latest consensus state: current_term: 1 leader_uuid: "4c66026400c2412c9a10d80634b29bc3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c66026400c2412c9a10d80634b29bc3" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 34279 } } peers { permanent_uuid: "eca3d074c7af444494d3aa580f6be541" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 32883 } } peers { permanent_uuid: "833cd6ffd2a343ecbad6317bdea2f9e3" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 44071 } } }
I20260807 10:37:02.142241 29523 tablet_replica.cc:442] T 0f0cf0389f7f4d71ad1a36ac25d97c62 P 4c66026400c2412c9a10d80634b29bc3: This TxnStatusTablet replica's current role is: LEADER
I20260807 10:37:02.142990 29535 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260807 10:37:02.143241 29535 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260807 10:37:02.143648 28970 catalog_manager.cc:5495] T 0f0cf0389f7f4d71ad1a36ac25d97c62 P 4c66026400c2412c9a10d80634b29bc3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4c66026400c2412c9a10d80634b29bc3 (127.20.171.65). New cstate: current_term: 1 leader_uuid: "4c66026400c2412c9a10d80634b29bc3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c66026400c2412c9a10d80634b29bc3" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 34279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eca3d074c7af444494d3aa580f6be541" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 32883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "833cd6ffd2a343ecbad6317bdea2f9e3" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 44071 } health_report { overall_health: UNKNOWN } } }
I20260807 10:37:02.166391 29487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:37:02.159965 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59406 (local address 127.20.171.65:34279)
0807 10:37:02.160152 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0807 10:37:02.160158 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:37:02.160422 (+ 264us) server_negotiation.cc:407] Connection header received
0807 10:37:02.160746 (+ 324us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:37:02.160753 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:37:02.160851 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:37:02.161002 (+ 151us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 10:37:02.161374 (+ 372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:02.162369 (+ 995us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:02.163729 (+ 1360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:02.164406 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:02.164564 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:02.165072 (+ 508us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 10:37:02.165655 (+ 583us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 10:37:02.165829 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0807 10:37:02.165928 (+ 99us) server_negotiation.cc:299] Negotiation successful
0807 10:37:02.166010 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260807 10:37:02.166373 29530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:37:02.159913 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.65:34279 (local address 127.0.0.1:59406)
0807 10:37:02.160318 (+ 405us) negotiation.cc:107] Waiting for socket to connect
0807 10:37:02.160338 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0807 10:37:02.160502 (+ 164us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:37:02.161026 (+ 524us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:37:02.161030 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:37:02.161042 (+ 12us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 10:37:02.161239 (+ 197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:02.161248 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:02.162568 (+ 1320us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:02.162571 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:02.163586 (+ 1015us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:02.163598 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:02.164577 (+ 979us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:02.164583 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:02.164797 (+ 214us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:02.164858 (+ 61us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 10:37:02.165779 (+ 921us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 10:37:02.165804 (+ 25us) client_negotiation.cc:769] Sending connection context
0807 10:37:02.165897 (+ 93us) client_negotiation.cc:240] Negotiation successful
0807 10:37:02.166059 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":195}
I20260807 10:37:02.171281 29419 raft_consensus.cc:1261] T 0f0cf0389f7f4d71ad1a36ac25d97c62 P 833cd6ffd2a343ecbad6317bdea2f9e3 [term 1 FOLLOWER]: Refusing update from remote peer 4c66026400c2412c9a10d80634b29bc3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 10:37:02.171484 29277 raft_consensus.cc:1261] T 0f0cf0389f7f4d71ad1a36ac25d97c62 P eca3d074c7af444494d3aa580f6be541 [term 1 FOLLOWER]: Refusing update from remote peer 4c66026400c2412c9a10d80634b29bc3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 10:37:02.172215 29498 consensus_queue.cc:1035] T 0f0cf0389f7f4d71ad1a36ac25d97c62 P 4c66026400c2412c9a10d80634b29bc3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "833cd6ffd2a343ecbad6317bdea2f9e3" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 44071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 10:37:02.172735 29523 consensus_queue.cc:1035] T 0f0cf0389f7f4d71ad1a36ac25d97c62 P 4c66026400c2412c9a10d80634b29bc3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eca3d074c7af444494d3aa580f6be541" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 32883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 10:37:02.182356 29497 tablet_replica.cc:439] T 0f0cf0389f7f4d71ad1a36ac25d97c62 P eca3d074c7af444494d3aa580f6be541: TxnStatusTablet state changed. Reason: New leader 4c66026400c2412c9a10d80634b29bc3. Latest consensus state: current_term: 1 leader_uuid: "4c66026400c2412c9a10d80634b29bc3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c66026400c2412c9a10d80634b29bc3" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 34279 } } peers { permanent_uuid: "eca3d074c7af444494d3aa580f6be541" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 32883 } } peers { permanent_uuid: "833cd6ffd2a343ecbad6317bdea2f9e3" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 44071 } } }
I20260807 10:37:02.182709 29497 tablet_replica.cc:442] T 0f0cf0389f7f4d71ad1a36ac25d97c62 P eca3d074c7af444494d3aa580f6be541: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 10:37:02.188119 29507 mvcc.cc:205] Tried to move back new op lower bound from 7315861594805075968 to 7315861594687791104. Current Snapshot: MvccSnapshot[applied={T|T < 7315861594805075968}]
I20260807 10:37:02.195515 29540 tablet_replica.cc:439] T 0f0cf0389f7f4d71ad1a36ac25d97c62 P 4c66026400c2412c9a10d80634b29bc3: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "4c66026400c2412c9a10d80634b29bc3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c66026400c2412c9a10d80634b29bc3" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 34279 } } peers { permanent_uuid: "eca3d074c7af444494d3aa580f6be541" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 32883 } } peers { permanent_uuid: "833cd6ffd2a343ecbad6317bdea2f9e3" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 44071 } } }
I20260807 10:37:02.196600 29540 tablet_replica.cc:442] T 0f0cf0389f7f4d71ad1a36ac25d97c62 P 4c66026400c2412c9a10d80634b29bc3: This TxnStatusTablet replica's current role is: LEADER
I20260807 10:37:02.210016 29487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:37:02.196633 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59422 (local address 127.20.171.65:34279)
0807 10:37:02.196906 (+ 273us) server_negotiation.cc:206] Beginning negotiation
0807 10:37:02.196912 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:37:02.197917 (+ 1005us) server_negotiation.cc:407] Connection header received
0807 10:37:02.198006 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:37:02.198014 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:37:02.198130 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:37:02.198229 (+ 99us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 10:37:02.198994 (+ 765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:02.200541 (+ 1547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:02.203491 (+ 2950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:02.204544 (+ 1053us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:02.204703 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:02.206894 (+ 2191us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 10:37:02.207084 (+ 190us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 10:37:02.207194 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0807 10:37:02.208019 (+ 825us) server_negotiation.cc:299] Negotiation successful
0807 10:37:02.208142 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260807 10:37:02.212373 29497 tablet_replica.cc:439] T 0f0cf0389f7f4d71ad1a36ac25d97c62 P eca3d074c7af444494d3aa580f6be541: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "4c66026400c2412c9a10d80634b29bc3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c66026400c2412c9a10d80634b29bc3" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 34279 } } peers { permanent_uuid: "eca3d074c7af444494d3aa580f6be541" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 32883 } } peers { permanent_uuid: "833cd6ffd2a343ecbad6317bdea2f9e3" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 44071 } } }
I20260807 10:37:02.212731 29497 tablet_replica.cc:442] T 0f0cf0389f7f4d71ad1a36ac25d97c62 P eca3d074c7af444494d3aa580f6be541: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 10:37:02.247695 29499 tablet_replica.cc:439] T 0f0cf0389f7f4d71ad1a36ac25d97c62 P 833cd6ffd2a343ecbad6317bdea2f9e3: TxnStatusTablet state changed. Reason: New leader 4c66026400c2412c9a10d80634b29bc3. Latest consensus state: current_term: 1 leader_uuid: "4c66026400c2412c9a10d80634b29bc3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c66026400c2412c9a10d80634b29bc3" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 34279 } } peers { permanent_uuid: "eca3d074c7af444494d3aa580f6be541" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 32883 } } peers { permanent_uuid: "833cd6ffd2a343ecbad6317bdea2f9e3" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 44071 } } }
I20260807 10:37:02.248009 29499 tablet_replica.cc:442] T 0f0cf0389f7f4d71ad1a36ac25d97c62 P 833cd6ffd2a343ecbad6317bdea2f9e3: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 10:37:02.251613 29540 tablet_replica.cc:439] T 0f0cf0389f7f4d71ad1a36ac25d97c62 P 4c66026400c2412c9a10d80634b29bc3: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "4c66026400c2412c9a10d80634b29bc3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c66026400c2412c9a10d80634b29bc3" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 34279 } } peers { permanent_uuid: "eca3d074c7af444494d3aa580f6be541" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 32883 } } peers { permanent_uuid: "833cd6ffd2a343ecbad6317bdea2f9e3" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 44071 } } }
I20260807 10:37:02.251927 29540 tablet_replica.cc:442] T 0f0cf0389f7f4d71ad1a36ac25d97c62 P 4c66026400c2412c9a10d80634b29bc3: This TxnStatusTablet replica's current role is: LEADER
I20260807 10:37:02.253295 29506 mvcc.cc:205] Tried to move back new op lower bound from 7315861594805075968 to 7315861594687791104. Current Snapshot: MvccSnapshot[applied={T|T < 7315861594805075968}]
I20260807 10:37:02.258044 29499 tablet_replica.cc:439] T 0f0cf0389f7f4d71ad1a36ac25d97c62 P 833cd6ffd2a343ecbad6317bdea2f9e3: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "4c66026400c2412c9a10d80634b29bc3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c66026400c2412c9a10d80634b29bc3" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 34279 } } peers { permanent_uuid: "eca3d074c7af444494d3aa580f6be541" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 32883 } } peers { permanent_uuid: "833cd6ffd2a343ecbad6317bdea2f9e3" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 44071 } } }
I20260807 10:37:02.258335 29499 tablet_replica.cc:442] T 0f0cf0389f7f4d71ad1a36ac25d97c62 P 833cd6ffd2a343ecbad6317bdea2f9e3: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 10:37:02.262044 29487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:37:02.254574 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.65:53667 (local address 127.20.171.65:34279)
0807 10:37:02.254797 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0807 10:37:02.254803 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:37:02.254996 (+ 193us) server_negotiation.cc:407] Connection header received
0807 10:37:02.255256 (+ 260us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:37:02.255264 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:37:02.255349 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:37:02.255420 (+ 71us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 10:37:02.256292 (+ 872us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:02.257421 (+ 1129us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:02.259668 (+ 2247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:02.260426 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:02.260525 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:02.261167 (+ 642us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 10:37:02.261344 (+ 177us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 10:37:02.261409 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0807 10:37:02.261590 (+ 181us) server_negotiation.cc:299] Negotiation successful
0807 10:37:02.261681 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260807 10:37:02.262756 29543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:37:02.254191 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.65:34279 (local address 127.20.171.65:53667)
0807 10:37:02.254902 (+ 711us) negotiation.cc:107] Waiting for socket to connect
0807 10:37:02.254927 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0807 10:37:02.255114 (+ 187us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:37:02.255623 (+ 509us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:37:02.255630 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:37:02.255642 (+ 12us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 10:37:02.256061 (+ 419us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:02.256074 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:02.257581 (+ 1507us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:02.257586 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:02.259518 (+ 1932us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:02.259534 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:02.260712 (+ 1178us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:02.260731 (+ 19us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:02.260908 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:02.260985 (+ 77us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 10:37:02.261473 (+ 488us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 10:37:02.261481 (+ 8us) client_negotiation.cc:769] Sending connection context
0807 10:37:02.262242 (+ 761us) client_negotiation.cc:240] Negotiation successful
0807 10:37:02.262388 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":549,"thread_start_us":7459,"threads_started":1}
I20260807 10:37:02.275468 29418 raft_consensus.cc:1261] T 2bd8398a305f4843bd71b7e2e82138ef P 833cd6ffd2a343ecbad6317bdea2f9e3 [term 1 FOLLOWER]: Refusing update from remote peer 4c66026400c2412c9a10d80634b29bc3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 10:37:02.275740 29277 raft_consensus.cc:1261] T 2bd8398a305f4843bd71b7e2e82138ef P eca3d074c7af444494d3aa580f6be541 [term 1 FOLLOWER]: Refusing update from remote peer 4c66026400c2412c9a10d80634b29bc3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 10:37:02.276078 29523 consensus_queue.cc:1035] T 2bd8398a305f4843bd71b7e2e82138ef P 4c66026400c2412c9a10d80634b29bc3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "833cd6ffd2a343ecbad6317bdea2f9e3" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 44071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 10:37:02.276616 29540 consensus_queue.cc:1035] T 2bd8398a305f4843bd71b7e2e82138ef P 4c66026400c2412c9a10d80634b29bc3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eca3d074c7af444494d3aa580f6be541" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 32883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 10:37:02.300524 29505 mvcc.cc:205] Tried to move back new op lower bound from 7315861595234369536 to 7315861594021224448. Current Snapshot: MvccSnapshot[applied={T|T < 7315861595234369536}]
I20260807 10:37:02.386474 28970 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39948:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 10:37:02.386757 28970 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39948:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 10:37:02.389791 28970 catalog_manager.cc:5782] T 00000000000000000000000000000000 P afbbf2687d4748f4a90abc23e7f73be8: Sending DeleteTablet for 3 replicas of tablet 2bd8398a305f4843bd71b7e2e82138ef
I20260807 10:37:02.391064 29399 tablet_service.cc:1514] Processing DeleteTablet for tablet 2bd8398a305f4843bd71b7e2e82138ef with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:37:02 UTC) from {username='oryx', principal='oryx/127.20.171.126@KRBTEST.COM'} at 127.0.0.1:59888
I20260807 10:37:02.391091 29252 tablet_service.cc:1514] Processing DeleteTablet for tablet 2bd8398a305f4843bd71b7e2e82138ef with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:37:02 UTC) from {username='oryx', principal='oryx/127.20.171.126@KRBTEST.COM'} at 127.0.0.1:35436
I20260807 10:37:02.391381 29517 tablet_replica.cc:330] T 2bd8398a305f4843bd71b7e2e82138ef P eca3d074c7af444494d3aa580f6be541: stopping tablet replica
I20260807 10:37:02.391402 29516 tablet_replica.cc:330] T 2bd8398a305f4843bd71b7e2e82138ef P 833cd6ffd2a343ecbad6317bdea2f9e3: stopping tablet replica
I20260807 10:37:02.391601 29517 raft_consensus.cc:2229] T 2bd8398a305f4843bd71b7e2e82138ef P eca3d074c7af444494d3aa580f6be541 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 10:37:02.391640 29516 raft_consensus.cc:2229] T 2bd8398a305f4843bd71b7e2e82138ef P 833cd6ffd2a343ecbad6317bdea2f9e3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 10:37:02.391857 29516 raft_consensus.cc:2258] T 2bd8398a305f4843bd71b7e2e82138ef P 833cd6ffd2a343ecbad6317bdea2f9e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:37:02.391848 29517 raft_consensus.cc:2258] T 2bd8398a305f4843bd71b7e2e82138ef P eca3d074c7af444494d3aa580f6be541 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:37:02.392215 29109 tablet_service.cc:1514] Processing DeleteTablet for tablet 2bd8398a305f4843bd71b7e2e82138ef with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:37:02 UTC) from {username='oryx', principal='oryx/127.20.171.126@KRBTEST.COM'} at 127.0.0.1:59396
I20260807 10:37:02.392539 29515 tablet_replica.cc:330] T 2bd8398a305f4843bd71b7e2e82138ef P 4c66026400c2412c9a10d80634b29bc3: stopping tablet replica
I20260807 10:37:02.392752 29515 raft_consensus.cc:2229] T 2bd8398a305f4843bd71b7e2e82138ef P 4c66026400c2412c9a10d80634b29bc3 [term 1 LEADER]: Raft consensus shutting down.
I20260807 10:37:02.393239 29516 ts_tablet_manager.cc:1905] T 2bd8398a305f4843bd71b7e2e82138ef P 833cd6ffd2a343ecbad6317bdea2f9e3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 10:37:02.393257 29515 raft_consensus.cc:2258] T 2bd8398a305f4843bd71b7e2e82138ef P 4c66026400c2412c9a10d80634b29bc3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:37:02.393484 29517 ts_tablet_manager.cc:1905] T 2bd8398a305f4843bd71b7e2e82138ef P eca3d074c7af444494d3aa580f6be541: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 10:37:02.394304 29515 ts_tablet_manager.cc:1905] T 2bd8398a305f4843bd71b7e2e82138ef P 4c66026400c2412c9a10d80634b29bc3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 10:37:02.401365 29517 ts_tablet_manager.cc:1918] T 2bd8398a305f4843bd71b7e2e82138ef P eca3d074c7af444494d3aa580f6be541: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 10:37:02.401558 29517 log.cc:1196] T 2bd8398a305f4843bd71b7e2e82138ef P eca3d074c7af444494d3aa580f6be541: Deleting WAL directory at /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786098956060137-21165-0/minicluster-data/ts-1/wal/wals/2bd8398a305f4843bd71b7e2e82138ef
I20260807 10:37:02.401665 29515 ts_tablet_manager.cc:1918] T 2bd8398a305f4843bd71b7e2e82138ef P 4c66026400c2412c9a10d80634b29bc3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 10:37:02.401816 29515 log.cc:1196] T 2bd8398a305f4843bd71b7e2e82138ef P 4c66026400c2412c9a10d80634b29bc3: Deleting WAL directory at /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786098956060137-21165-0/minicluster-data/ts-0/wal/wals/2bd8398a305f4843bd71b7e2e82138ef
I20260807 10:37:02.401994 29517 ts_tablet_manager.cc:1939] T 2bd8398a305f4843bd71b7e2e82138ef P eca3d074c7af444494d3aa580f6be541: Deleting consensus metadata
I20260807 10:37:02.402196 29515 ts_tablet_manager.cc:1939] T 2bd8398a305f4843bd71b7e2e82138ef P 4c66026400c2412c9a10d80634b29bc3: Deleting consensus metadata
I20260807 10:37:02.403249 28954 catalog_manager.cc:4841] TS eca3d074c7af444494d3aa580f6be541 (127.20.171.66:32883): tablet 2bd8398a305f4843bd71b7e2e82138ef (table test-table [id=f3f14cd98ce14543a7ffdab12fdd9dcd]) successfully deleted
I20260807 10:37:02.403241 28955 catalog_manager.cc:4841] TS 4c66026400c2412c9a10d80634b29bc3 (127.20.171.65:34279): tablet 2bd8398a305f4843bd71b7e2e82138ef (table test-table [id=f3f14cd98ce14543a7ffdab12fdd9dcd]) successfully deleted
I20260807 10:37:02.414009 29516 ts_tablet_manager.cc:1918] T 2bd8398a305f4843bd71b7e2e82138ef P 833cd6ffd2a343ecbad6317bdea2f9e3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 10:37:02.414274 29516 log.cc:1196] T 2bd8398a305f4843bd71b7e2e82138ef P 833cd6ffd2a343ecbad6317bdea2f9e3: Deleting WAL directory at /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786098956060137-21165-0/minicluster-data/ts-2/wal/wals/2bd8398a305f4843bd71b7e2e82138ef
I20260807 10:37:02.414815 29516 ts_tablet_manager.cc:1939] T 2bd8398a305f4843bd71b7e2e82138ef P 833cd6ffd2a343ecbad6317bdea2f9e3: Deleting consensus metadata
I20260807 10:37:02.415988 28954 catalog_manager.cc:4841] TS 833cd6ffd2a343ecbad6317bdea2f9e3 (127.20.171.67:44071): tablet 2bd8398a305f4843bd71b7e2e82138ef (table test-table [id=f3f14cd98ce14543a7ffdab12fdd9dcd]) successfully deleted
Aug 07 10:37:02 dist-test-slave-0b58 krb5kdc[28922](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099022, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 07 10:37:02 dist-test-slave-0b58 krb5kdc[28922](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.20.171.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 10:37:02 dist-test-slave-0b58 krb5kdc[28922](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.20.171.126@KRBTEST.COM, Server not found in Kerberos database
W20260807 10:37:02.496866 29067 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:37:02.486083 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39970 (local address 127.20.171.126:38447)
0807 10:37:02.486311 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0807 10:37:02.486317 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:37:02.486714 (+ 397us) server_negotiation.cc:407] Connection header received
0807 10:37:02.486884 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:37:02.486890 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:37:02.486976 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:37:02.487094 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:37:02.488416 (+ 1322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:02.489497 (+ 1081us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:02.490903 (+ 1406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:02.491585 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:02.491715 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:02.496542 (+ 4827us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39970: BlockingRecv error: recv got EOF from 127.0.0.1:39970 (error 108)
Metrics: {"server-negotiator.queue_time_us":77}
Aug 07 10:37:02 dist-test-slave-0b58 krb5kdc[28922](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099022, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.20.171.126@KRBTEST.COM
I20260807 10:37:02.518432 29067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:37:02.499619 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39978 (local address 127.20.171.126:38447)
0807 10:37:02.499793 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0807 10:37:02.499797 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 10:37:02.504731 (+ 4934us) server_negotiation.cc:407] Connection header received
0807 10:37:02.504926 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:37:02.504953 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:37:02.505038 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:37:02.505150 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:37:02.506652 (+ 1502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:02.507440 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:02.508753 (+ 1313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:02.509180 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:02.509325 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:02.513065 (+ 3740us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:37:02.513076 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:37:02.513079 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:37:02.513110 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:37:02.515741 (+ 2631us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:37:02.516485 (+ 744us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:37:02.516489 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:37:02.516491 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:37:02.516621 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:37:02.517022 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:37:02.517026 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:37:02.517028 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:37:02.517293 (+ 265us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:37:02.517546 (+ 253us) server_negotiation.cc:1035] Waiting for connection context
0807 10:37:02.517847 (+ 301us) server_negotiation.cc:299] Negotiation successful
0807 10:37:02.518085 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260807 10:37:02.521970 28970 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39978:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 10:37:02.522657 28970 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 10:37:02.529337 29252 tablet_service.cc:1467] Processing CreateTablet for tablet 0290178a486b4b23b1b672e73996fdc1 (DEFAULT_TABLE table=test-table [id=b8575f57631a469cab74a55375433a36]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:37:02.529297 29109 tablet_service.cc:1467] Processing CreateTablet for tablet 0290178a486b4b23b1b672e73996fdc1 (DEFAULT_TABLE table=test-table [id=b8575f57631a469cab74a55375433a36]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:37:02.529801 29252 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0290178a486b4b23b1b672e73996fdc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:37:02.529994 29109 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0290178a486b4b23b1b672e73996fdc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:37:02.536353 29491 tablet_bootstrap.cc:492] T 0290178a486b4b23b1b672e73996fdc1 P eca3d074c7af444494d3aa580f6be541: Bootstrap starting.
I20260807 10:37:02.537418 29399 tablet_service.cc:1467] Processing CreateTablet for tablet 0290178a486b4b23b1b672e73996fdc1 (DEFAULT_TABLE table=test-table [id=b8575f57631a469cab74a55375433a36]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:37:02.537739 29399 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0290178a486b4b23b1b672e73996fdc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:37:02.538038 29491 tablet_bootstrap.cc:654] T 0290178a486b4b23b1b672e73996fdc1 P eca3d074c7af444494d3aa580f6be541: Neither blocks nor log segments found. Creating new log.
I20260807 10:37:02.539094 29492 tablet_bootstrap.cc:492] T 0290178a486b4b23b1b672e73996fdc1 P 4c66026400c2412c9a10d80634b29bc3: Bootstrap starting.
I20260807 10:37:02.540940 29492 tablet_bootstrap.cc:654] T 0290178a486b4b23b1b672e73996fdc1 P 4c66026400c2412c9a10d80634b29bc3: Neither blocks nor log segments found. Creating new log.
I20260807 10:37:02.541455 29491 tablet_bootstrap.cc:492] T 0290178a486b4b23b1b672e73996fdc1 P eca3d074c7af444494d3aa580f6be541: No bootstrap required, opened a new log
I20260807 10:37:02.541587 29491 ts_tablet_manager.cc:1397] T 0290178a486b4b23b1b672e73996fdc1 P eca3d074c7af444494d3aa580f6be541: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260807 10:37:02.542327 29491 raft_consensus.cc:348] T 0290178a486b4b23b1b672e73996fdc1 P eca3d074c7af444494d3aa580f6be541 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c66026400c2412c9a10d80634b29bc3" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 34279 } } peers { permanent_uuid: "eca3d074c7af444494d3aa580f6be541" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 32883 } } peers { permanent_uuid: "833cd6ffd2a343ecbad6317bdea2f9e3" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 44071 } }
I20260807 10:37:02.542563 29491 raft_consensus.cc:374] T 0290178a486b4b23b1b672e73996fdc1 P eca3d074c7af444494d3aa580f6be541 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:37:02.542662 29491 raft_consensus.cc:729] T 0290178a486b4b23b1b672e73996fdc1 P eca3d074c7af444494d3aa580f6be541 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eca3d074c7af444494d3aa580f6be541, State: Initialized, Role: FOLLOWER
I20260807 10:37:02.543200 29495 tablet_bootstrap.cc:492] T 0290178a486b4b23b1b672e73996fdc1 P 833cd6ffd2a343ecbad6317bdea2f9e3: Bootstrap starting.
I20260807 10:37:02.543107 29491 consensus_queue.cc:260] T 0290178a486b4b23b1b672e73996fdc1 P eca3d074c7af444494d3aa580f6be541 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c66026400c2412c9a10d80634b29bc3" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 34279 } } peers { permanent_uuid: "eca3d074c7af444494d3aa580f6be541" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 32883 } } peers { permanent_uuid: "833cd6ffd2a343ecbad6317bdea2f9e3" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 44071 } }
I20260807 10:37:02.544833 29495 tablet_bootstrap.cc:654] T 0290178a486b4b23b1b672e73996fdc1 P 833cd6ffd2a343ecbad6317bdea2f9e3: Neither blocks nor log segments found. Creating new log.
I20260807 10:37:02.546370 29491 ts_tablet_manager.cc:1428] T 0290178a486b4b23b1b672e73996fdc1 P eca3d074c7af444494d3aa580f6be541: Time spent starting tablet: real 0.005s user 0.002s sys 0.001s
I20260807 10:37:02.549949 29495 tablet_bootstrap.cc:492] T 0290178a486b4b23b1b672e73996fdc1 P 833cd6ffd2a343ecbad6317bdea2f9e3: No bootstrap required, opened a new log
I20260807 10:37:02.550110 29495 ts_tablet_manager.cc:1397] T 0290178a486b4b23b1b672e73996fdc1 P 833cd6ffd2a343ecbad6317bdea2f9e3: Time spent bootstrapping tablet: real 0.007s user 0.003s sys 0.002s
I20260807 10:37:02.550696 29495 raft_consensus.cc:348] T 0290178a486b4b23b1b672e73996fdc1 P 833cd6ffd2a343ecbad6317bdea2f9e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c66026400c2412c9a10d80634b29bc3" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 34279 } } peers { permanent_uuid: "eca3d074c7af444494d3aa580f6be541" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 32883 } } peers { permanent_uuid: "833cd6ffd2a343ecbad6317bdea2f9e3" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 44071 } }
I20260807 10:37:02.550997 29495 raft_consensus.cc:374] T 0290178a486b4b23b1b672e73996fdc1 P 833cd6ffd2a343ecbad6317bdea2f9e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:37:02.551110 29495 raft_consensus.cc:729] T 0290178a486b4b23b1b672e73996fdc1 P 833cd6ffd2a343ecbad6317bdea2f9e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 833cd6ffd2a343ecbad6317bdea2f9e3, State: Initialized, Role: FOLLOWER
I20260807 10:37:02.551391 29495 consensus_queue.cc:260] T 0290178a486b4b23b1b672e73996fdc1 P 833cd6ffd2a343ecbad6317bdea2f9e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c66026400c2412c9a10d80634b29bc3" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 34279 } } peers { permanent_uuid: "eca3d074c7af444494d3aa580f6be541" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 32883 } } peers { permanent_uuid: "833cd6ffd2a343ecbad6317bdea2f9e3" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 44071 } }
I20260807 10:37:02.552462 29492 tablet_bootstrap.cc:492] T 0290178a486b4b23b1b672e73996fdc1 P 4c66026400c2412c9a10d80634b29bc3: No bootstrap required, opened a new log
I20260807 10:37:02.552629 29492 ts_tablet_manager.cc:1397] T 0290178a486b4b23b1b672e73996fdc1 P 4c66026400c2412c9a10d80634b29bc3: Time spent bootstrapping tablet: real 0.014s user 0.007s sys 0.004s
I20260807 10:37:02.552865 29495 ts_tablet_manager.cc:1428] T 0290178a486b4b23b1b672e73996fdc1 P 833cd6ffd2a343ecbad6317bdea2f9e3: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260807 10:37:02.553406 29492 raft_consensus.cc:348] T 0290178a486b4b23b1b672e73996fdc1 P 4c66026400c2412c9a10d80634b29bc3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c66026400c2412c9a10d80634b29bc3" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 34279 } } peers { permanent_uuid: "eca3d074c7af444494d3aa580f6be541" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 32883 } } peers { permanent_uuid: "833cd6ffd2a343ecbad6317bdea2f9e3" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 44071 } }
I20260807 10:37:02.553714 29492 raft_consensus.cc:374] T 0290178a486b4b23b1b672e73996fdc1 P 4c66026400c2412c9a10d80634b29bc3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:37:02.553826 29492 raft_consensus.cc:729] T 0290178a486b4b23b1b672e73996fdc1 P 4c66026400c2412c9a10d80634b29bc3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c66026400c2412c9a10d80634b29bc3, State: Initialized, Role: FOLLOWER
I20260807 10:37:02.554062 29492 consensus_queue.cc:260] T 0290178a486b4b23b1b672e73996fdc1 P 4c66026400c2412c9a10d80634b29bc3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c66026400c2412c9a10d80634b29bc3" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 34279 } } peers { permanent_uuid: "eca3d074c7af444494d3aa580f6be541" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 32883 } } peers { permanent_uuid: "833cd6ffd2a343ecbad6317bdea2f9e3" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 44071 } }
I20260807 10:37:02.554638 29492 ts_tablet_manager.cc:1428] T 0290178a486b4b23b1b672e73996fdc1 P 4c66026400c2412c9a10d80634b29bc3: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260807 10:37:02.599467 29497 raft_consensus.cc:482] T 0290178a486b4b23b1b672e73996fdc1 P eca3d074c7af444494d3aa580f6be541 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 10:37:02.599715 29497 raft_consensus.cc:504] T 0290178a486b4b23b1b672e73996fdc1 P eca3d074c7af444494d3aa580f6be541 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c66026400c2412c9a10d80634b29bc3" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 34279 } } peers { permanent_uuid: "eca3d074c7af444494d3aa580f6be541" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 32883 } } peers { permanent_uuid: "833cd6ffd2a343ecbad6317bdea2f9e3" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 44071 } }
I20260807 10:37:02.600564 29497 leader_election.cc:288] T 0290178a486b4b23b1b672e73996fdc1 P eca3d074c7af444494d3aa580f6be541 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c66026400c2412c9a10d80634b29bc3 (127.20.171.65:34279), 833cd6ffd2a343ecbad6317bdea2f9e3 (127.20.171.67:44071)
I20260807 10:37:02.601087 29137 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0290178a486b4b23b1b672e73996fdc1" candidate_uuid: "eca3d074c7af444494d3aa580f6be541" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c66026400c2412c9a10d80634b29bc3" is_pre_election: true
I20260807 10:37:02.601150 29419 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0290178a486b4b23b1b672e73996fdc1" candidate_uuid: "eca3d074c7af444494d3aa580f6be541" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "833cd6ffd2a343ecbad6317bdea2f9e3" is_pre_election: true
I20260807 10:37:02.601404 29419 raft_consensus.cc:2454] T 0290178a486b4b23b1b672e73996fdc1 P 833cd6ffd2a343ecbad6317bdea2f9e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eca3d074c7af444494d3aa580f6be541 in term 0.
I20260807 10:37:02.601395 29137 raft_consensus.cc:2454] T 0290178a486b4b23b1b672e73996fdc1 P 4c66026400c2412c9a10d80634b29bc3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eca3d074c7af444494d3aa580f6be541 in term 0.
I20260807 10:37:02.601881 29203 leader_election.cc:302] T 0290178a486b4b23b1b672e73996fdc1 P eca3d074c7af444494d3aa580f6be541 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c66026400c2412c9a10d80634b29bc3, eca3d074c7af444494d3aa580f6be541; no voters:
I20260807 10:37:02.602237 29497 raft_consensus.cc:2781] T 0290178a486b4b23b1b672e73996fdc1 P eca3d074c7af444494d3aa580f6be541 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 10:37:02.602350 29497 raft_consensus.cc:482] T 0290178a486b4b23b1b672e73996fdc1 P eca3d074c7af444494d3aa580f6be541 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 10:37:02.602435 29497 raft_consensus.cc:3037] T 0290178a486b4b23b1b672e73996fdc1 P eca3d074c7af444494d3aa580f6be541 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:37:02.605366 29497 raft_consensus.cc:504] T 0290178a486b4b23b1b672e73996fdc1 P eca3d074c7af444494d3aa580f6be541 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c66026400c2412c9a10d80634b29bc3" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 34279 } } peers { permanent_uuid: "eca3d074c7af444494d3aa580f6be541" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 32883 } } peers { permanent_uuid: "833cd6ffd2a343ecbad6317bdea2f9e3" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 44071 } }
I20260807 10:37:02.606046 29497 leader_election.cc:288] T 0290178a486b4b23b1b672e73996fdc1 P eca3d074c7af444494d3aa580f6be541 [CANDIDATE]: Term 1 election: Requested vote from peers 4c66026400c2412c9a10d80634b29bc3 (127.20.171.65:34279), 833cd6ffd2a343ecbad6317bdea2f9e3 (127.20.171.67:44071)
I20260807 10:37:02.606607 29419 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0290178a486b4b23b1b672e73996fdc1" candidate_uuid: "eca3d074c7af444494d3aa580f6be541" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "833cd6ffd2a343ecbad6317bdea2f9e3"
I20260807 10:37:02.606678 29137 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0290178a486b4b23b1b672e73996fdc1" candidate_uuid: "eca3d074c7af444494d3aa580f6be541" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c66026400c2412c9a10d80634b29bc3"
I20260807 10:37:02.606884 29137 raft_consensus.cc:3037] T 0290178a486b4b23b1b672e73996fdc1 P 4c66026400c2412c9a10d80634b29bc3 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:37:02.606864 29419 raft_consensus.cc:3037] T 0290178a486b4b23b1b672e73996fdc1 P 833cd6ffd2a343ecbad6317bdea2f9e3 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:37:02.609848 29419 raft_consensus.cc:2454] T 0290178a486b4b23b1b672e73996fdc1 P 833cd6ffd2a343ecbad6317bdea2f9e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eca3d074c7af444494d3aa580f6be541 in term 1.
I20260807 10:37:02.610055 29137 raft_consensus.cc:2454] T 0290178a486b4b23b1b672e73996fdc1 P 4c66026400c2412c9a10d80634b29bc3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eca3d074c7af444494d3aa580f6be541 in term 1.
I20260807 10:37:02.610288 29202 leader_election.cc:302] T 0290178a486b4b23b1b672e73996fdc1 P eca3d074c7af444494d3aa580f6be541 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 833cd6ffd2a343ecbad6317bdea2f9e3, eca3d074c7af444494d3aa580f6be541; no voters:
I20260807 10:37:02.610697 29497 raft_consensus.cc:2781] T 0290178a486b4b23b1b672e73996fdc1 P eca3d074c7af444494d3aa580f6be541 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:37:02.611158 29497 raft_consensus.cc:686] T 0290178a486b4b23b1b672e73996fdc1 P eca3d074c7af444494d3aa580f6be541 [term 1 LEADER]: Becoming Leader. State: Replica: eca3d074c7af444494d3aa580f6be541, State: Running, Role: LEADER
I20260807 10:37:02.611475 29497 consensus_queue.cc:237] T 0290178a486b4b23b1b672e73996fdc1 P eca3d074c7af444494d3aa580f6be541 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c66026400c2412c9a10d80634b29bc3" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 34279 } } peers { permanent_uuid: "eca3d074c7af444494d3aa580f6be541" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 32883 } } peers { permanent_uuid: "833cd6ffd2a343ecbad6317bdea2f9e3" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 44071 } }
I20260807 10:37:02.614446 28970 catalog_manager.cc:5495] T 0290178a486b4b23b1b672e73996fdc1 P eca3d074c7af444494d3aa580f6be541 reported cstate change: term changed from 0 to 1, leader changed from <none> to eca3d074c7af444494d3aa580f6be541 (127.20.171.66). New cstate: current_term: 1 leader_uuid: "eca3d074c7af444494d3aa580f6be541" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c66026400c2412c9a10d80634b29bc3" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 34279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eca3d074c7af444494d3aa580f6be541" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 32883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "833cd6ffd2a343ecbad6317bdea2f9e3" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 44071 } health_report { overall_health: UNKNOWN } } }
I20260807 10:37:02.639992 29565 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:37:02.634178 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35456 (local address 127.20.171.66:32883)
0807 10:37:02.634799 (+ 621us) server_negotiation.cc:206] Beginning negotiation
0807 10:37:02.634804 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:37:02.634819 (+ 15us) server_negotiation.cc:407] Connection header received
0807 10:37:02.634870 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:37:02.634873 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:37:02.634931 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:37:02.635010 (+ 79us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 10:37:02.635483 (+ 473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:02.636192 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:02.638227 (+ 2035us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:02.638594 (+ 367us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:02.638682 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:02.639250 (+ 568us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 10:37:02.639357 (+ 107us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 10:37:02.639417 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0807 10:37:02.639606 (+ 189us) server_negotiation.cc:299] Negotiation successful
0807 10:37:02.639659 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":510,"thread_start_us":359,"threads_started":1}
I20260807 10:37:02.642648 29137 raft_consensus.cc:1261] T 0290178a486b4b23b1b672e73996fdc1 P 4c66026400c2412c9a10d80634b29bc3 [term 1 FOLLOWER]: Refusing update from remote peer eca3d074c7af444494d3aa580f6be541: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 10:37:02.642678 29419 raft_consensus.cc:1261] T 0290178a486b4b23b1b672e73996fdc1 P 833cd6ffd2a343ecbad6317bdea2f9e3 [term 1 FOLLOWER]: Refusing update from remote peer eca3d074c7af444494d3aa580f6be541: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 10:37:02.643250 29562 consensus_queue.cc:1035] T 0290178a486b4b23b1b672e73996fdc1 P eca3d074c7af444494d3aa580f6be541 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c66026400c2412c9a10d80634b29bc3" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 34279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 10:37:02.643579 29497 consensus_queue.cc:1035] T 0290178a486b4b23b1b672e73996fdc1 P eca3d074c7af444494d3aa580f6be541 [LEADER]: Connected to new peer: Peer: permanent_uuid: "833cd6ffd2a343ecbad6317bdea2f9e3" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 44071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 10:37:02.656942 28970 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39978:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 10:37:02.657204 28970 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39978:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 10:37:02.661553 28970 catalog_manager.cc:5782] T 00000000000000000000000000000000 P afbbf2687d4748f4a90abc23e7f73be8: Sending DeleteTablet for 3 replicas of tablet 0290178a486b4b23b1b672e73996fdc1
I20260807 10:37:02.662509 29109 tablet_service.cc:1514] Processing DeleteTablet for tablet 0290178a486b4b23b1b672e73996fdc1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:37:02 UTC) from {username='oryx', principal='oryx/127.20.171.126@KRBTEST.COM'} at 127.0.0.1:59396
I20260807 10:37:02.662797 29515 tablet_replica.cc:330] T 0290178a486b4b23b1b672e73996fdc1 P 4c66026400c2412c9a10d80634b29bc3: stopping tablet replica
I20260807 10:37:02.662971 29515 raft_consensus.cc:2229] T 0290178a486b4b23b1b672e73996fdc1 P 4c66026400c2412c9a10d80634b29bc3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 10:37:02.662949 29252 tablet_service.cc:1514] Processing DeleteTablet for tablet 0290178a486b4b23b1b672e73996fdc1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:37:02 UTC) from {username='oryx', principal='oryx/127.20.171.126@KRBTEST.COM'} at 127.0.0.1:35436
I20260807 10:37:02.663198 29515 raft_consensus.cc:2258] T 0290178a486b4b23b1b672e73996fdc1 P 4c66026400c2412c9a10d80634b29bc3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:37:02.663216 29517 tablet_replica.cc:330] T 0290178a486b4b23b1b672e73996fdc1 P eca3d074c7af444494d3aa580f6be541: stopping tablet replica
I20260807 10:37:02.663417 29517 raft_consensus.cc:2229] T 0290178a486b4b23b1b672e73996fdc1 P eca3d074c7af444494d3aa580f6be541 [term 1 LEADER]: Raft consensus shutting down.
I20260807 10:37:02.663780 29517 raft_consensus.cc:2258] T 0290178a486b4b23b1b672e73996fdc1 P eca3d074c7af444494d3aa580f6be541 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:37:02.664520 29515 ts_tablet_manager.cc:1905] T 0290178a486b4b23b1b672e73996fdc1 P 4c66026400c2412c9a10d80634b29bc3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 10:37:02.664764 29399 tablet_service.cc:1514] Processing DeleteTablet for tablet 0290178a486b4b23b1b672e73996fdc1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:37:02 UTC) from {username='oryx', principal='oryx/127.20.171.126@KRBTEST.COM'} at 127.0.0.1:59888
I20260807 10:37:02.664891 29398 tablet_service.cc:1514] Processing DeleteTablet for tablet 0290178a486b4b23b1b672e73996fdc1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:37:02 UTC) from {username='oryx', principal='oryx/127.20.171.126@KRBTEST.COM'} at 127.0.0.1:59888
I20260807 10:37:02.665056 29516 tablet_replica.cc:330] T 0290178a486b4b23b1b672e73996fdc1 P 833cd6ffd2a343ecbad6317bdea2f9e3: stopping tablet replica
I20260807 10:37:02.665216 29516 raft_consensus.cc:2229] T 0290178a486b4b23b1b672e73996fdc1 P 833cd6ffd2a343ecbad6317bdea2f9e3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 10:37:02.665402 29516 raft_consensus.cc:2258] T 0290178a486b4b23b1b672e73996fdc1 P 833cd6ffd2a343ecbad6317bdea2f9e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:37:02.666894 29517 ts_tablet_manager.cc:1905] T 0290178a486b4b23b1b672e73996fdc1 P eca3d074c7af444494d3aa580f6be541: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 10:37:02.671977 29517 ts_tablet_manager.cc:1918] T 0290178a486b4b23b1b672e73996fdc1 P eca3d074c7af444494d3aa580f6be541: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 10:37:02.672087 29517 log.cc:1196] T 0290178a486b4b23b1b672e73996fdc1 P eca3d074c7af444494d3aa580f6be541: Deleting WAL directory at /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786098956060137-21165-0/minicluster-data/ts-1/wal/wals/0290178a486b4b23b1b672e73996fdc1
I20260807 10:37:02.672530 29517 ts_tablet_manager.cc:1939] T 0290178a486b4b23b1b672e73996fdc1 P eca3d074c7af444494d3aa580f6be541: Deleting consensus metadata
I20260807 10:37:02.673204 29515 ts_tablet_manager.cc:1918] T 0290178a486b4b23b1b672e73996fdc1 P 4c66026400c2412c9a10d80634b29bc3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 10:37:02.673434 29515 log.cc:1196] T 0290178a486b4b23b1b672e73996fdc1 P 4c66026400c2412c9a10d80634b29bc3: Deleting WAL directory at /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786098956060137-21165-0/minicluster-data/ts-0/wal/wals/0290178a486b4b23b1b672e73996fdc1
I20260807 10:37:02.673461 28954 catalog_manager.cc:4841] TS eca3d074c7af444494d3aa580f6be541 (127.20.171.66:32883): tablet 0290178a486b4b23b1b672e73996fdc1 (table test-table [id=b8575f57631a469cab74a55375433a36]) successfully deleted
I20260807 10:37:02.673457 28969 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39978:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 10:37:02.674129 29515 ts_tablet_manager.cc:1939] T 0290178a486b4b23b1b672e73996fdc1 P 4c66026400c2412c9a10d80634b29bc3: Deleting consensus metadata
W20260807 10:37:02.674176 28969 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 10:37:02.675221 28955 catalog_manager.cc:4841] TS 4c66026400c2412c9a10d80634b29bc3 (127.20.171.65:34279): tablet 0290178a486b4b23b1b672e73996fdc1 (table test-table [id=b8575f57631a469cab74a55375433a36]) successfully deleted
I20260807 10:37:02.675652 29516 ts_tablet_manager.cc:1905] T 0290178a486b4b23b1b672e73996fdc1 P 833cd6ffd2a343ecbad6317bdea2f9e3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 10:37:02.681124 29109 tablet_service.cc:1467] Processing CreateTablet for tablet 39dbb407fc9d4baf8a1e81808c743b1b (DEFAULT_TABLE table=test-table [id=ba721cd3a68c44d38421fb51d1198e09]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:37:02.681344 29398 tablet_service.cc:1467] Processing CreateTablet for tablet 39dbb407fc9d4baf8a1e81808c743b1b (DEFAULT_TABLE table=test-table [id=ba721cd3a68c44d38421fb51d1198e09]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:37:02.681345 29252 tablet_service.cc:1467] Processing CreateTablet for tablet 39dbb407fc9d4baf8a1e81808c743b1b (DEFAULT_TABLE table=test-table [id=ba721cd3a68c44d38421fb51d1198e09]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:37:02.681542 29109 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 39dbb407fc9d4baf8a1e81808c743b1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:37:02.681738 29252 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 39dbb407fc9d4baf8a1e81808c743b1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:37:02.681763 29398 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 39dbb407fc9d4baf8a1e81808c743b1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:37:02.688045 29495 tablet_bootstrap.cc:492] T 39dbb407fc9d4baf8a1e81808c743b1b P 833cd6ffd2a343ecbad6317bdea2f9e3: Bootstrap starting.
I20260807 10:37:02.689440 29495 tablet_bootstrap.cc:654] T 39dbb407fc9d4baf8a1e81808c743b1b P 833cd6ffd2a343ecbad6317bdea2f9e3: Neither blocks nor log segments found. Creating new log.
I20260807 10:37:02.690254 29516 ts_tablet_manager.cc:1918] T 0290178a486b4b23b1b672e73996fdc1 P 833cd6ffd2a343ecbad6317bdea2f9e3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 10:37:02.690387 29516 log.cc:1196] T 0290178a486b4b23b1b672e73996fdc1 P 833cd6ffd2a343ecbad6317bdea2f9e3: Deleting WAL directory at /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786098956060137-21165-0/minicluster-data/ts-2/wal/wals/0290178a486b4b23b1b672e73996fdc1
I20260807 10:37:02.690845 29492 tablet_bootstrap.cc:492] T 39dbb407fc9d4baf8a1e81808c743b1b P 4c66026400c2412c9a10d80634b29bc3: Bootstrap starting.
I20260807 10:37:02.691130 29491 tablet_bootstrap.cc:492] T 39dbb407fc9d4baf8a1e81808c743b1b P eca3d074c7af444494d3aa580f6be541: Bootstrap starting.
I20260807 10:37:02.692530 29492 tablet_bootstrap.cc:654] T 39dbb407fc9d4baf8a1e81808c743b1b P 4c66026400c2412c9a10d80634b29bc3: Neither blocks nor log segments found. Creating new log.
I20260807 10:37:02.692634 29491 tablet_bootstrap.cc:654] T 39dbb407fc9d4baf8a1e81808c743b1b P eca3d074c7af444494d3aa580f6be541: Neither blocks nor log segments found. Creating new log.
I20260807 10:37:02.693974 29495 tablet_bootstrap.cc:492] T 39dbb407fc9d4baf8a1e81808c743b1b P 833cd6ffd2a343ecbad6317bdea2f9e3: No bootstrap required, opened a new log
I20260807 10:37:02.694126 29495 ts_tablet_manager.cc:1397] T 39dbb407fc9d4baf8a1e81808c743b1b P 833cd6ffd2a343ecbad6317bdea2f9e3: Time spent bootstrapping tablet: real 0.006s user 0.003s sys 0.000s
I20260807 10:37:02.694722 29495 raft_consensus.cc:348] T 39dbb407fc9d4baf8a1e81808c743b1b P 833cd6ffd2a343ecbad6317bdea2f9e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c66026400c2412c9a10d80634b29bc3" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 34279 } } peers { permanent_uuid: "eca3d074c7af444494d3aa580f6be541" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 32883 } } peers { permanent_uuid: "833cd6ffd2a343ecbad6317bdea2f9e3" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 44071 } }
I20260807 10:37:02.694890 29495 raft_consensus.cc:374] T 39dbb407fc9d4baf8a1e81808c743b1b P 833cd6ffd2a343ecbad6317bdea2f9e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:37:02.694937 29495 raft_consensus.cc:729] T 39dbb407fc9d4baf8a1e81808c743b1b P 833cd6ffd2a343ecbad6317bdea2f9e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 833cd6ffd2a343ecbad6317bdea2f9e3, State: Initialized, Role: FOLLOWER
I20260807 10:37:02.695158 29495 consensus_queue.cc:260] T 39dbb407fc9d4baf8a1e81808c743b1b P 833cd6ffd2a343ecbad6317bdea2f9e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c66026400c2412c9a10d80634b29bc3" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 34279 } } peers { permanent_uuid: "eca3d074c7af444494d3aa580f6be541" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 32883 } } peers { permanent_uuid: "833cd6ffd2a343ecbad6317bdea2f9e3" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 44071 } }
I20260807 10:37:02.695631 29495 ts_tablet_manager.cc:1428] T 39dbb407fc9d4baf8a1e81808c743b1b P 833cd6ffd2a343ecbad6317bdea2f9e3: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260807 10:37:02.697861 29491 tablet_bootstrap.cc:492] T 39dbb407fc9d4baf8a1e81808c743b1b P eca3d074c7af444494d3aa580f6be541: No bootstrap required, opened a new log
I20260807 10:37:02.698050 29491 ts_tablet_manager.cc:1397] T 39dbb407fc9d4baf8a1e81808c743b1b P eca3d074c7af444494d3aa580f6be541: Time spent bootstrapping tablet: real 0.007s user 0.003s sys 0.000s
I20260807 10:37:02.698493 29516 ts_tablet_manager.cc:1939] T 0290178a486b4b23b1b672e73996fdc1 P 833cd6ffd2a343ecbad6317bdea2f9e3: Deleting consensus metadata
I20260807 10:37:02.698799 29491 raft_consensus.cc:348] T 39dbb407fc9d4baf8a1e81808c743b1b P eca3d074c7af444494d3aa580f6be541 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c66026400c2412c9a10d80634b29bc3" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 34279 } } peers { permanent_uuid: "eca3d074c7af444494d3aa580f6be541" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 32883 } } peers { permanent_uuid: "833cd6ffd2a343ecbad6317bdea2f9e3" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 44071 } }
I20260807 10:37:02.699041 29491 raft_consensus.cc:374] T 39dbb407fc9d4baf8a1e81808c743b1b P eca3d074c7af444494d3aa580f6be541 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:37:02.699110 29491 raft_consensus.cc:729] T 39dbb407fc9d4baf8a1e81808c743b1b P eca3d074c7af444494d3aa580f6be541 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eca3d074c7af444494d3aa580f6be541, State: Initialized, Role: FOLLOWER
I20260807 10:37:02.699649 29491 consensus_queue.cc:260] T 39dbb407fc9d4baf8a1e81808c743b1b P eca3d074c7af444494d3aa580f6be541 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c66026400c2412c9a10d80634b29bc3" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 34279 } } peers { permanent_uuid: "eca3d074c7af444494d3aa580f6be541" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 32883 } } peers { permanent_uuid: "833cd6ffd2a343ecbad6317bdea2f9e3" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 44071 } }
I20260807 10:37:02.700364 29491 ts_tablet_manager.cc:1428] T 39dbb407fc9d4baf8a1e81808c743b1b P eca3d074c7af444494d3aa580f6be541: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260807 10:37:02.701279 28954 catalog_manager.cc:4841] TS 833cd6ffd2a343ecbad6317bdea2f9e3 (127.20.171.67:44071): tablet 0290178a486b4b23b1b672e73996fdc1 (table test-table [id=b8575f57631a469cab74a55375433a36]) successfully deleted
I20260807 10:37:02.702191 29492 tablet_bootstrap.cc:492] T 39dbb407fc9d4baf8a1e81808c743b1b P 4c66026400c2412c9a10d80634b29bc3: No bootstrap required, opened a new log
I20260807 10:37:02.702363 29492 ts_tablet_manager.cc:1397] T 39dbb407fc9d4baf8a1e81808c743b1b P 4c66026400c2412c9a10d80634b29bc3: Time spent bootstrapping tablet: real 0.012s user 0.006s sys 0.001s
I20260807 10:37:02.703297 29492 raft_consensus.cc:348] T 39dbb407fc9d4baf8a1e81808c743b1b P 4c66026400c2412c9a10d80634b29bc3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c66026400c2412c9a10d80634b29bc3" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 34279 } } peers { permanent_uuid: "eca3d074c7af444494d3aa580f6be541" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 32883 } } peers { permanent_uuid: "833cd6ffd2a343ecbad6317bdea2f9e3" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 44071 } }
I20260807 10:37:02.703532 29492 raft_consensus.cc:374] T 39dbb407fc9d4baf8a1e81808c743b1b P 4c66026400c2412c9a10d80634b29bc3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:37:02.703606 29492 raft_consensus.cc:729] T 39dbb407fc9d4baf8a1e81808c743b1b P 4c66026400c2412c9a10d80634b29bc3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c66026400c2412c9a10d80634b29bc3, State: Initialized, Role: FOLLOWER
I20260807 10:37:02.703843 29492 consensus_queue.cc:260] T 39dbb407fc9d4baf8a1e81808c743b1b P 4c66026400c2412c9a10d80634b29bc3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c66026400c2412c9a10d80634b29bc3" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 34279 } } peers { permanent_uuid: "eca3d074c7af444494d3aa580f6be541" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 32883 } } peers { permanent_uuid: "833cd6ffd2a343ecbad6317bdea2f9e3" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 44071 } }
I20260807 10:37:02.704460 29492 ts_tablet_manager.cc:1428] T 39dbb407fc9d4baf8a1e81808c743b1b P 4c66026400c2412c9a10d80634b29bc3: Time spent starting tablet: real 0.002s user 0.002s sys 0.001s
W20260807 10:37:02.705472 28954 catalog_manager.cc:4808] TS 833cd6ffd2a343ecbad6317bdea2f9e3 (127.20.171.67:44071): delete failed for tablet 0290178a486b4b23b1b672e73996fdc1 because the tablet was not found. No further retry: Not found: Tablet not found: 0290178a486b4b23b1b672e73996fdc1
I20260807 10:37:02.734551 29523 raft_consensus.cc:482] T 39dbb407fc9d4baf8a1e81808c743b1b P 4c66026400c2412c9a10d80634b29bc3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 10:37:02.734740 29523 raft_consensus.cc:504] T 39dbb407fc9d4baf8a1e81808c743b1b P 4c66026400c2412c9a10d80634b29bc3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c66026400c2412c9a10d80634b29bc3" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 34279 } } peers { permanent_uuid: "eca3d074c7af444494d3aa580f6be541" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 32883 } } peers { permanent_uuid: "833cd6ffd2a343ecbad6317bdea2f9e3" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 44071 } }
I20260807 10:37:02.735440 29523 leader_election.cc:288] T 39dbb407fc9d4baf8a1e81808c743b1b P 4c66026400c2412c9a10d80634b29bc3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eca3d074c7af444494d3aa580f6be541 (127.20.171.66:32883), 833cd6ffd2a343ecbad6317bdea2f9e3 (127.20.171.67:44071)
I20260807 10:37:02.736001 29277 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "39dbb407fc9d4baf8a1e81808c743b1b" candidate_uuid: "4c66026400c2412c9a10d80634b29bc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eca3d074c7af444494d3aa580f6be541" is_pre_election: true
I20260807 10:37:02.736017 29419 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "39dbb407fc9d4baf8a1e81808c743b1b" candidate_uuid: "4c66026400c2412c9a10d80634b29bc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "833cd6ffd2a343ecbad6317bdea2f9e3" is_pre_election: true
I20260807 10:37:02.736213 29277 raft_consensus.cc:2454] T 39dbb407fc9d4baf8a1e81808c743b1b P eca3d074c7af444494d3aa580f6be541 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c66026400c2412c9a10d80634b29bc3 in term 0.
I20260807 10:37:02.736363 29419 raft_consensus.cc:2454] T 39dbb407fc9d4baf8a1e81808c743b1b P 833cd6ffd2a343ecbad6317bdea2f9e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c66026400c2412c9a10d80634b29bc3 in term 0.
I20260807 10:37:02.736836 29059 leader_election.cc:302] T 39dbb407fc9d4baf8a1e81808c743b1b P 4c66026400c2412c9a10d80634b29bc3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c66026400c2412c9a10d80634b29bc3, 833cd6ffd2a343ecbad6317bdea2f9e3; no voters:
I20260807 10:37:02.737128 29523 raft_consensus.cc:2781] T 39dbb407fc9d4baf8a1e81808c743b1b P 4c66026400c2412c9a10d80634b29bc3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 10:37:02.737257 29523 raft_consensus.cc:482] T 39dbb407fc9d4baf8a1e81808c743b1b P 4c66026400c2412c9a10d80634b29bc3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 10:37:02.737339 29523 raft_consensus.cc:3037] T 39dbb407fc9d4baf8a1e81808c743b1b P 4c66026400c2412c9a10d80634b29bc3 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:37:02.740432 29523 raft_consensus.cc:504] T 39dbb407fc9d4baf8a1e81808c743b1b P 4c66026400c2412c9a10d80634b29bc3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c66026400c2412c9a10d80634b29bc3" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 34279 } } peers { permanent_uuid: "eca3d074c7af444494d3aa580f6be541" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 32883 } } peers { permanent_uuid: "833cd6ffd2a343ecbad6317bdea2f9e3" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 44071 } }
I20260807 10:37:02.741025 29523 leader_election.cc:288] T 39dbb407fc9d4baf8a1e81808c743b1b P 4c66026400c2412c9a10d80634b29bc3 [CANDIDATE]: Term 1 election: Requested vote from peers eca3d074c7af444494d3aa580f6be541 (127.20.171.66:32883), 833cd6ffd2a343ecbad6317bdea2f9e3 (127.20.171.67:44071)
I20260807 10:37:02.741504 29277 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "39dbb407fc9d4baf8a1e81808c743b1b" candidate_uuid: "4c66026400c2412c9a10d80634b29bc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eca3d074c7af444494d3aa580f6be541"
I20260807 10:37:02.741701 29277 raft_consensus.cc:3037] T 39dbb407fc9d4baf8a1e81808c743b1b P eca3d074c7af444494d3aa580f6be541 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:37:02.741634 29419 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "39dbb407fc9d4baf8a1e81808c743b1b" candidate_uuid: "4c66026400c2412c9a10d80634b29bc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "833cd6ffd2a343ecbad6317bdea2f9e3"
I20260807 10:37:02.741842 29419 raft_consensus.cc:3037] T 39dbb407fc9d4baf8a1e81808c743b1b P 833cd6ffd2a343ecbad6317bdea2f9e3 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:37:02.744824 29419 raft_consensus.cc:2454] T 39dbb407fc9d4baf8a1e81808c743b1b P 833cd6ffd2a343ecbad6317bdea2f9e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c66026400c2412c9a10d80634b29bc3 in term 1.
I20260807 10:37:02.744990 29277 raft_consensus.cc:2454] T 39dbb407fc9d4baf8a1e81808c743b1b P eca3d074c7af444494d3aa580f6be541 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c66026400c2412c9a10d80634b29bc3 in term 1.
I20260807 10:37:02.745330 29059 leader_election.cc:302] T 39dbb407fc9d4baf8a1e81808c743b1b P 4c66026400c2412c9a10d80634b29bc3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c66026400c2412c9a10d80634b29bc3, 833cd6ffd2a343ecbad6317bdea2f9e3; no voters:
I20260807 10:37:02.745666 29523 raft_consensus.cc:2781] T 39dbb407fc9d4baf8a1e81808c743b1b P 4c66026400c2412c9a10d80634b29bc3 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:37:02.745867 29523 raft_consensus.cc:686] T 39dbb407fc9d4baf8a1e81808c743b1b P 4c66026400c2412c9a10d80634b29bc3 [term 1 LEADER]: Becoming Leader. State: Replica: 4c66026400c2412c9a10d80634b29bc3, State: Running, Role: LEADER
I20260807 10:37:02.746194 29523 consensus_queue.cc:237] T 39dbb407fc9d4baf8a1e81808c743b1b P 4c66026400c2412c9a10d80634b29bc3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c66026400c2412c9a10d80634b29bc3" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 34279 } } peers { permanent_uuid: "eca3d074c7af444494d3aa580f6be541" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 32883 } } peers { permanent_uuid: "833cd6ffd2a343ecbad6317bdea2f9e3" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 44071 } }
I20260807 10:37:02.748814 28969 catalog_manager.cc:5495] T 39dbb407fc9d4baf8a1e81808c743b1b P 4c66026400c2412c9a10d80634b29bc3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4c66026400c2412c9a10d80634b29bc3 (127.20.171.65). New cstate: current_term: 1 leader_uuid: "4c66026400c2412c9a10d80634b29bc3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c66026400c2412c9a10d80634b29bc3" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 34279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eca3d074c7af444494d3aa580f6be541" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 32883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "833cd6ffd2a343ecbad6317bdea2f9e3" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 44071 } health_report { overall_health: UNKNOWN } } }
I20260807 10:37:02.775964 29572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:37:02.770265 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59438 (local address 127.20.171.65:34279)
0807 10:37:02.770799 (+ 534us) server_negotiation.cc:206] Beginning negotiation
0807 10:37:02.770803 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 10:37:02.770816 (+ 13us) server_negotiation.cc:407] Connection header received
0807 10:37:02.770861 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:37:02.770864 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:37:02.770915 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:37:02.770986 (+ 71us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 10:37:02.771408 (+ 422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:02.772191 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:02.774100 (+ 1909us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:02.774625 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:02.774785 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:02.775249 (+ 464us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 10:37:02.775407 (+ 158us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 10:37:02.775493 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0807 10:37:02.775635 (+ 142us) server_negotiation.cc:299] Negotiation successful
0807 10:37:02.775698 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":420,"thread_start_us":283,"threads_started":1}
I20260807 10:37:02.784348 29277 raft_consensus.cc:1261] T 39dbb407fc9d4baf8a1e81808c743b1b P eca3d074c7af444494d3aa580f6be541 [term 1 FOLLOWER]: Refusing update from remote peer 4c66026400c2412c9a10d80634b29bc3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 10:37:02.784471 29418 raft_consensus.cc:1261] T 39dbb407fc9d4baf8a1e81808c743b1b P 833cd6ffd2a343ecbad6317bdea2f9e3 [term 1 FOLLOWER]: Refusing update from remote peer 4c66026400c2412c9a10d80634b29bc3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 10:37:02.784997 29523 consensus_queue.cc:1035] T 39dbb407fc9d4baf8a1e81808c743b1b P 4c66026400c2412c9a10d80634b29bc3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eca3d074c7af444494d3aa580f6be541" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 32883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 10:37:02.785354 29498 consensus_queue.cc:1035] T 39dbb407fc9d4baf8a1e81808c743b1b P 4c66026400c2412c9a10d80634b29bc3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "833cd6ffd2a343ecbad6317bdea2f9e3" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 44071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 10:37:02.841641 28969 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39978:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 10:37:02.841922 28969 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39978:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 10:37:02.844794 28969 catalog_manager.cc:5782] T 00000000000000000000000000000000 P afbbf2687d4748f4a90abc23e7f73be8: Sending DeleteTablet for 3 replicas of tablet 39dbb407fc9d4baf8a1e81808c743b1b
I20260807 10:37:02.845491 29110 tablet_service.cc:1514] Processing DeleteTablet for tablet 39dbb407fc9d4baf8a1e81808c743b1b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:37:02 UTC) from {username='oryx', principal='oryx/127.20.171.126@KRBTEST.COM'} at 127.0.0.1:59396
I20260807 10:37:02.845785 29398 tablet_service.cc:1514] Processing DeleteTablet for tablet 39dbb407fc9d4baf8a1e81808c743b1b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:37:02 UTC) from {username='oryx', principal='oryx/127.20.171.126@KRBTEST.COM'} at 127.0.0.1:59888
I20260807 10:37:02.845956 29252 tablet_service.cc:1514] Processing DeleteTablet for tablet 39dbb407fc9d4baf8a1e81808c743b1b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:37:02 UTC) from {username='oryx', principal='oryx/127.20.171.126@KRBTEST.COM'} at 127.0.0.1:35436
I20260807 10:37:02.846097 29515 tablet_replica.cc:330] T 39dbb407fc9d4baf8a1e81808c743b1b P 4c66026400c2412c9a10d80634b29bc3: stopping tablet replica
I20260807 10:37:02.846279 29517 tablet_replica.cc:330] T 39dbb407fc9d4baf8a1e81808c743b1b P eca3d074c7af444494d3aa580f6be541: stopping tablet replica
I20260807 10:37:02.846361 29515 raft_consensus.cc:2229] T 39dbb407fc9d4baf8a1e81808c743b1b P 4c66026400c2412c9a10d80634b29bc3 [term 1 LEADER]: Raft consensus shutting down.
I20260807 10:37:02.846467 29517 raft_consensus.cc:2229] T 39dbb407fc9d4baf8a1e81808c743b1b P eca3d074c7af444494d3aa580f6be541 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 10:37:02.846637 29517 raft_consensus.cc:2258] T 39dbb407fc9d4baf8a1e81808c743b1b P eca3d074c7af444494d3aa580f6be541 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:37:02.846673 29515 raft_consensus.cc:2258] T 39dbb407fc9d4baf8a1e81808c743b1b P 4c66026400c2412c9a10d80634b29bc3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:37:02.846931 29516 tablet_replica.cc:330] T 39dbb407fc9d4baf8a1e81808c743b1b P 833cd6ffd2a343ecbad6317bdea2f9e3: stopping tablet replica
I20260807 10:37:02.847218 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 29043
I20260807 10:37:02.847806 29516 raft_consensus.cc:2229] T 39dbb407fc9d4baf8a1e81808c743b1b P 833cd6ffd2a343ecbad6317bdea2f9e3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 10:37:02.848007 29516 raft_consensus.cc:2258] T 39dbb407fc9d4baf8a1e81808c743b1b P 833cd6ffd2a343ecbad6317bdea2f9e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:37:02.849045 29517 ts_tablet_manager.cc:1905] T 39dbb407fc9d4baf8a1e81808c743b1b P eca3d074c7af444494d3aa580f6be541: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 10:37:02.852826 29515 ts_tablet_manager.cc:1905] T 39dbb407fc9d4baf8a1e81808c743b1b P 4c66026400c2412c9a10d80634b29bc3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 10:37:02.853739 29516 ts_tablet_manager.cc:1905] T 39dbb407fc9d4baf8a1e81808c743b1b P 833cd6ffd2a343ecbad6317bdea2f9e3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 10:37:02.854911 29517 ts_tablet_manager.cc:1918] T 39dbb407fc9d4baf8a1e81808c743b1b P eca3d074c7af444494d3aa580f6be541: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 10:37:02.855070 29517 log.cc:1196] T 39dbb407fc9d4baf8a1e81808c743b1b P eca3d074c7af444494d3aa580f6be541: Deleting WAL directory at /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786098956060137-21165-0/minicluster-data/ts-1/wal/wals/39dbb407fc9d4baf8a1e81808c743b1b
I20260807 10:37:02.855525 29517 ts_tablet_manager.cc:1939] T 39dbb407fc9d4baf8a1e81808c743b1b P eca3d074c7af444494d3aa580f6be541: Deleting consensus metadata
I20260807 10:37:02.856542 28954 catalog_manager.cc:4841] TS eca3d074c7af444494d3aa580f6be541 (127.20.171.66:32883): tablet 39dbb407fc9d4baf8a1e81808c743b1b (table test-table [id=ba721cd3a68c44d38421fb51d1198e09]) successfully deleted
I20260807 10:37:02.860304 29516 ts_tablet_manager.cc:1918] T 39dbb407fc9d4baf8a1e81808c743b1b P 833cd6ffd2a343ecbad6317bdea2f9e3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 10:37:02.860499 29516 log.cc:1196] T 39dbb407fc9d4baf8a1e81808c743b1b P 833cd6ffd2a343ecbad6317bdea2f9e3: Deleting WAL directory at /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786098956060137-21165-0/minicluster-data/ts-2/wal/wals/39dbb407fc9d4baf8a1e81808c743b1b
I20260807 10:37:02.860931 29516 ts_tablet_manager.cc:1939] T 39dbb407fc9d4baf8a1e81808c743b1b P 833cd6ffd2a343ecbad6317bdea2f9e3: Deleting consensus metadata
I20260807 10:37:02.861595 29515 ts_tablet_manager.cc:1918] T 39dbb407fc9d4baf8a1e81808c743b1b P 4c66026400c2412c9a10d80634b29bc3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 10:37:02.861744 29515 log.cc:1196] T 39dbb407fc9d4baf8a1e81808c743b1b P 4c66026400c2412c9a10d80634b29bc3: Deleting WAL directory at /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786098956060137-21165-0/minicluster-data/ts-0/wal/wals/39dbb407fc9d4baf8a1e81808c743b1b
I20260807 10:37:02.862102 28954 catalog_manager.cc:4841] TS 833cd6ffd2a343ecbad6317bdea2f9e3 (127.20.171.67:44071): tablet 39dbb407fc9d4baf8a1e81808c743b1b (table test-table [id=ba721cd3a68c44d38421fb51d1198e09]) successfully deleted
I20260807 10:37:02.862178 29515 ts_tablet_manager.cc:1939] T 39dbb407fc9d4baf8a1e81808c743b1b P 4c66026400c2412c9a10d80634b29bc3: Deleting consensus metadata
I20260807 10:37:02.863237 28955 catalog_manager.cc:4841] TS 4c66026400c2412c9a10d80634b29bc3 (127.20.171.65:34279): tablet 39dbb407fc9d4baf8a1e81808c743b1b (table test-table [id=ba721cd3a68c44d38421fb51d1198e09]) successfully deleted
Aug 07 10:37:02 dist-test-slave-0b58 krb5kdc[28922](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099022, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.20.171.65@KRBTEST.COM
I20260807 10:37:02.871523 29572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:37:02.848639 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59452 (local address 127.20.171.65:34279)
0807 10:37:02.848803 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0807 10:37:02.848810 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:37:02.849744 (+ 934us) server_negotiation.cc:407] Connection header received
0807 10:37:02.849922 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:37:02.849927 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:37:02.849997 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:37:02.850081 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:37:02.851654 (+ 1573us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:02.852750 (+ 1096us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:02.858259 (+ 5509us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:02.858990 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:02.859120 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:02.864649 (+ 5529us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:37:02.864670 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:37:02.864687 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:37:02.864721 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:37:02.868615 (+ 3894us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:37:02.869337 (+ 722us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:37:02.869347 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:37:02.869352 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:37:02.869504 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:37:02.869896 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:37:02.869901 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:37:02.869904 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:37:02.870359 (+ 455us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:37:02.870695 (+ 336us) server_negotiation.cc:1035] Waiting for connection context
0807 10:37:02.870914 (+ 219us) server_negotiation.cc:299] Negotiation successful
0807 10:37:02.871164 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260807 10:37:02.872218 29177 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:37:03.016058 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 29043
I20260807 10:37:03.044332 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 29186
Aug 07 10:37:03 dist-test-slave-0b58 krb5kdc[28922](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099022, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.20.171.66@KRBTEST.COM
I20260807 10:37:03.058401 29565 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:37:03.045067 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35470 (local address 127.20.171.66:32883)
0807 10:37:03.045237 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0807 10:37:03.045241 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 10:37:03.045259 (+ 18us) server_negotiation.cc:407] Connection header received
0807 10:37:03.045413 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:37:03.045417 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:37:03.045490 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:37:03.045571 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:37:03.046779 (+ 1208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:03.047504 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:03.048775 (+ 1271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:03.049153 (+ 378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:03.049238 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:03.053258 (+ 4020us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:37:03.053270 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:37:03.053284 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:37:03.053312 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:37:03.055864 (+ 2552us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:37:03.056533 (+ 669us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:37:03.056539 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:37:03.056541 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:37:03.056689 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:37:03.057054 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:37:03.057060 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:37:03.057062 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:37:03.057418 (+ 356us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:37:03.057642 (+ 224us) server_negotiation.cc:1035] Waiting for connection context
0807 10:37:03.057899 (+ 257us) server_negotiation.cc:299] Negotiation successful
0807 10:37:03.058065 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260807 10:37:03.059118 29319 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:37:03.184602 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 29186
I20260807 10:37:03.211828 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 29328
Aug 07 10:37:03 dist-test-slave-0b58 krb5kdc[28922](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099022, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.20.171.67@KRBTEST.COM
I20260807 10:37:03.226696 29581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:37:03.212657 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59900 (local address 127.20.171.67:44071)
0807 10:37:03.213083 (+ 426us) server_negotiation.cc:206] Beginning negotiation
0807 10:37:03.213087 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 10:37:03.213102 (+ 15us) server_negotiation.cc:407] Connection header received
0807 10:37:03.213153 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:37:03.213156 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:37:03.213237 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:37:03.213344 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:37:03.214635 (+ 1291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:03.215343 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:03.216726 (+ 1383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:03.217148 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:03.217242 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:03.221394 (+ 4152us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:37:03.221409 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:37:03.221425 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:37:03.221454 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:37:03.224250 (+ 2796us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:37:03.224927 (+ 677us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:37:03.224935 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:37:03.224937 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:37:03.225071 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:37:03.225384 (+ 313us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:37:03.225387 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:37:03.225389 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:37:03.225748 (+ 359us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:37:03.225951 (+ 203us) server_negotiation.cc:1035] Waiting for connection context
0807 10:37:03.226246 (+ 295us) server_negotiation.cc:299] Negotiation successful
0807 10:37:03.226421 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":334,"thread_start_us":236,"threads_started":1}
I20260807 10:37:03.227341 29459 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:37:03.322516 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 29328
I20260807 10:37:03.343152 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 28937
I20260807 10:37:03.344476 29011 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:37:03.458298 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 28937
2026-08-07T10:37:03Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (5552 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786098956060137-21165-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 10:37:03 dist-test-slave-0b58 krb5kdc[29586](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 10:37:03 dist-test-slave-0b58 krb5kdc[29586](info): set up 2 sockets
Aug 07 10:37:03 dist-test-slave-0b58 krb5kdc[29586](info): commencing operation
krb5kdc: starting...
W20260807 10:37:04.598959 21165 mini_kdc.cc:121] Time spent starting KDC: real 1.092s user 0.000s sys 0.037s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786098956060137-21165-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786098956060137-21165-0/krb5kdc/test-user.keytab.
Aug 07 10:37:04 dist-test-slave-0b58 krb5kdc[29586](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099024, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T10:37:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T10:37:04Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.171.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.171.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.171.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.126.keytab.
Entry for principal kudu/127.20.171.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.126.keytab.
I20260807 10:37:04.878002 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786098956060137-21165-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786098956060137-21165-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786098956060137-21165-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.171.126:41807
--webserver_interface=127.20.171.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.126.keytab
--principal=kudu/127.20.171.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.171.84:38543
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.171.126:41807
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786098956060137-21165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786098956060137-21165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786098956060137-21165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:37:05.202724 29600 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:37:05.202991 29600 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:37:05.203110 29600 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:37:05.210222 29600 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 10:37:05.210317 29600 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:37:05.210358 29600 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:37:05.210429 29600 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 10:37:05.210491 29600 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 10:37:05.219704 29600 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.171.84:38543
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786098956060137-21165-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786098956060137-21165-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.171.126:41807
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.126.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.171.126:41807
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.171.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786098956060137-21165-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:37:05.220995 29600 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:37:05.222395 29600 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:37:05.233700 29605 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:37:05.233767 29606 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:37:05.233805 29608 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:37:05.234640 29600 server_base.cc:1034] running on GCE node
I20260807 10:37:05.235467 29600 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:37:05.236843 29600 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:37:05.238040 29600 hybrid_clock.cc:648] HybridClock initialized: now 1786099025237982 us; error 45 us; skew 500 ppm
I20260807 10:37:05.238407 29600 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-08-07T10:37:05Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (1848 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 10:37:05 dist-test-slave-0b58 krb5kdc[29614](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 10:37:05 dist-test-slave-0b58 krb5kdc[29614](info): set up 2 sockets
Aug 07 10:37:05 dist-test-slave-0b58 krb5kdc[29614](info): commencing operation
krb5kdc: starting...
W20260807 10:37:06.387223 21165 mini_kdc.cc:121] Time spent starting KDC: real 1.032s user 0.003s sys 0.033s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/krb5kdc/test-user.keytab.
Aug 07 10:37:06 dist-test-slave-0b58 krb5kdc[29614](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099026, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T10:37:06Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T10:37:06Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.171.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.171.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.171.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.126.keytab.
Entry for principal kudu/127.20.171.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.126.keytab.
I20260807 10:37:06.663209 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.171.126:35453
--webserver_interface=127.20.171.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.126.keytab
--principal=kudu/127.20.171.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.171.84:44481
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.171.126:35453
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:37:06.992651 29627 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:37:06.992990 29627 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:37:06.993166 29627 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:37:07.000409 29627 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 10:37:07.000542 29627 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:37:07.000653 29627 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:37:07.000751 29627 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 10:37:07.000829 29627 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 10:37:07.011207 29627 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.171.84:44481
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.171.126:35453
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.126.keytab
--principal=kudu/127.20.171.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.171.126:35453
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.171.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:37:07.012616 29627 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:37:07.014201 29627 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:37:07.026261 29633 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:37:07.026228 29634 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:37:07.026270 29636 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:37:07.027144 29627 server_base.cc:1034] running on GCE node
I20260807 10:37:07.027882 29627 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:37:07.029311 29627 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:37:07.030553 29627 hybrid_clock.cc:648] HybridClock initialized: now 1786099027030516 us; error 48 us; skew 500 ppm
I20260807 10:37:07.030906 29627 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:37:07 dist-test-slave-0b58 krb5kdc[29614](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099027, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:37:07.037375 29627 init.cc:377] Logged in from keytab as kudu/127.20.171.126@KRBTEST.COM (short username kudu)
I20260807 10:37:07.039113 29627 webserver.cc:460] Webserver started at http://127.20.171.126:46267/ using document root <none> and password file <none>
I20260807 10:37:07.039860 29627 fs_manager.cc:359] Metadata directory not provided
I20260807 10:37:07.040012 29627 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:37:07.040424 29627 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:37:07.043452 29627 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/minicluster-data/master-0/data/instance:
uuid: "0f42f464394a4f2e8a4e0599dadcdcf8"
format_stamp: "Formatted at 2026-08-07 10:37:07 on dist-test-slave-0b58"
server_key: "e797d91552e07e710012aee39aca64e3"
server_key_iv: "ee81cf02b0b907b9c5e29378f4518695"
server_key_version: "encryptionkey@0"
I20260807 10:37:07.044387 29627 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/minicluster-data/master-0/wal/instance:
uuid: "0f42f464394a4f2e8a4e0599dadcdcf8"
format_stamp: "Formatted at 2026-08-07 10:37:07 on dist-test-slave-0b58"
server_key: "e797d91552e07e710012aee39aca64e3"
server_key_iv: "ee81cf02b0b907b9c5e29378f4518695"
server_key_version: "encryptionkey@0"
I20260807 10:37:07.049592 29627 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.004s
I20260807 10:37:07.052989 29643 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:37:07.054226 29627 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260807 10:37:07.054404 29627 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/minicluster-data/master-0/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/minicluster-data/master-0/wal
uuid: "0f42f464394a4f2e8a4e0599dadcdcf8"
format_stamp: "Formatted at 2026-08-07 10:37:07 on dist-test-slave-0b58"
server_key: "e797d91552e07e710012aee39aca64e3"
server_key_iv: "ee81cf02b0b907b9c5e29378f4518695"
server_key_version: "encryptionkey@0"
I20260807 10:37:07.054595 29627 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:37:07.067643 29627 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:37:07.071673 29627 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:37:07.071954 29627 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:37:07.091085 29627 rpc_server.cc:307] RPC server started. Bound to: 127.20.171.126:35453
I20260807 10:37:07.091105 29695 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.171.126:35453 every 8 connection(s)
I20260807 10:37:07.092589 29627 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
I20260807 10:37:07.096242 29696 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:37:07.099861 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 29627
I20260807 10:37:07.100090 21165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/minicluster-data/master-0/wal/instance
I20260807 10:37:07.100951 21165 external_mini_cluster.cc:1428] Setting key cdbdf33f78ca545b2a3884c9b0e04ec9
I20260807 10:37:07.107334 29696 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0f42f464394a4f2e8a4e0599dadcdcf8: Bootstrap starting.
I20260807 10:37:07.110994 29696 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0f42f464394a4f2e8a4e0599dadcdcf8: Neither blocks nor log segments found. Creating new log.
I20260807 10:37:07.112152 29696 log.cc:824] T 00000000000000000000000000000000 P 0f42f464394a4f2e8a4e0599dadcdcf8: Log is configured to *not* fsync() on all Append() calls
I20260807 10:37:07.115662 29696 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0f42f464394a4f2e8a4e0599dadcdcf8: No bootstrap required, opened a new log
Aug 07 10:37:07 dist-test-slave-0b58 krb5kdc[29614](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099026, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.171.126@KRBTEST.COM
I20260807 10:37:07.123255 29696 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0f42f464394a4f2e8a4e0599dadcdcf8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f42f464394a4f2e8a4e0599dadcdcf8" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 35453 } }
I20260807 10:37:07.123616 29696 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0f42f464394a4f2e8a4e0599dadcdcf8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:37:07.123754 29696 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0f42f464394a4f2e8a4e0599dadcdcf8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f42f464394a4f2e8a4e0599dadcdcf8, State: Initialized, Role: FOLLOWER
I20260807 10:37:07.124375 29696 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0f42f464394a4f2e8a4e0599dadcdcf8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f42f464394a4f2e8a4e0599dadcdcf8" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 35453 } }
I20260807 10:37:07.124663 29696 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0f42f464394a4f2e8a4e0599dadcdcf8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 10:37:07.124819 29696 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0f42f464394a4f2e8a4e0599dadcdcf8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 10:37:07.125010 29696 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0f42f464394a4f2e8a4e0599dadcdcf8 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:37:07.125147 29699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:37:07.102831 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44474 (local address 127.20.171.126:35453)
0807 10:37:07.103646 (+ 815us) server_negotiation.cc:206] Beginning negotiation
0807 10:37:07.103672 (+ 26us) server_negotiation.cc:399] Waiting for connection header
0807 10:37:07.103715 (+ 43us) server_negotiation.cc:407] Connection header received
0807 10:37:07.105872 (+ 2157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:37:07.105894 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:37:07.106331 (+ 437us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:37:07.106644 (+ 313us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:37:07.108596 (+ 1952us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:07.109973 (+ 1377us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:07.111693 (+ 1720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:07.112456 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:07.112601 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:07.117529 (+ 4928us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:37:07.117536 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:37:07.117550 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:37:07.117588 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:37:07.120786 (+ 3198us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:37:07.121485 (+ 699us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:37:07.121492 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:37:07.121498 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:37:07.121703 (+ 205us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:37:07.122084 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:37:07.122090 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:37:07.122098 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:37:07.122625 (+ 527us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:37:07.122939 (+ 314us) server_negotiation.cc:1035] Waiting for connection context
0807 10:37:07.123356 (+ 417us) server_negotiation.cc:299] Negotiation successful
0807 10:37:07.123797 (+ 441us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":609,"thread_start_us":396,"threads_started":1}
I20260807 10:37:07.127453 29696 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0f42f464394a4f2e8a4e0599dadcdcf8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f42f464394a4f2e8a4e0599dadcdcf8" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 35453 } }
I20260807 10:37:07.127933 29696 leader_election.cc:302] T 00000000000000000000000000000000 P 0f42f464394a4f2e8a4e0599dadcdcf8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0f42f464394a4f2e8a4e0599dadcdcf8; no voters:
I20260807 10:37:07.128542 29696 leader_election.cc:288] T 00000000000000000000000000000000 P 0f42f464394a4f2e8a4e0599dadcdcf8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 10:37:07.128674 29701 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0f42f464394a4f2e8a4e0599dadcdcf8 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:37:07.129441 29701 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0f42f464394a4f2e8a4e0599dadcdcf8 [term 1 LEADER]: Becoming Leader. State: Replica: 0f42f464394a4f2e8a4e0599dadcdcf8, State: Running, Role: LEADER
I20260807 10:37:07.129966 29701 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0f42f464394a4f2e8a4e0599dadcdcf8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f42f464394a4f2e8a4e0599dadcdcf8" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 35453 } }
I20260807 10:37:07.130661 29696 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0f42f464394a4f2e8a4e0599dadcdcf8 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 10:37:07.133414 29703 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0f42f464394a4f2e8a4e0599dadcdcf8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0f42f464394a4f2e8a4e0599dadcdcf8. Latest consensus state: current_term: 1 leader_uuid: "0f42f464394a4f2e8a4e0599dadcdcf8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f42f464394a4f2e8a4e0599dadcdcf8" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 35453 } } }
I20260807 10:37:07.133387 29702 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0f42f464394a4f2e8a4e0599dadcdcf8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0f42f464394a4f2e8a4e0599dadcdcf8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f42f464394a4f2e8a4e0599dadcdcf8" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 35453 } } }
I20260807 10:37:07.133853 29703 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0f42f464394a4f2e8a4e0599dadcdcf8 [sys.catalog]: This master's current role is: LEADER
I20260807 10:37:07.133916 29702 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0f42f464394a4f2e8a4e0599dadcdcf8 [sys.catalog]: This master's current role is: LEADER
I20260807 10:37:07.141588 29706 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 10:37:07.146409 29706 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 10:37:07.154862 29706 catalog_manager.cc:1347] Generated new cluster ID: cfbef6b78af84c88b795da0d9c1d7a79
I20260807 10:37:07.155001 29706 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 10:37:07.163393 29706 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 10:37:07.164839 29706 catalog_manager.cc:1504] Loading token signing keys...
I20260807 10:37:07.174963 29706 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0f42f464394a4f2e8a4e0599dadcdcf8: Generated new TSK 0
I20260807 10:37:07.175977 29706 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.171.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.171.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.171.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.65.keytab.
Entry for principal kudu/127.20.171.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.65.keytab.
I20260807 10:37:07.255584 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.171.65:0
--local_ip_for_outbound_sockets=127.20.171.65
--webserver_interface=127.20.171.65
--webserver_port=0
--tserver_master_addrs=127.20.171.126:35453
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.65.keytab
--principal=kudu/127.20.171.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.171.84:44481
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:37:07.579555 29723 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:37:07.579788 29723 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:37:07.579869 29723 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:37:07.586575 29723 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:37:07.586663 29723 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:37:07.586867 29723 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.171.65
I20260807 10:37:07.595340 29723 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.171.84:44481
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.65.keytab
--principal=kudu/127.20.171.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.171.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.171.65
--webserver_port=0
--tserver_master_addrs=127.20.171.126:35453
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.171.65
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:37:07.596439 29723 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:37:07.597548 29723 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:37:07.609679 29728 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:37:07.609758 29731 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:37:07.610057 29729 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:37:07.610414 29723 server_base.cc:1034] running on GCE node
I20260807 10:37:07.610936 29723 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:37:07.611726 29723 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:37:07.612973 29723 hybrid_clock.cc:648] HybridClock initialized: now 1786099027612889 us; error 79 us; skew 500 ppm
I20260807 10:37:07.613204 29723 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:37:07 dist-test-slave-0b58 krb5kdc[29614](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099027, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:37:07.616369 29723 init.cc:377] Logged in from keytab as kudu/127.20.171.65@KRBTEST.COM (short username kudu)
I20260807 10:37:07.617573 29723 webserver.cc:460] Webserver started at http://127.20.171.65:41317/ using document root <none> and password file <none>
I20260807 10:37:07.618114 29723 fs_manager.cc:359] Metadata directory not provided
I20260807 10:37:07.618237 29723 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:37:07.618461 29723 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:37:07.621037 29723 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/minicluster-data/ts-0/data/instance:
uuid: "7f93496410a94d13a1a28c0c43e1f3d6"
format_stamp: "Formatted at 2026-08-07 10:37:07 on dist-test-slave-0b58"
server_key: "2345bd31445032e74f0e53117e852f21"
server_key_iv: "609993e2363c4b971743334e5a28778d"
server_key_version: "encryptionkey@0"
I20260807 10:37:07.621696 29723 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/minicluster-data/ts-0/wal/instance:
uuid: "7f93496410a94d13a1a28c0c43e1f3d6"
format_stamp: "Formatted at 2026-08-07 10:37:07 on dist-test-slave-0b58"
server_key: "2345bd31445032e74f0e53117e852f21"
server_key_iv: "609993e2363c4b971743334e5a28778d"
server_key_version: "encryptionkey@0"
I20260807 10:37:07.627537 29723 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260807 10:37:07.630663 29738 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:37:07.631911 29723 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260807 10:37:07.632033 29723 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/minicluster-data/ts-0/wal
uuid: "7f93496410a94d13a1a28c0c43e1f3d6"
format_stamp: "Formatted at 2026-08-07 10:37:07 on dist-test-slave-0b58"
server_key: "2345bd31445032e74f0e53117e852f21"
server_key_iv: "609993e2363c4b971743334e5a28778d"
server_key_version: "encryptionkey@0"
I20260807 10:37:07.632186 29723 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:37:07.643859 29723 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:37:07.647825 29723 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:37:07.648061 29723 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:37:07.648850 29723 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:37:07.649931 29723 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:37:07.649997 29723 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:37:07.650068 29723 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:37:07.650112 29723 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:37:07.681871 29723 rpc_server.cc:307] RPC server started. Bound to: 127.20.171.65:38205
I20260807 10:37:07.681941 29853 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.171.65:38205 every 8 connection(s)
I20260807 10:37:07.682967 29723 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/minicluster-data/ts-0/data/info.pb
I20260807 10:37:07.683352 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 29723
I20260807 10:37:07.683573 21165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/minicluster-data/ts-0/wal/instance
I20260807 10:37:07.684422 21165 external_mini_cluster.cc:1428] Setting key 096f971b6e7a18cd6524793b54af050b
Aug 07 10:37:07 dist-test-slave-0b58 krb5kdc[29614](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099027, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.65@KRBTEST.COM for kudu/127.20.171.126@KRBTEST.COM
I20260807 10:37:07.703235 29857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:37:07.686353 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.65:36267 (local address 127.20.171.126:35453)
0807 10:37:07.688663 (+ 2310us) server_negotiation.cc:206] Beginning negotiation
0807 10:37:07.688683 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0807 10:37:07.688705 (+ 22us) server_negotiation.cc:407] Connection header received
0807 10:37:07.689386 (+ 681us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:37:07.689394 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:37:07.689478 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:37:07.689590 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:37:07.690815 (+ 1225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:07.691873 (+ 1058us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:07.693317 (+ 1444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:07.694002 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:07.694143 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:07.697457 (+ 3314us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:37:07.697465 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:37:07.697473 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:37:07.697515 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:37:07.700146 (+ 2631us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:37:07.701065 (+ 919us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:37:07.701069 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:37:07.701071 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:37:07.701186 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:37:07.701704 (+ 518us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:37:07.701725 (+ 21us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:37:07.701727 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:37:07.701950 (+ 223us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:37:07.702052 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0807 10:37:07.702830 (+ 778us) server_negotiation.cc:299] Negotiation successful
0807 10:37:07.702985 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2175,"thread_start_us":2061,"threads_started":1}
I20260807 10:37:07.704612 29856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:37:07.685916 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:35453 (local address 127.20.171.65:36267)
0807 10:37:07.686863 (+ 947us) negotiation.cc:107] Waiting for socket to connect
0807 10:37:07.686919 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0807 10:37:07.689155 (+ 2236us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:37:07.689769 (+ 614us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:37:07.689776 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:37:07.690186 (+ 410us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:37:07.690657 (+ 471us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:07.690672 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:07.692001 (+ 1329us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:07.692004 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:07.693160 (+ 1156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:07.693171 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:07.694204 (+ 1033us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:07.694209 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:07.694385 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:07.694999 (+ 614us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:37:07.695019 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:37:07.697249 (+ 2230us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:37:07.700330 (+ 3081us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:37:07.700341 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:37:07.700356 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:37:07.700948 (+ 592us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:37:07.701305 (+ 357us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:37:07.701313 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:37:07.701319 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:37:07.701601 (+ 282us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:37:07.702071 (+ 470us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:37:07.702080 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:37:07.702480 (+ 400us) client_negotiation.cc:769] Sending connection context
0807 10:37:07.702739 (+ 259us) client_negotiation.cc:240] Negotiation successful
0807 10:37:07.703295 (+ 556us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":581,"thread_start_us":394,"threads_started":1}
I20260807 10:37:07.706104 29854 heartbeater.cc:347] Connected to a master server at 127.20.171.126:35453
I20260807 10:37:07.706398 29854 heartbeater.cc:464] Registering TS with master...
I20260807 10:37:07.707013 29854 heartbeater.cc:511] Master 127.20.171.126:35453 requested a full tablet report, sending...
I20260807 10:37:07.709105 29660 ts_manager.cc:194] Registered new tserver with Master: 7f93496410a94d13a1a28c0c43e1f3d6 (127.20.171.65:38205)
I20260807 10:37:07.711244 29660 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.171.65@KRBTEST.COM'} at 127.20.171.65:36267
WARNING: no policy specified for kudu/127.20.171.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.171.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.171.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.66.keytab.
Entry for principal kudu/127.20.171.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.66.keytab.
I20260807 10:37:07.742733 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.171.66:0
--local_ip_for_outbound_sockets=127.20.171.66
--webserver_interface=127.20.171.66
--webserver_port=0
--tserver_master_addrs=127.20.171.126:35453
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.66.keytab
--principal=kudu/127.20.171.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.171.84:44481
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:37:08.042622 29860 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:37:08.042842 29860 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:37:08.042979 29860 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:37:08.049468 29860 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:37:08.049551 29860 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:37:08.049687 29860 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.171.66
I20260807 10:37:08.058038 29860 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.171.84:44481
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.66.keytab
--principal=kudu/127.20.171.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.171.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.171.66
--webserver_port=0
--tserver_master_addrs=127.20.171.126:35453
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.171.66
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:37:08.059046 29860 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:37:08.060083 29860 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:37:08.072067 29866 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:37:08.072039 29865 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:37:08.072243 29868 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:37:08.072722 29860 server_base.cc:1034] running on GCE node
I20260807 10:37:08.073253 29860 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:37:08.074015 29860 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:37:08.075215 29860 hybrid_clock.cc:648] HybridClock initialized: now 1786099028075174 us; error 29 us; skew 500 ppm
I20260807 10:37:08.075505 29860 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:37:08 dist-test-slave-0b58 krb5kdc[29614](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099028, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:37:08.078482 29860 init.cc:377] Logged in from keytab as kudu/127.20.171.66@KRBTEST.COM (short username kudu)
I20260807 10:37:08.079782 29860 webserver.cc:460] Webserver started at http://127.20.171.66:38847/ using document root <none> and password file <none>
I20260807 10:37:08.080451 29860 fs_manager.cc:359] Metadata directory not provided
I20260807 10:37:08.080586 29860 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:37:08.080881 29860 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:37:08.083777 29860 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/minicluster-data/ts-1/data/instance:
uuid: "9f6dd7e253104417865207aa316a449b"
format_stamp: "Formatted at 2026-08-07 10:37:08 on dist-test-slave-0b58"
server_key: "e621d8c9a6606f78722d4501652487ad"
server_key_iv: "c884d2d9d130088b36e2551d744e8627"
server_key_version: "encryptionkey@0"
I20260807 10:37:08.084543 29860 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/minicluster-data/ts-1/wal/instance:
uuid: "9f6dd7e253104417865207aa316a449b"
format_stamp: "Formatted at 2026-08-07 10:37:08 on dist-test-slave-0b58"
server_key: "e621d8c9a6606f78722d4501652487ad"
server_key_iv: "c884d2d9d130088b36e2551d744e8627"
server_key_version: "encryptionkey@0"
I20260807 10:37:08.089221 29860 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260807 10:37:08.092833 29875 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:37:08.093974 29860 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260807 10:37:08.094142 29860 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/minicluster-data/ts-1/wal
uuid: "9f6dd7e253104417865207aa316a449b"
format_stamp: "Formatted at 2026-08-07 10:37:08 on dist-test-slave-0b58"
server_key: "e621d8c9a6606f78722d4501652487ad"
server_key_iv: "c884d2d9d130088b36e2551d744e8627"
server_key_version: "encryptionkey@0"
I20260807 10:37:08.094329 29860 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:37:08.105765 29860 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:37:08.109793 29860 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:37:08.110041 29860 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:37:08.110793 29860 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:37:08.111936 29860 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:37:08.112030 29860 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:37:08.112181 29860 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:37:08.112283 29860 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:37:08.143846 29860 rpc_server.cc:307] RPC server started. Bound to: 127.20.171.66:33237
I20260807 10:37:08.143893 29988 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.171.66:33237 every 8 connection(s)
I20260807 10:37:08.145071 29860 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/minicluster-data/ts-1/data/info.pb
I20260807 10:37:08.153028 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 29860
I20260807 10:37:08.153265 21165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/minicluster-data/ts-1/wal/instance
I20260807 10:37:08.153678 21165 external_mini_cluster.cc:1428] Setting key cc0bf2e38c4a455258076f2b4f0ead87
Aug 07 10:37:08 dist-test-slave-0b58 krb5kdc[29614](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099028, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.66@KRBTEST.COM for kudu/127.20.171.126@KRBTEST.COM
I20260807 10:37:08.164424 29857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:37:08.147482 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.66:35353 (local address 127.20.171.126:35453)
0807 10:37:08.147640 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0807 10:37:08.147645 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:37:08.148641 (+ 996us) server_negotiation.cc:407] Connection header received
0807 10:37:08.150242 (+ 1601us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:37:08.150247 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:37:08.150329 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:37:08.150431 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:37:08.151655 (+ 1224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:08.152380 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:08.153887 (+ 1507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:08.154407 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:08.154525 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:08.158346 (+ 3821us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:37:08.158353 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:37:08.158360 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:37:08.158401 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:37:08.161610 (+ 3209us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:37:08.162213 (+ 603us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:37:08.162220 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:37:08.162225 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:37:08.162371 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:37:08.162725 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:37:08.162730 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:37:08.162735 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:37:08.163068 (+ 333us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:37:08.163212 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0807 10:37:08.163721 (+ 509us) server_negotiation.cc:299] Negotiation successful
0807 10:37:08.163995 (+ 274us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260807 10:37:08.165100 29991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:37:08.147836 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:35453 (local address 127.20.171.66:35353)
0807 10:37:08.148503 (+ 667us) negotiation.cc:107] Waiting for socket to connect
0807 10:37:08.148541 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0807 10:37:08.150004 (+ 1463us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:37:08.150641 (+ 637us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:37:08.150648 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:37:08.151052 (+ 404us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:37:08.151512 (+ 460us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:08.151526 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:08.152525 (+ 999us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:08.152530 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:08.153728 (+ 1198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:08.153743 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:08.154617 (+ 874us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:08.154625 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:08.154899 (+ 274us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:08.155639 (+ 740us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:37:08.155672 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:37:08.158138 (+ 2466us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:37:08.161734 (+ 3596us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:37:08.161739 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:37:08.161748 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:37:08.162108 (+ 360us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:37:08.162470 (+ 362us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:37:08.162473 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:37:08.162474 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:37:08.162628 (+ 154us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:37:08.163172 (+ 544us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:37:08.163179 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:37:08.163408 (+ 229us) client_negotiation.cc:769] Sending connection context
0807 10:37:08.163588 (+ 180us) client_negotiation.cc:240] Negotiation successful
0807 10:37:08.163905 (+ 317us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":486,"thread_start_us":266,"threads_started":1}
I20260807 10:37:08.166501 29989 heartbeater.cc:347] Connected to a master server at 127.20.171.126:35453
I20260807 10:37:08.166769 29989 heartbeater.cc:464] Registering TS with master...
I20260807 10:37:08.167476 29989 heartbeater.cc:511] Master 127.20.171.126:35453 requested a full tablet report, sending...
I20260807 10:37:08.169016 29660 ts_manager.cc:194] Registered new tserver with Master: 9f6dd7e253104417865207aa316a449b (127.20.171.66:33237)
I20260807 10:37:08.169833 29660 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.171.66@KRBTEST.COM'} at 127.20.171.66:35353
WARNING: no policy specified for kudu/127.20.171.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.171.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.171.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.67.keytab.
Entry for principal kudu/127.20.171.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.67.keytab.
I20260807 10:37:08.210453 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.171.67:0
--local_ip_for_outbound_sockets=127.20.171.67
--webserver_interface=127.20.171.67
--webserver_port=0
--tserver_master_addrs=127.20.171.126:35453
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.67.keytab
--principal=kudu/127.20.171.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.171.84:44481
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:37:08.512974 29994 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:37:08.513234 29994 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:37:08.513379 29994 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:37:08.520012 29994 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:37:08.520092 29994 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:37:08.520219 29994 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.171.67
I20260807 10:37:08.528678 29994 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.171.84:44481
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.67.keytab
--principal=kudu/127.20.171.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.171.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.171.67
--webserver_port=0
--tserver_master_addrs=127.20.171.126:35453
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.171.67
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:37:08.529668 29994 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:37:08.530840 29994 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:37:08.543828 29999 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:37:08.543774 30002 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:37:08.543805 30000 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:37:08.544672 29994 server_base.cc:1034] running on GCE node
I20260807 10:37:08.545233 29994 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:37:08.546095 29994 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:37:08.547314 29994 hybrid_clock.cc:648] HybridClock initialized: now 1786099028547234 us; error 55 us; skew 500 ppm
I20260807 10:37:08.547578 29994 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:37:08 dist-test-slave-0b58 krb5kdc[29614](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099028, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:37:08.550513 29994 init.cc:377] Logged in from keytab as kudu/127.20.171.67@KRBTEST.COM (short username kudu)
I20260807 10:37:08.551921 29994 webserver.cc:460] Webserver started at http://127.20.171.67:37847/ using document root <none> and password file <none>
I20260807 10:37:08.552642 29994 fs_manager.cc:359] Metadata directory not provided
I20260807 10:37:08.552788 29994 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:37:08.553107 29994 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:37:08.555874 29994 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/minicluster-data/ts-2/data/instance:
uuid: "0be36d072ba748d5aea40094e65ebe1f"
format_stamp: "Formatted at 2026-08-07 10:37:08 on dist-test-slave-0b58"
server_key: "571930f91d5c88070faecd8e7ca12df8"
server_key_iv: "438c29f50d9db602df0ff561ab231792"
server_key_version: "encryptionkey@0"
I20260807 10:37:08.556685 29994 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/minicluster-data/ts-2/wal/instance:
uuid: "0be36d072ba748d5aea40094e65ebe1f"
format_stamp: "Formatted at 2026-08-07 10:37:08 on dist-test-slave-0b58"
server_key: "571930f91d5c88070faecd8e7ca12df8"
server_key_iv: "438c29f50d9db602df0ff561ab231792"
server_key_version: "encryptionkey@0"
I20260807 10:37:08.561558 29994 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.004s
I20260807 10:37:08.564703 30009 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:37:08.565917 29994 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260807 10:37:08.566110 29994 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/minicluster-data/ts-2/wal
uuid: "0be36d072ba748d5aea40094e65ebe1f"
format_stamp: "Formatted at 2026-08-07 10:37:08 on dist-test-slave-0b58"
server_key: "571930f91d5c88070faecd8e7ca12df8"
server_key_iv: "438c29f50d9db602df0ff561ab231792"
server_key_version: "encryptionkey@0"
I20260807 10:37:08.566371 29994 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:37:08.578890 29994 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:37:08.582942 29994 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:37:08.583233 29994 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:37:08.584133 29994 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:37:08.585625 29994 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:37:08.585739 29994 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:37:08.585893 29994 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:37:08.585983 29994 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:37:08.618412 29994 rpc_server.cc:307] RPC server started. Bound to: 127.20.171.67:43567
I20260807 10:37:08.618453 30125 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.171.67:43567 every 8 connection(s)
I20260807 10:37:08.619735 29994 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/minicluster-data/ts-2/data/info.pb
I20260807 10:37:08.629522 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 29994
I20260807 10:37:08.629700 21165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/minicluster-data/ts-2/wal/instance
I20260807 10:37:08.630146 21165 external_mini_cluster.cc:1428] Setting key 7d331ad33776a22d2584e7a4568b07d2
Aug 07 10:37:08 dist-test-slave-0b58 krb5kdc[29614](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099028, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.67@KRBTEST.COM for kudu/127.20.171.126@KRBTEST.COM
I20260807 10:37:08.639882 29857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:37:08.622232 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.67:40673 (local address 127.20.171.126:35453)
0807 10:37:08.622419 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0807 10:37:08.622423 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 10:37:08.623561 (+ 1138us) server_negotiation.cc:407] Connection header received
0807 10:37:08.625381 (+ 1820us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:37:08.625385 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:37:08.625453 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:37:08.625539 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:37:08.627716 (+ 2177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:08.628831 (+ 1115us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:08.630506 (+ 1675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:08.631032 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:08.631145 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:08.634727 (+ 3582us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:37:08.634731 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:37:08.634735 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:37:08.634767 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:37:08.637295 (+ 2528us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:37:08.637925 (+ 630us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:37:08.637928 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:37:08.637930 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:37:08.638043 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:37:08.638475 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:37:08.638478 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:37:08.638480 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:37:08.638739 (+ 259us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:37:08.638862 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0807 10:37:08.639478 (+ 616us) server_negotiation.cc:299] Negotiation successful
0807 10:37:08.639661 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260807 10:37:08.640782 30128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:37:08.622631 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:35453 (local address 127.20.171.67:40673)
0807 10:37:08.623391 (+ 760us) negotiation.cc:107] Waiting for socket to connect
0807 10:37:08.623427 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0807 10:37:08.625136 (+ 1709us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:37:08.625763 (+ 627us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:37:08.625771 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:37:08.626683 (+ 912us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:37:08.627509 (+ 826us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:08.627535 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:08.628966 (+ 1431us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:08.628981 (+ 15us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:08.630367 (+ 1386us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:08.630380 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:08.631269 (+ 889us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:08.631275 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:08.631557 (+ 282us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:08.632438 (+ 881us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:37:08.632458 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:37:08.634560 (+ 2102us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:37:08.637415 (+ 2855us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:37:08.637421 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:37:08.637431 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:37:08.637832 (+ 401us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:37:08.638129 (+ 297us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:37:08.638132 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:37:08.638135 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:37:08.638376 (+ 241us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:37:08.638854 (+ 478us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:37:08.638859 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:37:08.639126 (+ 267us) client_negotiation.cc:769] Sending connection context
0807 10:37:08.639373 (+ 247us) client_negotiation.cc:240] Negotiation successful
0807 10:37:08.639720 (+ 347us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":499,"thread_start_us":278,"threads_started":1}
I20260807 10:37:08.642213 30126 heartbeater.cc:347] Connected to a master server at 127.20.171.126:35453
I20260807 10:37:08.642463 30126 heartbeater.cc:464] Registering TS with master...
I20260807 10:37:08.643185 30126 heartbeater.cc:511] Master 127.20.171.126:35453 requested a full tablet report, sending...
I20260807 10:37:08.644696 29660 ts_manager.cc:194] Registered new tserver with Master: 0be36d072ba748d5aea40094e65ebe1f (127.20.171.67:43567)
I20260807 10:37:08.645516 29660 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.171.67@KRBTEST.COM'} at 127.20.171.67:40673
I20260807 10:37:08.645671 21165 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.20.171.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.20.171.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.20.171.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/krb5kdc/oryx_127.20.171.65.keytab.
Entry for principal oryx/127.20.171.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/krb5kdc/oryx_127.20.171.65.keytab.
I20260807 10:37:08.714076 29854 heartbeater.cc:503] Master 127.20.171.126:35453 was elected leader, sending a full tablet report...
WARNING: no policy specified for oryx/127.20.171.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.20.171.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.20.171.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/krb5kdc/oryx_127.20.171.66.keytab.
Entry for principal oryx/127.20.171.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/krb5kdc/oryx_127.20.171.66.keytab.
WARNING: no policy specified for oryx/127.20.171.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.20.171.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.20.171.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/krb5kdc/oryx_127.20.171.67.keytab.
Entry for principal oryx/127.20.171.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/krb5kdc/oryx_127.20.171.67.keytab.
I20260807 10:37:08.813144 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 29723
Aug 07 10:37:08 dist-test-slave-0b58 krb5kdc[29614](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099026, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.171.65@KRBTEST.COM
I20260807 10:37:08.828866 30136 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:37:08.814379 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34560 (local address 127.20.171.65:38205)
0807 10:37:08.815307 (+ 928us) server_negotiation.cc:206] Beginning negotiation
0807 10:37:08.815314 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:37:08.815342 (+ 28us) server_negotiation.cc:407] Connection header received
0807 10:37:08.815414 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:37:08.815420 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:37:08.815628 (+ 208us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:37:08.815764 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:37:08.817086 (+ 1322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:08.818101 (+ 1015us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:08.819307 (+ 1206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:08.819815 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:08.819906 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:08.823664 (+ 3758us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:37:08.823675 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:37:08.823695 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:37:08.823732 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:37:08.826323 (+ 2591us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:37:08.827030 (+ 707us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:37:08.827037 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:37:08.827040 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:37:08.827171 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:37:08.827507 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:37:08.827510 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:37:08.827511 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:37:08.827860 (+ 349us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:37:08.828071 (+ 211us) server_negotiation.cc:1035] Waiting for connection context
0807 10:37:08.828365 (+ 294us) server_negotiation.cc:299] Negotiation successful
0807 10:37:08.828564 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":755,"thread_start_us":595,"threads_started":1}
I20260807 10:37:08.830062 29849 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:37:08.910706 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 29723
I20260807 10:37:08.930691 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 29860
Aug 07 10:37:08 dist-test-slave-0b58 krb5kdc[29614](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099026, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.171.66@KRBTEST.COM
I20260807 10:37:08.946101 30138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:37:08.931588 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52652 (local address 127.20.171.66:33237)
0807 10:37:08.932192 (+ 604us) server_negotiation.cc:206] Beginning negotiation
0807 10:37:08.932200 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 10:37:08.932225 (+ 25us) server_negotiation.cc:407] Connection header received
0807 10:37:08.932338 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:37:08.932352 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:37:08.932570 (+ 218us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:37:08.932703 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:37:08.933950 (+ 1247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:08.934941 (+ 991us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:08.936143 (+ 1202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:08.936751 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:08.936846 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:08.940920 (+ 4074us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:37:08.940932 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:37:08.940943 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:37:08.940980 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:37:08.943754 (+ 2774us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:37:08.944350 (+ 596us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:37:08.944357 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:37:08.944359 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:37:08.944492 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:37:08.944790 (+ 298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:37:08.944793 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:37:08.944794 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:37:08.945150 (+ 356us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:37:08.945386 (+ 236us) server_negotiation.cc:1035] Waiting for connection context
0807 10:37:08.945609 (+ 223us) server_negotiation.cc:299] Negotiation successful
0807 10:37:08.945811 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":430,"thread_start_us":323,"threads_started":1}
I20260807 10:37:08.947389 29984 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:37:09.026543 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 29860
I20260807 10:37:09.045703 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 29994
Aug 07 10:37:09 dist-test-slave-0b58 krb5kdc[29614](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099026, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.171.67@KRBTEST.COM
I20260807 10:37:09.061589 30140 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:37:09.046699 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54186 (local address 127.20.171.67:43567)
0807 10:37:09.047312 (+ 613us) server_negotiation.cc:206] Beginning negotiation
0807 10:37:09.047319 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:37:09.047366 (+ 47us) server_negotiation.cc:407] Connection header received
0807 10:37:09.047424 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:37:09.047430 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:37:09.047630 (+ 200us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:37:09.047793 (+ 163us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:37:09.049256 (+ 1463us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:09.050292 (+ 1036us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:09.051496 (+ 1204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:09.052012 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:09.052142 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:09.056395 (+ 4253us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:37:09.056406 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:37:09.056419 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:37:09.056449 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:37:09.059011 (+ 2562us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:37:09.059652 (+ 641us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:37:09.059658 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:37:09.059660 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:37:09.059763 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:37:09.060097 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:37:09.060101 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:37:09.060103 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:37:09.060566 (+ 463us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:37:09.060822 (+ 256us) server_negotiation.cc:1035] Waiting for connection context
0807 10:37:09.061049 (+ 227us) server_negotiation.cc:299] Negotiation successful
0807 10:37:09.061293 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":442,"thread_start_us":278,"threads_started":1}
I20260807 10:37:09.062871 30121 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:37:09.151085 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 29994
I20260807 10:37:09.170454 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 29627
I20260807 10:37:09.171759 29691 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:37:09.280277 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 29627
I20260807 10:37:09.305169 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.171.126:35453
--webserver_interface=127.20.171.126
--webserver_port=46267
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.126.keytab
--principal=kudu/127.20.171.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.171.84:44481
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.171.126:35453
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:37:09.643487 30143 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:37:09.643880 30143 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:37:09.644058 30143 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:37:09.651244 30143 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 10:37:09.651368 30143 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:37:09.651439 30143 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:37:09.651513 30143 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 10:37:09.651567 30143 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 10:37:09.661015 30143 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.171.84:44481
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.171.126:35453
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.126.keytab
--principal=kudu/127.20.171.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.171.126:35453
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.171.126
--webserver_port=46267
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:37:09.662396 30143 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:37:09.663671 30143 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:37:09.675457 30148 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:37:09.675493 30151 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:37:09.675420 30149 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:37:09.676182 30143 server_base.cc:1034] running on GCE node
I20260807 10:37:09.676905 30143 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:37:09.678141 30143 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:37:09.679350 30143 hybrid_clock.cc:648] HybridClock initialized: now 1786099029679300 us; error 51 us; skew 500 ppm
I20260807 10:37:09.679690 30143 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:37:09 dist-test-slave-0b58 krb5kdc[29614](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099029, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:37:09.682610 30143 init.cc:377] Logged in from keytab as kudu/127.20.171.126@KRBTEST.COM (short username kudu)
I20260807 10:37:09.683938 30143 webserver.cc:460] Webserver started at http://127.20.171.126:46267/ using document root <none> and password file <none>
I20260807 10:37:09.684609 30143 fs_manager.cc:359] Metadata directory not provided
I20260807 10:37:09.684747 30143 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:37:09.689991 30143 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260807 10:37:09.692595 30158 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:37:09.693747 30143 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.002s
I20260807 10:37:09.693919 30143 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/minicluster-data/master-0/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/minicluster-data/master-0/wal
uuid: "0f42f464394a4f2e8a4e0599dadcdcf8"
format_stamp: "Formatted at 2026-08-07 10:37:07 on dist-test-slave-0b58"
server_key: "e797d91552e07e710012aee39aca64e3"
server_key_iv: "ee81cf02b0b907b9c5e29378f4518695"
server_key_version: "encryptionkey@0"
I20260807 10:37:09.694798 30143 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:37:09.721308 30143 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:37:09.724854 30143 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:37:09.725142 30143 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:37:09.743482 30143 rpc_server.cc:307] RPC server started. Bound to: 127.20.171.126:35453
I20260807 10:37:09.743501 30210 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.171.126:35453 every 8 connection(s)
I20260807 10:37:09.745116 30143 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
I20260807 10:37:09.751875 30211 sys_catalog.cc:263] Verifying existing consensus state
I20260807 10:37:09.752076 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 30143
I20260807 10:37:09.753094 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.171.65:38205
--local_ip_for_outbound_sockets=127.20.171.65
--tserver_master_addrs=127.20.171.126:35453
--webserver_port=41317
--webserver_interface=127.20.171.65
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.65.keytab
--principal=kudu/127.20.171.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.171.84:44481
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.20.171.65
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/krb5kdc/oryx_127.20.171.65.keytab with env {KRB5CCNAME=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 10:37:09.756675 30211 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0f42f464394a4f2e8a4e0599dadcdcf8: Bootstrap starting.
I20260807 10:37:09.778589 30211 log.cc:824] T 00000000000000000000000000000000 P 0f42f464394a4f2e8a4e0599dadcdcf8: Log is configured to *not* fsync() on all Append() calls
I20260807 10:37:09.787493 30211 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0f42f464394a4f2e8a4e0599dadcdcf8: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 10:37:09.788038 30211 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0f42f464394a4f2e8a4e0599dadcdcf8: Bootstrap complete.
I20260807 10:37:09.797499 30211 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0f42f464394a4f2e8a4e0599dadcdcf8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f42f464394a4f2e8a4e0599dadcdcf8" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 35453 } }
I20260807 10:37:09.798486 30211 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0f42f464394a4f2e8a4e0599dadcdcf8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f42f464394a4f2e8a4e0599dadcdcf8, State: Initialized, Role: FOLLOWER
I20260807 10:37:09.799171 30211 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0f42f464394a4f2e8a4e0599dadcdcf8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f42f464394a4f2e8a4e0599dadcdcf8" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 35453 } }
I20260807 10:37:09.799435 30211 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0f42f464394a4f2e8a4e0599dadcdcf8 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 10:37:09.799547 30211 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0f42f464394a4f2e8a4e0599dadcdcf8 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 10:37:09.799734 30211 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0f42f464394a4f2e8a4e0599dadcdcf8 [term 1 FOLLOWER]: Advancing to term 2
I20260807 10:37:09.803431 30211 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0f42f464394a4f2e8a4e0599dadcdcf8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f42f464394a4f2e8a4e0599dadcdcf8" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 35453 } }
I20260807 10:37:09.803885 30211 leader_election.cc:302] T 00000000000000000000000000000000 P 0f42f464394a4f2e8a4e0599dadcdcf8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0f42f464394a4f2e8a4e0599dadcdcf8; no voters:
I20260807 10:37:09.804486 30211 leader_election.cc:288] T 00000000000000000000000000000000 P 0f42f464394a4f2e8a4e0599dadcdcf8 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260807 10:37:09.804680 30215 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0f42f464394a4f2e8a4e0599dadcdcf8 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 10:37:09.805795 30215 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0f42f464394a4f2e8a4e0599dadcdcf8 [term 2 LEADER]: Becoming Leader. State: Replica: 0f42f464394a4f2e8a4e0599dadcdcf8, State: Running, Role: LEADER
I20260807 10:37:09.806447 30215 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0f42f464394a4f2e8a4e0599dadcdcf8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f42f464394a4f2e8a4e0599dadcdcf8" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 35453 } }
I20260807 10:37:09.806634 30211 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0f42f464394a4f2e8a4e0599dadcdcf8 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 10:37:09.809444 30216 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0f42f464394a4f2e8a4e0599dadcdcf8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "0f42f464394a4f2e8a4e0599dadcdcf8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f42f464394a4f2e8a4e0599dadcdcf8" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 35453 } } }
I20260807 10:37:09.809456 30217 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0f42f464394a4f2e8a4e0599dadcdcf8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0f42f464394a4f2e8a4e0599dadcdcf8. Latest consensus state: current_term: 2 leader_uuid: "0f42f464394a4f2e8a4e0599dadcdcf8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f42f464394a4f2e8a4e0599dadcdcf8" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 35453 } } }
I20260807 10:37:09.809954 30216 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0f42f464394a4f2e8a4e0599dadcdcf8 [sys.catalog]: This master's current role is: LEADER
I20260807 10:37:09.809996 30217 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0f42f464394a4f2e8a4e0599dadcdcf8 [sys.catalog]: This master's current role is: LEADER
I20260807 10:37:09.820736 30221 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 10:37:09.827874 30221 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 10:37:09.829834 30221 catalog_manager.cc:1259] Loaded cluster ID: cfbef6b78af84c88b795da0d9c1d7a79
I20260807 10:37:09.829943 30221 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 10:37:09.834949 30221 catalog_manager.cc:1504] Loading token signing keys...
I20260807 10:37:09.837291 30221 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 0f42f464394a4f2e8a4e0599dadcdcf8: Loaded TSK: 0
I20260807 10:37:09.839452 30221 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260807 10:37:10.114523 30213 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:37:10.114814 30213 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:37:10.114977 30213 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:37:10.122189 30213 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:37:10.122287 30213 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:37:10.122442 30213 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.171.65
I20260807 10:37:10.131896 30213 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.171.84:44481
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/krb5kdc/oryx_127.20.171.65.keytab
--principal=oryx/127.20.171.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.171.65:38205
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.171.65
--webserver_port=41317
--tserver_master_addrs=127.20.171.126:35453
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.171.65
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:37:10.133268 30213 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:37:10.135066 30213 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:37:10.149570 30239 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:37:10.149753 30241 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:37:10.150431 30213 server_base.cc:1034] running on GCE node
W20260807 10:37:10.150544 30238 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:37:10.151225 30213 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:37:10.152122 30213 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:37:10.153347 30213 hybrid_clock.cc:648] HybridClock initialized: now 1786099030153307 us; error 64 us; skew 500 ppm
I20260807 10:37:10.153646 30213 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:37:10 dist-test-slave-0b58 krb5kdc[29614](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099030, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.171.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:37:10.156881 30213 init.cc:377] Logged in from keytab as oryx/127.20.171.65@KRBTEST.COM (short username oryx)
I20260807 10:37:10.158512 30213 webserver.cc:460] Webserver started at http://127.20.171.65:41317/ using document root <none> and password file <none>
I20260807 10:37:10.159219 30213 fs_manager.cc:359] Metadata directory not provided
I20260807 10:37:10.159365 30213 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:37:10.164793 30213 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.001s
I20260807 10:37:10.167645 30249 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:37:10.169014 30213 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 10:37:10.169201 30213 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/minicluster-data/ts-0/wal
uuid: "7f93496410a94d13a1a28c0c43e1f3d6"
format_stamp: "Formatted at 2026-08-07 10:37:07 on dist-test-slave-0b58"
server_key: "2345bd31445032e74f0e53117e852f21"
server_key_iv: "609993e2363c4b971743334e5a28778d"
server_key_version: "encryptionkey@0"
I20260807 10:37:10.170147 30213 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:37:10.183007 30213 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:37:10.187295 30213 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:37:10.187589 30213 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:37:10.188630 30213 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:37:10.189894 30213 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:37:10.190007 30213 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:37:10.190126 30213 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:37:10.190223 30213 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:37:10.222285 30213 rpc_server.cc:307] RPC server started. Bound to: 127.20.171.65:38205
I20260807 10:37:10.222316 30365 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.171.65:38205 every 8 connection(s)
I20260807 10:37:10.224354 30213 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/minicluster-data/ts-0/data/info.pb
I20260807 10:37:10.233459 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 30213
I20260807 10:37:10.234256 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.171.66:33237
--local_ip_for_outbound_sockets=127.20.171.66
--tserver_master_addrs=127.20.171.126:35453
--webserver_port=38847
--webserver_interface=127.20.171.66
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.66.keytab
--principal=kudu/127.20.171.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.171.84:44481
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.20.171.66
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/krb5kdc/oryx_127.20.171.66.keytab with env {KRB5CCNAME=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 10:37:10 dist-test-slave-0b58 krb5kdc[29614](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.171.65@KRBTEST.COM for oryx/127.20.171.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 10:37:10 dist-test-slave-0b58 krb5kdc[29614](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.171.65@KRBTEST.COM for oryx/127.20.171.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 10:37:10.245983 30368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:37:10.228180 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:35453 (local address 127.20.171.65:46707)
0807 10:37:10.230134 (+ 1954us) negotiation.cc:107] Waiting for socket to connect
0807 10:37:10.230201 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0807 10:37:10.232716 (+ 2515us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:37:10.234309 (+ 1593us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:37:10.234315 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:37:10.234794 (+ 479us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:37:10.235339 (+ 545us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:10.235356 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:10.237636 (+ 2280us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:10.237640 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:10.238817 (+ 1177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:10.238833 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:10.240360 (+ 1527us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:10.240365 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:10.240544 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:10.241221 (+ 677us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:37:10.241243 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:37:10.244795 (+ 3552us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.171.126:35453: Server oryx/127.20.171.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":1651,"thread_start_us":1393,"threads_started":1}
W20260807 10:37:10.246104 30369 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:37:10.228930 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.65:46707 (local address 127.20.171.126:35453)
0807 10:37:10.229954 (+ 1024us) server_negotiation.cc:206] Beginning negotiation
0807 10:37:10.229969 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 10:37:10.230362 (+ 393us) server_negotiation.cc:407] Connection header received
0807 10:37:10.233328 (+ 2966us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:37:10.233349 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:37:10.233790 (+ 441us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:37:10.234193 (+ 403us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:37:10.235543 (+ 1350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:10.237485 (+ 1942us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:10.238976 (+ 1491us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:10.240093 (+ 1117us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:10.240318 (+ 225us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:10.245195 (+ 4877us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.171.65:46707: BlockingRecv error: recv got EOF from 127.20.171.65:46707 (error 108)
Metrics: {"server-negotiator.queue_time_us":710,"thread_start_us":356,"threads_started":1}
W20260807 10:37:10.246846 30366 heartbeater.cc:644] Failed to heartbeat to 127.20.171.126:35453 (0 consecutive failures): Not authorized: Failed to ping master at 127.20.171.126:35453: Client connection negotiation failed: client connection to 127.20.171.126:35453: Server oryx/127.20.171.126@KRBTEST.COM not found in Kerberos database
Aug 07 10:37:10 dist-test-slave-0b58 krb5kdc[29614](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.171.65@KRBTEST.COM for oryx/127.20.171.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 10:37:10 dist-test-slave-0b58 krb5kdc[29614](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.171.65@KRBTEST.COM for oryx/127.20.171.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 10:37:10.256155 30368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:37:10.247482 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:35453 (local address 127.20.171.65:43901)
0807 10:37:10.247667 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0807 10:37:10.247686 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 10:37:10.247786 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:37:10.248152 (+ 366us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:37:10.248154 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:37:10.248510 (+ 356us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:37:10.248639 (+ 129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:10.248646 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:10.250111 (+ 1465us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:10.250115 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:10.251431 (+ 1316us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:10.251443 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:10.252467 (+ 1024us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:10.252471 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:10.252588 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:10.253153 (+ 565us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:37:10.253168 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:37:10.255954 (+ 2786us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.171.126:35453: Server oryx/127.20.171.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":54}
W20260807 10:37:10.256568 30369 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:37:10.247658 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.65:43901 (local address 127.20.171.126:35453)
0807 10:37:10.247856 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0807 10:37:10.247865 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 10:37:10.247884 (+ 19us) server_negotiation.cc:407] Connection header received
0807 10:37:10.247936 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:37:10.247943 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:37:10.248019 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:37:10.248126 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:37:10.248772 (+ 646us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:10.249982 (+ 1210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:10.251559 (+ 1577us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:10.252333 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:10.252465 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:10.256299 (+ 3834us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.171.65:43901: BlockingRecv error: recv got EOF from 127.20.171.65:43901 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
Aug 07 10:37:10 dist-test-slave-0b58 krb5kdc[29614](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.171.65@KRBTEST.COM for oryx/127.20.171.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 10:37:10 dist-test-slave-0b58 krb5kdc[29614](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.171.65@KRBTEST.COM for oryx/127.20.171.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 10:37:10.265021 30368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:37:10.256931 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:35453 (local address 127.20.171.65:51647)
0807 10:37:10.257074 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0807 10:37:10.257091 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 10:37:10.257172 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:37:10.257480 (+ 308us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:37:10.257483 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:37:10.257735 (+ 252us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:37:10.257865 (+ 130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:10.257872 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:10.259286 (+ 1414us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:10.259289 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:10.260192 (+ 903us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:10.260202 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:10.261298 (+ 1096us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:10.261302 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:10.261458 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:10.262036 (+ 578us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:37:10.262052 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:37:10.264804 (+ 2752us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.171.126:35453: Server oryx/127.20.171.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":46}
W20260807 10:37:10.265427 30369 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:37:10.257008 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.65:51647 (local address 127.20.171.126:35453)
0807 10:37:10.257164 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0807 10:37:10.257180 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 10:37:10.257199 (+ 19us) server_negotiation.cc:407] Connection header received
0807 10:37:10.257247 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:37:10.257255 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:37:10.257343 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:37:10.257454 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:37:10.257999 (+ 545us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:10.259153 (+ 1154us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:10.260390 (+ 1237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:10.261157 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:10.261314 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:10.265090 (+ 3776us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.171.65:51647: BlockingRecv error: recv got EOF from 127.20.171.65:51647 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
W20260807 10:37:10.265460 30366 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260807 10:37:10.564050 30370 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:37:10.564335 30370 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:37:10.564427 30370 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:37:10.571344 30370 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:37:10.571442 30370 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:37:10.571575 30370 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.171.66
I20260807 10:37:10.580674 30370 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.171.84:44481
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/krb5kdc/oryx_127.20.171.66.keytab
--principal=oryx/127.20.171.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.171.66:33237
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.171.66
--webserver_port=38847
--tserver_master_addrs=127.20.171.126:35453
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.171.66
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:37:10.581815 30370 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:37:10.582953 30370 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:37:10.595714 30376 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:37:10.595657 30378 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:37:10.596009 30375 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:37:10.596642 30370 server_base.cc:1034] running on GCE node
I20260807 10:37:10.597137 30370 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:37:10.598029 30370 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:37:10.599217 30370 hybrid_clock.cc:648] HybridClock initialized: now 1786099030599181 us; error 27 us; skew 500 ppm
I20260807 10:37:10.599526 30370 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:37:10 dist-test-slave-0b58 krb5kdc[29614](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099030, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.171.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:37:10.602447 30370 init.cc:377] Logged in from keytab as oryx/127.20.171.66@KRBTEST.COM (short username oryx)
I20260807 10:37:10.603771 30370 webserver.cc:460] Webserver started at http://127.20.171.66:38847/ using document root <none> and password file <none>
I20260807 10:37:10.604429 30370 fs_manager.cc:359] Metadata directory not provided
I20260807 10:37:10.604540 30370 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:37:10.609764 30370 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260807 10:37:10.612188 30385 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:37:10.613399 30370 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 10:37:10.613559 30370 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/minicluster-data/ts-1/wal
uuid: "9f6dd7e253104417865207aa316a449b"
format_stamp: "Formatted at 2026-08-07 10:37:08 on dist-test-slave-0b58"
server_key: "e621d8c9a6606f78722d4501652487ad"
server_key_iv: "c884d2d9d130088b36e2551d744e8627"
server_key_version: "encryptionkey@0"
I20260807 10:37:10.614411 30370 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:37:10.643491 30370 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:37:10.648000 30370 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:37:10.648351 30370 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:37:10.649309 30370 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:37:10.650583 30370 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:37:10.650710 30370 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:37:10.650826 30370 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:37:10.650919 30370 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:37:10.684123 30370 rpc_server.cc:307] RPC server started. Bound to: 127.20.171.66:33237
I20260807 10:37:10.684208 30500 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.171.66:33237 every 8 connection(s)
I20260807 10:37:10.685557 30370 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/minicluster-data/ts-1/data/info.pb
I20260807 10:37:10.687096 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 30370
I20260807 10:37:10.687840 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.171.67:43567
--local_ip_for_outbound_sockets=127.20.171.67
--tserver_master_addrs=127.20.171.126:35453
--webserver_port=37847
--webserver_interface=127.20.171.67
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.67.keytab
--principal=kudu/127.20.171.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.171.84:44481
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.20.171.67
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/krb5kdc/oryx_127.20.171.67.keytab with env {KRB5CCNAME=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 10:37:10 dist-test-slave-0b58 krb5kdc[29614](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.171.66@KRBTEST.COM for oryx/127.20.171.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 10:37:10 dist-test-slave-0b58 krb5kdc[29614](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.171.66@KRBTEST.COM for oryx/127.20.171.126@KRBTEST.COM, Server not found in Kerberos database
W20260807 10:37:10.704428 30369 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:37:10.688387 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.66:58145 (local address 127.20.171.126:35453)
0807 10:37:10.688626 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0807 10:37:10.688634 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 10:37:10.689770 (+ 1136us) server_negotiation.cc:407] Connection header received
0807 10:37:10.692564 (+ 2794us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:37:10.692571 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:37:10.692653 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:37:10.692746 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:37:10.694649 (+ 1903us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:10.695667 (+ 1018us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:10.698150 (+ 2483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:10.698580 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:10.698709 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:10.704135 (+ 5426us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.171.66:58145: BlockingRecv error: recv got EOF from 127.20.171.66:58145 (error 108)
Metrics: {"server-negotiator.queue_time_us":68}
I20260807 10:37:10.705190 30503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:37:10.688836 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:35453 (local address 127.20.171.66:58145)
0807 10:37:10.689610 (+ 774us) negotiation.cc:107] Waiting for socket to connect
0807 10:37:10.689659 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0807 10:37:10.692220 (+ 2561us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:37:10.692997 (+ 777us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:37:10.693009 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:37:10.693728 (+ 719us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:37:10.694481 (+ 753us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:10.694508 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:10.695849 (+ 1341us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:10.695857 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:10.698017 (+ 2160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:10.698038 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:10.698811 (+ 773us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:10.698820 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:10.699134 (+ 314us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:10.699912 (+ 778us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:37:10.699944 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:37:10.703929 (+ 3985us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.171.126:35453: Server oryx/127.20.171.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":486,"thread_start_us":296,"threads_started":1}
W20260807 10:37:10.705899 30501 heartbeater.cc:644] Failed to heartbeat to 127.20.171.126:35453 (0 consecutive failures): Not authorized: Failed to ping master at 127.20.171.126:35453: Client connection negotiation failed: client connection to 127.20.171.126:35453: Server oryx/127.20.171.126@KRBTEST.COM not found in Kerberos database
Aug 07 10:37:10 dist-test-slave-0b58 krb5kdc[29614](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.171.66@KRBTEST.COM for oryx/127.20.171.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 10:37:10 dist-test-slave-0b58 krb5kdc[29614](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.171.66@KRBTEST.COM for oryx/127.20.171.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 10:37:10.714587 30503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:37:10.706508 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:35453 (local address 127.20.171.66:44177)
0807 10:37:10.706714 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0807 10:37:10.706733 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 10:37:10.706836 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:37:10.707186 (+ 350us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:37:10.707191 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:37:10.707524 (+ 333us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:37:10.707647 (+ 123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:10.707654 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:10.708880 (+ 1226us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:10.708888 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:10.709954 (+ 1066us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:10.709965 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:10.710662 (+ 697us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:10.710668 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:10.710846 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:10.711452 (+ 606us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:37:10.711468 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:37:10.714316 (+ 2848us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.171.126:35453: Server oryx/127.20.171.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":56}
W20260807 10:37:10.715036 30369 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:37:10.706629 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.66:44177 (local address 127.20.171.126:35453)
0807 10:37:10.706821 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0807 10:37:10.706826 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:37:10.706845 (+ 19us) server_negotiation.cc:407] Connection header received
0807 10:37:10.706955 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:37:10.706961 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:37:10.707029 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:37:10.707133 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:37:10.707776 (+ 643us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:10.708762 (+ 986us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:10.710103 (+ 1341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:10.710522 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:10.710651 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:10.714519 (+ 3868us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.171.66:44177: BlockingRecv error: recv got EOF from 127.20.171.66:44177 (error 108)
Metrics: {"server-negotiator.queue_time_us":69}
Aug 07 10:37:10 dist-test-slave-0b58 krb5kdc[29614](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.171.66@KRBTEST.COM for oryx/127.20.171.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 10:37:10 dist-test-slave-0b58 krb5kdc[29614](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.171.66@KRBTEST.COM for oryx/127.20.171.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 10:37:10.723044 30503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:37:10.715252 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:35453 (local address 127.20.171.66:45125)
0807 10:37:10.715403 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0807 10:37:10.715422 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 10:37:10.715515 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:37:10.716089 (+ 574us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:37:10.716094 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:37:10.716451 (+ 357us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:37:10.716580 (+ 129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:10.716587 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:10.717545 (+ 958us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:10.717550 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:10.718666 (+ 1116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:10.718687 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:10.719372 (+ 685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:10.719377 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:10.719560 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:10.720081 (+ 521us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:37:10.720095 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:37:10.722763 (+ 2668us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.171.126:35453: Server oryx/127.20.171.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":50}
W20260807 10:37:10.723165 30369 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:37:10.715687 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.66:45125 (local address 127.20.171.126:35453)
0807 10:37:10.715854 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0807 10:37:10.715858 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 10:37:10.715870 (+ 12us) server_negotiation.cc:407] Connection header received
0807 10:37:10.715906 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:37:10.715910 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:37:10.715960 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:37:10.716064 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:37:10.716715 (+ 651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:10.717395 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:10.718788 (+ 1393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:10.719246 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:10.719361 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:10.722940 (+ 3579us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.171.66:45125: BlockingRecv error: recv got EOF from 127.20.171.66:45125 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
W20260807 10:37:10.723517 30501 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260807 10:37:11.022190 30504 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:37:11.022477 30504 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:37:11.022634 30504 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:37:11.029584 30504 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:37:11.029728 30504 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:37:11.029919 30504 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.171.67
I20260807 10:37:11.039260 30504 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.171.84:44481
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/krb5kdc/oryx_127.20.171.67.keytab
--principal=oryx/127.20.171.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.171.67:43567
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.171.67
--webserver_port=37847
--tserver_master_addrs=127.20.171.126:35453
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.171.67
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:37:11.040593 30504 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:37:11.041841 30504 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:37:11.054373 30509 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:37:11.054431 30512 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:37:11.054427 30510 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:37:11.055467 30504 server_base.cc:1034] running on GCE node
I20260807 10:37:11.056039 30504 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:37:11.057046 30504 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:37:11.058261 30504 hybrid_clock.cc:648] HybridClock initialized: now 1786099031058232 us; error 33 us; skew 500 ppm
I20260807 10:37:11.058562 30504 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:37:11 dist-test-slave-0b58 krb5kdc[29614](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099031, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.171.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:37:11.061803 30504 init.cc:377] Logged in from keytab as oryx/127.20.171.67@KRBTEST.COM (short username oryx)
I20260807 10:37:11.063122 30504 webserver.cc:460] Webserver started at http://127.20.171.67:37847/ using document root <none> and password file <none>
I20260807 10:37:11.063710 30504 fs_manager.cc:359] Metadata directory not provided
I20260807 10:37:11.063812 30504 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:37:11.068897 30504 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260807 10:37:11.071267 30519 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:37:11.072665 30504 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 10:37:11.072837 30504 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/minicluster-data/ts-2/wal
uuid: "0be36d072ba748d5aea40094e65ebe1f"
format_stamp: "Formatted at 2026-08-07 10:37:08 on dist-test-slave-0b58"
server_key: "571930f91d5c88070faecd8e7ca12df8"
server_key_iv: "438c29f50d9db602df0ff561ab231792"
server_key_version: "encryptionkey@0"
I20260807 10:37:11.073859 30504 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:37:11.098362 30504 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:37:11.102651 30504 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:37:11.102931 30504 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:37:11.103863 30504 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:37:11.105209 30504 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:37:11.105300 30504 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:37:11.105372 30504 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:37:11.105434 30504 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:37:11.137495 30504 rpc_server.cc:307] RPC server started. Bound to: 127.20.171.67:43567
I20260807 10:37:11.137564 30635 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.171.67:43567 every 8 connection(s)
I20260807 10:37:11.138903 30504 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786098956060137-21165-0/minicluster-data/ts-2/data/info.pb
I20260807 10:37:11.139334 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 30504
Aug 07 10:37:11 dist-test-slave-0b58 krb5kdc[29614](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.171.67@KRBTEST.COM for oryx/127.20.171.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 10:37:11 dist-test-slave-0b58 krb5kdc[29614](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.171.67@KRBTEST.COM for oryx/127.20.171.126@KRBTEST.COM, Server not found in Kerberos database
W20260807 10:37:11.154575 30639 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:37:11.141555 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.67:34583 (local address 127.20.171.126:35453)
0807 10:37:11.141975 (+ 420us) server_negotiation.cc:206] Beginning negotiation
0807 10:37:11.141979 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 10:37:11.142980 (+ 1001us) server_negotiation.cc:407] Connection header received
0807 10:37:11.144681 (+ 1701us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:37:11.144686 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:37:11.144754 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:37:11.144843 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:37:11.146276 (+ 1433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:11.147269 (+ 993us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:11.148811 (+ 1542us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:11.149263 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:11.149383 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:11.154288 (+ 4905us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.171.67:34583: BlockingRecv error: recv got EOF from 127.20.171.67:34583 (error 108)
Metrics: {"server-negotiator.queue_time_us":338,"thread_start_us":249,"threads_started":1}
I20260807 10:37:11.155177 30369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:37:11.140726 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47920 (local address 127.20.171.126:35453)
0807 10:37:11.140941 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0807 10:37:11.140947 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:37:11.141027 (+ 80us) server_negotiation.cc:407] Connection header received
0807 10:37:11.141237 (+ 210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:37:11.141242 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:37:11.141319 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:37:11.141414 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:37:11.143354 (+ 1940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:11.144150 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:11.145403 (+ 1253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:11.145839 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:11.145976 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:11.148990 (+ 3014us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:37:11.148997 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:37:11.149012 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:37:11.149050 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:37:11.151740 (+ 2690us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:37:11.152639 (+ 899us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:37:11.152648 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:37:11.152666 (+ 18us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:37:11.152880 (+ 214us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:37:11.153252 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:37:11.153256 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:37:11.153260 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:37:11.153668 (+ 408us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:37:11.153999 (+ 331us) server_negotiation.cc:1035] Waiting for connection context
0807 10:37:11.154429 (+ 430us) server_negotiation.cc:299] Negotiation successful
0807 10:37:11.154805 (+ 376us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260807 10:37:11.155256 30640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:37:11.142102 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:35453 (local address 127.20.171.67:34583)
0807 10:37:11.142847 (+ 745us) negotiation.cc:107] Waiting for socket to connect
0807 10:37:11.142880 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0807 10:37:11.144459 (+ 1579us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:37:11.145100 (+ 641us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:37:11.145107 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:37:11.145557 (+ 450us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:37:11.146084 (+ 527us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:11.146100 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:11.147419 (+ 1319us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:11.147425 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:11.148667 (+ 1242us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:11.148685 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:11.149470 (+ 785us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:11.149479 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:11.149799 (+ 320us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:11.150416 (+ 617us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:37:11.150443 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:37:11.154084 (+ 3641us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.171.126:35453: Server oryx/127.20.171.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":502,"thread_start_us":311,"threads_started":1}
W20260807 10:37:11.155918 30636 heartbeater.cc:644] Failed to heartbeat to 127.20.171.126:35453 (0 consecutive failures): Not authorized: Failed to ping master at 127.20.171.126:35453: Client connection negotiation failed: client connection to 127.20.171.126:35453: Server oryx/127.20.171.126@KRBTEST.COM not found in Kerberos database
Aug 07 10:37:11 dist-test-slave-0b58 krb5kdc[29614](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.171.67@KRBTEST.COM for oryx/127.20.171.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 10:37:11 dist-test-slave-0b58 krb5kdc[29614](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.171.67@KRBTEST.COM for oryx/127.20.171.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 10:37:11.164057 30640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:37:11.156547 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:35453 (local address 127.20.171.67:51499)
0807 10:37:11.156740 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0807 10:37:11.156758 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 10:37:11.156860 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:37:11.157159 (+ 299us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:37:11.157163 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:37:11.157592 (+ 429us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:37:11.157794 (+ 202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:11.157803 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:11.159022 (+ 1219us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:11.159027 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:11.159904 (+ 877us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:11.159915 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:11.160643 (+ 728us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:11.160647 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:11.160760 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:11.161295 (+ 535us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:37:11.161311 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:37:11.163877 (+ 2566us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.171.126:35453: Server oryx/127.20.171.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":60}
W20260807 10:37:11.164317 30369 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:37:11.156639 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.67:51499 (local address 127.20.171.126:35453)
0807 10:37:11.156798 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0807 10:37:11.156802 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 10:37:11.156817 (+ 15us) server_negotiation.cc:407] Connection header received
0807 10:37:11.156969 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:37:11.156972 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:37:11.157023 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:37:11.157103 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:37:11.157928 (+ 825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:11.158851 (+ 923us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:11.160047 (+ 1196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:11.160527 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:11.160625 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:11.164069 (+ 3444us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.171.67:51499: BlockingRecv error: recv got EOF from 127.20.171.67:51499 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
Aug 07 10:37:11 dist-test-slave-0b58 krb5kdc[29614](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.171.67@KRBTEST.COM for oryx/127.20.171.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 10:37:11 dist-test-slave-0b58 krb5kdc[29614](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.171.67@KRBTEST.COM for oryx/127.20.171.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 10:37:11.172729 30640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:37:11.164764 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:35453 (local address 127.20.171.67:50317)
0807 10:37:11.164897 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0807 10:37:11.164914 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 10:37:11.165031 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:37:11.165327 (+ 296us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:37:11.165332 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:37:11.165642 (+ 310us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:37:11.165780 (+ 138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:11.165788 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:11.166760 (+ 972us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:11.166765 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:11.167676 (+ 911us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:11.167686 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:11.168489 (+ 803us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:11.168495 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:11.168693 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:11.169296 (+ 603us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:37:11.169312 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:37:11.172494 (+ 3182us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.171.126:35453: Server oryx/127.20.171.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":31}
W20260807 10:37:11.172852 30369 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:37:11.164825 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.67:50317 (local address 127.20.171.126:35453)
0807 10:37:11.165052 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0807 10:37:11.165060 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 10:37:11.165080 (+ 20us) server_negotiation.cc:407] Connection header received
0807 10:37:11.165130 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:37:11.165134 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:37:11.165196 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:37:11.165302 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:37:11.165915 (+ 613us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:11.166621 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:11.167827 (+ 1206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:11.168340 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:11.168479 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:11.172608 (+ 4129us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.171.67:50317: BlockingRecv error: recv got EOF from 127.20.171.67:50317 (error 108)
Metrics: {"server-negotiator.queue_time_us":106}
W20260807 10:37:11.173189 30636 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 07 10:37:11 dist-test-slave-0b58 krb5kdc[29614](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.171.65@KRBTEST.COM for oryx/127.20.171.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 10:37:11 dist-test-slave-0b58 krb5kdc[29614](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.171.65@KRBTEST.COM for oryx/127.20.171.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 10:37:11.274536 30641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:37:11.266116 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:35453 (local address 127.20.171.65:46541)
0807 10:37:11.266755 (+ 639us) negotiation.cc:107] Waiting for socket to connect
0807 10:37:11.266776 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0807 10:37:11.266936 (+ 160us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:37:11.267326 (+ 390us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:37:11.267329 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:37:11.267811 (+ 482us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:37:11.268002 (+ 191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:11.268011 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:11.268958 (+ 947us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:11.268962 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:11.269894 (+ 932us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:11.269905 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:11.270557 (+ 652us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:11.270562 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:11.270700 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:11.271264 (+ 564us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:37:11.271280 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:37:11.274240 (+ 2960us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.171.126:35453: Server oryx/127.20.171.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":487,"thread_start_us":308,"threads_started":1}
W20260807 10:37:11.274696 30369 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:37:11.266203 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.65:46541 (local address 127.20.171.126:35453)
0807 10:37:11.266478 (+ 275us) server_negotiation.cc:206] Beginning negotiation
0807 10:37:11.266485 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:37:11.266877 (+ 392us) server_negotiation.cc:407] Connection header received
0807 10:37:11.267077 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:37:11.267084 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:37:11.267169 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:37:11.267260 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:37:11.268122 (+ 862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:11.268824 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:11.270006 (+ 1182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:11.270393 (+ 387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:11.270481 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:11.274483 (+ 4002us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.171.65:46541: BlockingRecv error: recv got EOF from 127.20.171.65:46541 (error 108)
Metrics: {"server-negotiator.queue_time_us":99}
Aug 07 10:37:11 dist-test-slave-0b58 krb5kdc[29614](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.171.66@KRBTEST.COM for oryx/127.20.171.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 10:37:11 dist-test-slave-0b58 krb5kdc[29614](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.171.66@KRBTEST.COM for oryx/127.20.171.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 10:37:11.733000 30642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:37:11.724061 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:35453 (local address 127.20.171.66:56373)
0807 10:37:11.724669 (+ 608us) negotiation.cc:107] Waiting for socket to connect
0807 10:37:11.724684 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 10:37:11.724795 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:37:11.725097 (+ 302us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:37:11.725100 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:37:11.725596 (+ 496us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:37:11.725796 (+ 200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:11.725805 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:11.726889 (+ 1084us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:11.726894 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:11.728009 (+ 1115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:11.728024 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:11.728960 (+ 936us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:11.728965 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:11.729086 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:11.729765 (+ 679us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:37:11.729782 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:37:11.732767 (+ 2985us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.171.126:35453: Server oryx/127.20.171.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":508,"thread_start_us":368,"threads_started":1}
W20260807 10:37:11.733242 30369 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:37:11.724123 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.66:56373 (local address 127.20.171.126:35453)
0807 10:37:11.724505 (+ 382us) server_negotiation.cc:206] Beginning negotiation
0807 10:37:11.724511 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:37:11.724760 (+ 249us) server_negotiation.cc:407] Connection header received
0807 10:37:11.724886 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:37:11.724889 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:37:11.724962 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:37:11.725037 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:37:11.725960 (+ 923us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:11.726707 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:11.728167 (+ 1460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:11.728786 (+ 619us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:11.728881 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:11.732966 (+ 4085us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.171.66:56373: BlockingRecv error: recv got EOF from 127.20.171.66:56373 (error 108)
Metrics: {"server-negotiator.queue_time_us":72}
Aug 07 10:37:12 dist-test-slave-0b58 krb5kdc[29614](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.171.67@KRBTEST.COM for oryx/127.20.171.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 10:37:12 dist-test-slave-0b58 krb5kdc[29614](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.171.67@KRBTEST.COM for oryx/127.20.171.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 10:37:12.185067 30643 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:37:12.173773 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:35453 (local address 127.20.171.67:46435)
0807 10:37:12.174285 (+ 512us) negotiation.cc:107] Waiting for socket to connect
0807 10:37:12.174298 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 10:37:12.174438 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:37:12.174891 (+ 453us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:37:12.174895 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:37:12.175580 (+ 685us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:37:12.175871 (+ 291us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:12.175884 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:12.177014 (+ 1130us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:12.177018 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:12.178077 (+ 1059us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:12.178088 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:12.178766 (+ 678us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:12.178770 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:12.178891 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:12.182356 (+ 3465us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:37:12.182371 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:37:12.184863 (+ 2492us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.171.126:35453: Server oryx/127.20.171.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":411,"thread_start_us":278,"threads_started":1}
W20260807 10:37:12.185262 30369 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:37:12.173967 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.67:46435 (local address 127.20.171.126:35453)
0807 10:37:12.174159 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0807 10:37:12.174164 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:37:12.174372 (+ 208us) server_negotiation.cc:407] Connection header received
0807 10:37:12.174624 (+ 252us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:37:12.174628 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:37:12.174708 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:37:12.174809 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:37:12.176027 (+ 1218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:12.176894 (+ 867us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:12.178194 (+ 1300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:12.178604 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:12.178700 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:12.185030 (+ 6330us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.171.67:46435: BlockingRecv error: recv got EOF from 127.20.171.67:46435 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
Aug 07 10:37:12 dist-test-slave-0b58 krb5kdc[29614](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.171.65@KRBTEST.COM for oryx/127.20.171.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 10:37:12 dist-test-slave-0b58 krb5kdc[29614](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.171.65@KRBTEST.COM for oryx/127.20.171.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 10:37:12.284031 30644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:37:12.275351 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:35453 (local address 127.20.171.65:47527)
0807 10:37:12.275905 (+ 554us) negotiation.cc:107] Waiting for socket to connect
0807 10:37:12.275921 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 10:37:12.276048 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:37:12.276398 (+ 350us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:37:12.276401 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:37:12.276848 (+ 447us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:37:12.277042 (+ 194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:12.277056 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:12.278062 (+ 1006us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:12.278066 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:12.279008 (+ 942us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:12.279020 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:12.279767 (+ 747us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:12.279772 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:12.279914 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:12.280710 (+ 796us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:37:12.280735 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:37:12.283689 (+ 2954us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.171.126:35453: Server oryx/127.20.171.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":444,"thread_start_us":323,"threads_started":1}
W20260807 10:37:12.284127 30369 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:37:12.275431 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.65:47527 (local address 127.20.171.126:35453)
0807 10:37:12.275610 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0807 10:37:12.275615 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:37:12.275994 (+ 379us) server_negotiation.cc:407] Connection header received
0807 10:37:12.276146 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:37:12.276149 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:37:12.276212 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:37:12.276367 (+ 155us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:37:12.277193 (+ 826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:12.277946 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:12.279169 (+ 1223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:12.279602 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:12.279711 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:12.283891 (+ 4180us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.171.65:47527: BlockingRecv error: recv got EOF from 127.20.171.65:47527 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
Aug 07 10:37:12 dist-test-slave-0b58 krb5kdc[29614](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.171.66@KRBTEST.COM for oryx/127.20.171.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 10:37:12 dist-test-slave-0b58 krb5kdc[29614](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.171.66@KRBTEST.COM for oryx/127.20.171.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 10:37:12.742326 30645 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:37:12.733943 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:35453 (local address 127.20.171.66:37533)
0807 10:37:12.734469 (+ 526us) negotiation.cc:107] Waiting for socket to connect
0807 10:37:12.734492 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0807 10:37:12.734621 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:37:12.734943 (+ 322us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:37:12.734946 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:37:12.735375 (+ 429us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:37:12.735544 (+ 169us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:12.735553 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:12.736622 (+ 1069us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:12.736626 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:12.737509 (+ 883us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:12.737519 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:12.738148 (+ 629us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:12.738152 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:12.738273 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:12.738955 (+ 682us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:37:12.738973 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:37:12.742081 (+ 3108us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.171.126:35453: Server oryx/127.20.171.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":416,"thread_start_us":296,"threads_started":1}
W20260807 10:37:12.742509 30369 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:37:12.733990 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.66:37533 (local address 127.20.171.126:35453)
0807 10:37:12.734205 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0807 10:37:12.734215 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 10:37:12.734575 (+ 360us) server_negotiation.cc:407] Connection header received
0807 10:37:12.734722 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:37:12.734725 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:37:12.734818 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:37:12.734896 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:37:12.735676 (+ 780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:12.736499 (+ 823us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:12.737627 (+ 1128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:12.738023 (+ 396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:12.738111 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:12.742269 (+ 4158us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.171.66:37533: BlockingRecv error: recv got EOF from 127.20.171.66:37533 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
Aug 07 10:37:13 dist-test-slave-0b58 krb5kdc[29614](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.171.67@KRBTEST.COM for oryx/127.20.171.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 10:37:13 dist-test-slave-0b58 krb5kdc[29614](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.171.67@KRBTEST.COM for oryx/127.20.171.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 10:37:13.194283 30646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:37:13.185953 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:35453 (local address 127.20.171.67:43753)
0807 10:37:13.186546 (+ 593us) negotiation.cc:107] Waiting for socket to connect
0807 10:37:13.186561 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 10:37:13.186730 (+ 169us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:37:13.187086 (+ 356us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:37:13.187091 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:37:13.187548 (+ 457us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:37:13.187745 (+ 197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:13.187753 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:13.188847 (+ 1094us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:13.188852 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:13.189676 (+ 824us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:13.189687 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:13.190371 (+ 684us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:13.190377 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:13.190550 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:13.191097 (+ 547us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:37:13.191113 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:37:13.193913 (+ 2800us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.171.126:35453: Server oryx/127.20.171.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":503,"thread_start_us":357,"threads_started":1}
W20260807 10:37:13.194356 30369 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:37:13.186169 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.67:43753 (local address 127.20.171.126:35453)
0807 10:37:13.186405 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0807 10:37:13.186411 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:37:13.186652 (+ 241us) server_negotiation.cc:407] Connection header received
0807 10:37:13.186860 (+ 208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:37:13.186866 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:37:13.186943 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:37:13.187046 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:37:13.187877 (+ 831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:13.188720 (+ 843us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:13.189807 (+ 1087us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:13.190221 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:13.190356 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:13.194118 (+ 3762us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.171.67:43753: BlockingRecv error: recv got EOF from 127.20.171.67:43753 (error 108)
Metrics: {"server-negotiator.queue_time_us":77}
Aug 07 10:37:13 dist-test-slave-0b58 krb5kdc[29614](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.171.65@KRBTEST.COM for oryx/127.20.171.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 10:37:13 dist-test-slave-0b58 krb5kdc[29614](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.171.65@KRBTEST.COM for oryx/127.20.171.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 10:37:13.293083 30647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:37:13.285050 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:35453 (local address 127.20.171.65:54449)
0807 10:37:13.285649 (+ 599us) negotiation.cc:107] Waiting for socket to connect
0807 10:37:13.285665 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 10:37:13.285788 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:37:13.286080 (+ 292us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:37:13.286083 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:37:13.286458 (+ 375us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:37:13.286632 (+ 174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:13.286642 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:13.287702 (+ 1060us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:13.287706 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:13.288675 (+ 969us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:13.288687 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:13.289358 (+ 671us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:13.289363 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:13.289490 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:13.290178 (+ 688us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:37:13.290195 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:37:13.292823 (+ 2628us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.171.126:35453: Server oryx/127.20.171.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":481,"thread_start_us":341,"threads_started":1}
W20260807 10:37:13.293296 30369 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:37:13.285102 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.65:54449 (local address 127.20.171.126:35453)
0807 10:37:13.285319 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0807 10:37:13.285324 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:37:13.285739 (+ 415us) server_negotiation.cc:407] Connection header received
0807 10:37:13.285886 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:37:13.285890 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:37:13.285951 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:37:13.286032 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:37:13.286766 (+ 734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:13.287560 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:13.288797 (+ 1237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:13.289211 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:13.289303 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:13.293007 (+ 3704us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.171.65:54449: BlockingRecv error: recv got EOF from 127.20.171.65:54449 (error 108)
Metrics: {"server-negotiator.queue_time_us":69}
Aug 07 10:37:13 dist-test-slave-0b58 krb5kdc[29614](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.171.66@KRBTEST.COM for oryx/127.20.171.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 10:37:13 dist-test-slave-0b58 krb5kdc[29614](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.171.66@KRBTEST.COM for oryx/127.20.171.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 10:37:13.752683 30648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:37:13.743463 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:35453 (local address 127.20.171.66:44697)
0807 10:37:13.743991 (+ 528us) negotiation.cc:107] Waiting for socket to connect
0807 10:37:13.744013 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0807 10:37:13.744130 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:37:13.744503 (+ 373us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:37:13.744506 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:37:13.744860 (+ 354us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:37:13.745031 (+ 171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:13.745039 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:13.746530 (+ 1491us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:13.746534 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:13.747644 (+ 1110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:13.747658 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:13.748643 (+ 985us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:13.748647 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:13.748782 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:13.749440 (+ 658us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:37:13.749464 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:37:13.752424 (+ 2960us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.171.126:35453: Server oryx/127.20.171.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":401,"thread_start_us":284,"threads_started":1}
W20260807 10:37:13.752827 30369 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:37:13.743526 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.66:44697 (local address 127.20.171.126:35453)
0807 10:37:13.743726 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0807 10:37:13.743732 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:37:13.744099 (+ 367us) server_negotiation.cc:407] Connection header received
0807 10:37:13.744271 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:37:13.744277 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:37:13.744356 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:37:13.744458 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:37:13.745189 (+ 731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:13.746353 (+ 1164us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:13.747795 (+ 1442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:13.748505 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:13.748644 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:13.752610 (+ 3966us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.171.66:44697: BlockingRecv error: recv got EOF from 127.20.171.66:44697 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
Aug 07 10:37:14 dist-test-slave-0b58 krb5kdc[29614](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.171.67@KRBTEST.COM for oryx/127.20.171.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 10:37:14 dist-test-slave-0b58 krb5kdc[29614](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.171.67@KRBTEST.COM for oryx/127.20.171.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 10:37:14.206041 30649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:37:14.195392 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:35453 (local address 127.20.171.67:38945)
0807 10:37:14.195910 (+ 518us) negotiation.cc:107] Waiting for socket to connect
0807 10:37:14.195930 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0807 10:37:14.196080 (+ 150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:37:14.196533 (+ 453us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:37:14.196538 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:37:14.196902 (+ 364us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:37:14.197121 (+ 219us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:14.197135 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:14.198283 (+ 1148us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:14.198286 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:14.199740 (+ 1454us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:14.199757 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:14.200856 (+ 1099us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:14.200862 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:14.201116 (+ 254us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:14.201893 (+ 777us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:37:14.201914 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:37:14.205774 (+ 3860us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.171.126:35453: Server oryx/127.20.171.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":378,"spinlock_wait_cycles":39808,"thread_start_us":350,"threads_started":1}
W20260807 10:37:14.206413 30369 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:37:14.195498 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.67:38945 (local address 127.20.171.126:35453)
0807 10:37:14.195745 (+ 247us) server_negotiation.cc:206] Beginning negotiation
0807 10:37:14.195751 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:37:14.196045 (+ 294us) server_negotiation.cc:407] Connection header received
0807 10:37:14.196229 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:37:14.196236 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:37:14.196346 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:37:14.196478 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:37:14.197324 (+ 846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:14.198167 (+ 843us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:14.199884 (+ 1717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:14.200679 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:14.200817 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:14.206105 (+ 5288us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.171.67:38945: BlockingRecv error: recv got EOF from 127.20.171.67:38945 (error 108)
Metrics: {"server-negotiator.queue_time_us":79}
Aug 07 10:37:14 dist-test-slave-0b58 krb5kdc[29614](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.171.65@KRBTEST.COM for oryx/127.20.171.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 10:37:14 dist-test-slave-0b58 krb5kdc[29614](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.171.65@KRBTEST.COM for oryx/127.20.171.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 10:37:14.301537 30650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:37:14.293973 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:35453 (local address 127.20.171.65:40019)
0807 10:37:14.294460 (+ 487us) negotiation.cc:107] Waiting for socket to connect
0807 10:37:14.294485 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0807 10:37:14.294591 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:37:14.294868 (+ 277us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:37:14.294871 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:37:14.295232 (+ 361us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:37:14.295390 (+ 158us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:14.295398 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:14.296455 (+ 1057us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:14.296459 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:14.297413 (+ 954us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:14.297425 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:14.298087 (+ 662us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:14.298090 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:14.298204 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:14.298818 (+ 614us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:37:14.298843 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:37:14.301321 (+ 2478us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.171.126:35453: Server oryx/127.20.171.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":377,"thread_start_us":272,"threads_started":1}
W20260807 10:37:14.301860 30369 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:37:14.294012 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.65:40019 (local address 127.20.171.126:35453)
0807 10:37:14.294203 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0807 10:37:14.294207 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 10:37:14.294550 (+ 343us) server_negotiation.cc:407] Connection header received
0807 10:37:14.294678 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:37:14.294681 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:37:14.294738 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:37:14.294814 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:37:14.295534 (+ 720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:14.296331 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:14.297549 (+ 1218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:14.297962 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:14.298049 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:14.301503 (+ 3454us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.171.65:40019: BlockingRecv error: recv got EOF from 127.20.171.65:40019 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
Aug 07 10:37:14 dist-test-slave-0b58 krb5kdc[29614](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.171.66@KRBTEST.COM for oryx/127.20.171.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 10:37:14 dist-test-slave-0b58 krb5kdc[29614](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.171.66@KRBTEST.COM for oryx/127.20.171.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 10:37:14.761359 30651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:37:14.753578 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:35453 (local address 127.20.171.66:44473)
0807 10:37:14.754118 (+ 540us) negotiation.cc:107] Waiting for socket to connect
0807 10:37:14.754134 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 10:37:14.754244 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:37:14.754538 (+ 294us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:37:14.754541 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:37:14.754872 (+ 331us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:37:14.755019 (+ 147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:14.755028 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:14.756012 (+ 984us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:14.756016 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:14.756978 (+ 962us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:14.756990 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:14.757708 (+ 718us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:14.757712 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:14.757832 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:14.758398 (+ 566us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:37:14.758414 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:37:14.761026 (+ 2612us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.171.126:35453: Server oryx/127.20.171.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":408,"thread_start_us":263,"threads_started":1}
W20260807 10:37:14.761451 30369 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:37:14.753615 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.66:44473 (local address 127.20.171.126:35453)
0807 10:37:14.753850 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0807 10:37:14.753859 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 10:37:14.754215 (+ 356us) server_negotiation.cc:407] Connection header received
0807 10:37:14.754325 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:37:14.754328 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:37:14.754387 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:37:14.754463 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:37:14.755138 (+ 675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:14.755896 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:14.757171 (+ 1275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:14.757548 (+ 377us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:14.757655 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:14.761231 (+ 3576us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.171.66:44473: BlockingRecv error: recv got EOF from 127.20.171.66:44473 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
Aug 07 10:37:15 dist-test-slave-0b58 krb5kdc[29614](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.171.67@KRBTEST.COM for oryx/127.20.171.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 10:37:15 dist-test-slave-0b58 krb5kdc[29614](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.171.67@KRBTEST.COM for oryx/127.20.171.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 10:37:15.214838 30652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:37:15.207074 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:35453 (local address 127.20.171.67:41765)
0807 10:37:15.207619 (+ 545us) negotiation.cc:107] Waiting for socket to connect
0807 10:37:15.207633 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 10:37:15.207745 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:37:15.208016 (+ 271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:37:15.208019 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:37:15.208544 (+ 525us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:37:15.208694 (+ 150us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:15.208702 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:15.209630 (+ 928us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:15.209633 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:15.210483 (+ 850us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:15.210493 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:15.211077 (+ 584us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:15.211080 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:15.211180 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:15.211801 (+ 621us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:37:15.211816 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:37:15.214597 (+ 2781us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.171.126:35453: Server oryx/127.20.171.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":429,"thread_start_us":317,"threads_started":1}
W20260807 10:37:15.215148 30369 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:37:15.207158 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.67:41765 (local address 127.20.171.126:35453)
0807 10:37:15.207367 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0807 10:37:15.207376 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 10:37:15.207719 (+ 343us) server_negotiation.cc:407] Connection header received
0807 10:37:15.207826 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:37:15.207829 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:37:15.207903 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:37:15.207979 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:37:15.208830 (+ 851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:15.209508 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:15.210591 (+ 1083us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:15.210967 (+ 376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:15.211050 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:15.214845 (+ 3795us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.171.67:41765: BlockingRecv error: recv got EOF from 127.20.171.67:41765 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
Aug 07 10:37:15 dist-test-slave-0b58 krb5kdc[29614](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.171.65@KRBTEST.COM for oryx/127.20.171.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 10:37:15 dist-test-slave-0b58 krb5kdc[29614](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.171.65@KRBTEST.COM for oryx/127.20.171.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 10:37:15.310882 30653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:37:15.302432 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:35453 (local address 127.20.171.65:39131)
0807 10:37:15.302959 (+ 527us) negotiation.cc:107] Waiting for socket to connect
0807 10:37:15.302975 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 10:37:15.303079 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:37:15.303346 (+ 267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:37:15.303349 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:37:15.303748 (+ 399us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:37:15.303893 (+ 145us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:15.303901 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:15.304858 (+ 957us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:15.304861 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:15.305767 (+ 906us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:15.305779 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:15.306684 (+ 905us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:15.306690 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:15.306889 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:15.307630 (+ 741us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:37:15.307656 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:37:15.310643 (+ 2987us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.171.126:35453: Server oryx/127.20.171.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":421,"thread_start_us":268,"threads_started":1}
W20260807 10:37:15.311045 30369 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:37:15.302555 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.65:39131 (local address 127.20.171.126:35453)
0807 10:37:15.302756 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0807 10:37:15.302760 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 10:37:15.303043 (+ 283us) server_negotiation.cc:407] Connection header received
0807 10:37:15.303165 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:37:15.303168 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:37:15.303223 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:37:15.303299 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:37:15.304007 (+ 708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:15.304717 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:15.305886 (+ 1169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:15.306510 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:15.306668 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:15.310826 (+ 4158us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.171.65:39131: BlockingRecv error: recv got EOF from 127.20.171.65:39131 (error 108)
Metrics: {"server-negotiator.queue_time_us":75}
Aug 07 10:37:15 dist-test-slave-0b58 krb5kdc[29614](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.171.66@KRBTEST.COM for oryx/127.20.171.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 10:37:15 dist-test-slave-0b58 krb5kdc[29614](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.171.66@KRBTEST.COM for oryx/127.20.171.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 10:37:15.770843 30654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:37:15.762413 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:35453 (local address 127.20.171.66:58329)
0807 10:37:15.763013 (+ 600us) negotiation.cc:107] Waiting for socket to connect
0807 10:37:15.763030 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 10:37:15.763136 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:37:15.763534 (+ 398us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:37:15.763540 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:37:15.764003 (+ 463us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:37:15.764233 (+ 230us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:15.764244 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:15.765575 (+ 1331us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:15.765579 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:15.766521 (+ 942us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:15.766535 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:15.767143 (+ 608us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:15.767147 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:15.767274 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:15.767875 (+ 601us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:37:15.767891 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:37:15.770604 (+ 2713us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.171.126:35453: Server oryx/127.20.171.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":483,"thread_start_us":315,"threads_started":1}
W20260807 10:37:15.771014 30369 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:37:15.762560 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.66:58329 (local address 127.20.171.126:35453)
0807 10:37:15.762758 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0807 10:37:15.762763 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:37:15.763106 (+ 343us) server_negotiation.cc:407] Connection header received
0807 10:37:15.763260 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:37:15.763266 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:37:15.763348 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:37:15.763476 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:37:15.764424 (+ 948us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:15.765433 (+ 1009us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:15.766648 (+ 1215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:15.767023 (+ 375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:15.767114 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:15.770796 (+ 3682us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.171.66:58329: BlockingRecv error: recv got EOF from 127.20.171.66:58329 (error 108)
Metrics: {"server-negotiator.queue_time_us":86}
Aug 07 10:37:16 dist-test-slave-0b58 krb5kdc[29614](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.171.67@KRBTEST.COM for oryx/127.20.171.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 10:37:16 dist-test-slave-0b58 krb5kdc[29614](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.171.67@KRBTEST.COM for oryx/127.20.171.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 10:37:16.225170 30655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:37:16.215871 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:35453 (local address 127.20.171.67:49357)
0807 10:37:16.216428 (+ 557us) negotiation.cc:107] Waiting for socket to connect
0807 10:37:16.216443 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 10:37:16.216606 (+ 163us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:37:16.216963 (+ 357us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:37:16.216968 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:37:16.217499 (+ 531us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:37:16.217663 (+ 164us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:16.217672 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:16.218787 (+ 1115us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:16.218792 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:16.219654 (+ 862us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:16.219665 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:16.220397 (+ 732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:16.220402 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:16.220607 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:16.221192 (+ 585us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:37:16.221217 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:37:16.224810 (+ 3593us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.171.126:35453: Server oryx/127.20.171.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":457,"thread_start_us":255,"threads_started":1}
W20260807 10:37:16.225777 30369 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:37:16.215953 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.67:49357 (local address 127.20.171.126:35453)
0807 10:37:16.216185 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0807 10:37:16.216192 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:37:16.216529 (+ 337us) server_negotiation.cc:407] Connection header received
0807 10:37:16.216730 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:37:16.216739 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:37:16.216797 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:37:16.216938 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:37:16.217810 (+ 872us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:16.218644 (+ 834us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:16.219791 (+ 1147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:16.220197 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:16.220390 (+ 193us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:16.225107 (+ 4717us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.171.67:49357: BlockingRecv error: recv got EOF from 127.20.171.67:49357 (error 108)
Metrics: {"server-negotiator.queue_time_us":78}
Aug 07 10:37:16 dist-test-slave-0b58 krb5kdc[29614](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.171.65@KRBTEST.COM for oryx/127.20.171.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 10:37:16 dist-test-slave-0b58 krb5kdc[29614](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.171.65@KRBTEST.COM for oryx/127.20.171.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 10:37:16.320381 30656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:37:16.311899 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:35453 (local address 127.20.171.65:55075)
0807 10:37:16.312781 (+ 882us) negotiation.cc:107] Waiting for socket to connect
0807 10:37:16.312799 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 10:37:16.312925 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:37:16.313252 (+ 327us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:37:16.313255 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:37:16.313619 (+ 364us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:37:16.313773 (+ 154us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:16.313782 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:16.314693 (+ 911us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:16.314697 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:16.315544 (+ 847us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:16.315555 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:16.316216 (+ 661us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:16.316220 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:16.316419 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:16.317050 (+ 631us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:37:16.317067 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:37:16.320037 (+ 2970us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.171.126:35453: Server oryx/127.20.171.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":754,"thread_start_us":628,"threads_started":1}
W20260807 10:37:16.320536 30369 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:37:16.312070 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.65:55075 (local address 127.20.171.126:35453)
0807 10:37:16.312359 (+ 289us) server_negotiation.cc:206] Beginning negotiation
0807 10:37:16.312368 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 10:37:16.312885 (+ 517us) server_negotiation.cc:407] Connection header received
0807 10:37:16.313048 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:37:16.313052 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:37:16.313128 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:37:16.313221 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:37:16.313887 (+ 666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:16.314567 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:16.315661 (+ 1094us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:16.316067 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:16.316155 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:16.320290 (+ 4135us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.171.65:55075: BlockingRecv error: recv got EOF from 127.20.171.65:55075 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
Aug 07 10:37:16 dist-test-slave-0b58 krb5kdc[29614](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.171.66@KRBTEST.COM for oryx/127.20.171.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 10:37:16 dist-test-slave-0b58 krb5kdc[29614](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.171.66@KRBTEST.COM for oryx/127.20.171.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 10:37:16.779742 30657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:37:16.771799 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:35453 (local address 127.20.171.66:33297)
0807 10:37:16.772362 (+ 563us) negotiation.cc:107] Waiting for socket to connect
0807 10:37:16.772379 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 10:37:16.772492 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:37:16.772796 (+ 304us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:37:16.772800 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:37:16.773249 (+ 449us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:37:16.773403 (+ 154us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:16.773411 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:16.774390 (+ 979us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:16.774394 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:16.775257 (+ 863us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:16.775267 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:16.775934 (+ 667us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:16.775939 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:16.776061 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:16.776742 (+ 681us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:37:16.776759 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:37:16.779531 (+ 2772us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.171.126:35453: Server oryx/127.20.171.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":406,"thread_start_us":281,"threads_started":1}
W20260807 10:37:16.779934 30369 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:37:16.771837 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.66:33297 (local address 127.20.171.126:35453)
0807 10:37:16.772056 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0807 10:37:16.772065 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 10:37:16.772461 (+ 396us) server_negotiation.cc:407] Connection header received
0807 10:37:16.772590 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:37:16.772593 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:37:16.772653 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:37:16.772733 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:37:16.773517 (+ 784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:16.774257 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:16.775374 (+ 1117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:16.775787 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:16.775881 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:16.779711 (+ 3830us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.171.66:33297: BlockingRecv error: recv got EOF from 127.20.171.66:33297 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
Aug 07 10:37:17 dist-test-slave-0b58 krb5kdc[29614](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.171.67@KRBTEST.COM for oryx/127.20.171.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 10:37:17 dist-test-slave-0b58 krb5kdc[29614](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.171.67@KRBTEST.COM for oryx/127.20.171.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 10:37:17.237424 30658 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:37:17.226223 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:35453 (local address 127.20.171.67:49905)
0807 10:37:17.226715 (+ 492us) negotiation.cc:107] Waiting for socket to connect
0807 10:37:17.226732 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 10:37:17.226844 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:37:17.227128 (+ 284us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:37:17.227131 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:37:17.227507 (+ 376us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:37:17.227670 (+ 163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:17.227679 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:17.228693 (+ 1014us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:17.228697 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:17.229599 (+ 902us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:17.229611 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:17.230293 (+ 682us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:17.230297 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:17.230425 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:17.233889 (+ 3464us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:37:17.233907 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:37:17.237076 (+ 3169us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.171.126:35453: Server oryx/127.20.171.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":387,"thread_start_us":268,"threads_started":1}
W20260807 10:37:17.237769 30369 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:37:17.226296 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.67:49905 (local address 127.20.171.126:35453)
0807 10:37:17.226547 (+ 251us) server_negotiation.cc:206] Beginning negotiation
0807 10:37:17.226554 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:37:17.226812 (+ 258us) server_negotiation.cc:407] Connection header received
0807 10:37:17.226944 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:37:17.226947 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:37:17.227009 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:37:17.227087 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:37:17.227794 (+ 707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:17.228558 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:17.229735 (+ 1177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:17.230153 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:17.230248 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:17.237327 (+ 7079us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.171.67:49905: BlockingRecv error: recv got EOF from 127.20.171.67:49905 (error 108)
Metrics: {"server-negotiator.queue_time_us":86}
Aug 07 10:37:17 dist-test-slave-0b58 krb5kdc[29614](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.171.65@KRBTEST.COM for oryx/127.20.171.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 10:37:17 dist-test-slave-0b58 krb5kdc[29614](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.171.65@KRBTEST.COM for oryx/127.20.171.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 10:37:17.329641 30659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:37:17.321573 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:35453 (local address 127.20.171.65:47287)
0807 10:37:17.322203 (+ 630us) negotiation.cc:107] Waiting for socket to connect
0807 10:37:17.322219 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 10:37:17.322336 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:37:17.322630 (+ 294us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:37:17.322633 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:37:17.323045 (+ 412us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:37:17.323223 (+ 178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:17.323232 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:17.324178 (+ 946us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:17.324182 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:17.325311 (+ 1129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:17.325324 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:17.325979 (+ 655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:17.325983 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:17.326092 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:17.326635 (+ 543us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:37:17.326652 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:37:17.329392 (+ 2740us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.171.126:35453: Server oryx/127.20.171.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":523,"thread_start_us":269,"threads_started":1}
W20260807 10:37:17.329923 30369 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:37:17.321625 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.65:47287 (local address 127.20.171.126:35453)
0807 10:37:17.321854 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0807 10:37:17.321863 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 10:37:17.322298 (+ 435us) server_negotiation.cc:407] Connection header received
0807 10:37:17.322428 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:37:17.322432 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:37:17.322494 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:37:17.322574 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:37:17.323345 (+ 771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:17.324058 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:17.325435 (+ 1377us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:17.325852 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:17.325954 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:17.329576 (+ 3622us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.171.65:47287: BlockingRecv error: recv got EOF from 127.20.171.65:47287 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
Aug 07 10:37:17 dist-test-slave-0b58 krb5kdc[29614](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.171.66@KRBTEST.COM for oryx/127.20.171.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 10:37:17 dist-test-slave-0b58 krb5kdc[29614](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.171.66@KRBTEST.COM for oryx/127.20.171.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 10:37:17.789669 30660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:37:17.780807 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:35453 (local address 127.20.171.66:33831)
0807 10:37:17.781419 (+ 612us) negotiation.cc:107] Waiting for socket to connect
0807 10:37:17.781435 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 10:37:17.781552 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:37:17.781849 (+ 297us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:37:17.781853 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:37:17.782315 (+ 462us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:37:17.782503 (+ 188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:17.782512 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:17.783499 (+ 987us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:17.783503 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:17.784819 (+ 1316us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:17.784839 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:17.785817 (+ 978us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:17.785822 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:17.785938 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:17.786517 (+ 579us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:37:17.786535 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:37:17.789427 (+ 2892us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.171.126:35453: Server oryx/127.20.171.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":491,"thread_start_us":271,"threads_started":1}
W20260807 10:37:17.789924 30369 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:37:17.780856 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.66:33831 (local address 127.20.171.126:35453)
0807 10:37:17.781092 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0807 10:37:17.781096 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 10:37:17.781512 (+ 416us) server_negotiation.cc:407] Connection header received
0807 10:37:17.781649 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:37:17.781652 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:37:17.781721 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:37:17.781801 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:37:17.782649 (+ 848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:17.783380 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:17.785003 (+ 1623us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:17.785651 (+ 648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:17.785753 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:17.789632 (+ 3879us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.171.66:33831: BlockingRecv error: recv got EOF from 127.20.171.66:33831 (error 108)
Metrics: {"server-negotiator.queue_time_us":111}
Aug 07 10:37:18 dist-test-slave-0b58 krb5kdc[29614](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.171.67@KRBTEST.COM for oryx/127.20.171.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 10:37:18 dist-test-slave-0b58 krb5kdc[29614](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.171.67@KRBTEST.COM for oryx/127.20.171.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 10:37:18.247153 30661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:37:18.238488 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:35453 (local address 127.20.171.67:57949)
0807 10:37:18.239179 (+ 691us) negotiation.cc:107] Waiting for socket to connect
0807 10:37:18.239203 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0807 10:37:18.239379 (+ 176us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:37:18.239728 (+ 349us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:37:18.239733 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:37:18.240179 (+ 446us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:37:18.240473 (+ 294us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:18.240484 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:18.241519 (+ 1035us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:18.241525 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:18.242465 (+ 940us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:18.242477 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:18.243234 (+ 757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:18.243240 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:18.243416 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:18.243970 (+ 554us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:37:18.243986 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:37:18.246774 (+ 2788us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.171.126:35453: Server oryx/127.20.171.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":576,"thread_start_us":293,"threads_started":1}
W20260807 10:37:18.247258 30369 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:37:18.238580 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.67:57949 (local address 127.20.171.126:35453)
0807 10:37:18.238821 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0807 10:37:18.238830 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 10:37:18.239290 (+ 460us) server_negotiation.cc:407] Connection header received
0807 10:37:18.239501 (+ 211us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:37:18.239507 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:37:18.239583 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:37:18.239697 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:37:18.240620 (+ 923us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:18.241374 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:18.242610 (+ 1236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:18.243068 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:18.243206 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:18.247009 (+ 3803us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.171.67:57949: BlockingRecv error: recv got EOF from 127.20.171.67:57949 (error 108)
Metrics: {"server-negotiator.queue_time_us":71}
Aug 07 10:37:18 dist-test-slave-0b58 krb5kdc[29614](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.171.65@KRBTEST.COM for oryx/127.20.171.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 10:37:18 dist-test-slave-0b58 krb5kdc[29614](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.171.65@KRBTEST.COM for oryx/127.20.171.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 10:37:18.339359 30662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:37:18.330583 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:35453 (local address 127.20.171.65:38041)
0807 10:37:18.331187 (+ 604us) negotiation.cc:107] Waiting for socket to connect
0807 10:37:18.331203 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 10:37:18.331368 (+ 165us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:37:18.331720 (+ 352us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:37:18.331726 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:37:18.332180 (+ 454us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:37:18.332359 (+ 179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:18.332368 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:18.333442 (+ 1074us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:18.333448 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:18.334404 (+ 956us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:18.334415 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:18.335158 (+ 743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:18.335164 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:18.335350 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:18.336048 (+ 698us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:37:18.336065 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:37:18.339106 (+ 3041us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.171.126:35453: Server oryx/127.20.171.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":451,"thread_start_us":324,"threads_started":1}
W20260807 10:37:18.339560 30369 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:37:18.330844 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.65:38041 (local address 127.20.171.126:35453)
0807 10:37:18.331106 (+ 262us) server_negotiation.cc:206] Beginning negotiation
0807 10:37:18.331113 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:37:18.331294 (+ 181us) server_negotiation.cc:407] Connection header received
0807 10:37:18.331498 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:37:18.331510 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:37:18.331573 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:37:18.331679 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:37:18.332511 (+ 832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:18.333287 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:18.334548 (+ 1261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:18.334976 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:18.335112 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:18.339315 (+ 4203us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.171.65:38041: BlockingRecv error: recv got EOF from 127.20.171.65:38041 (error 108)
Metrics: {"server-negotiator.queue_time_us":101}
Aug 07 10:37:18 dist-test-slave-0b58 krb5kdc[29614](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.171.66@KRBTEST.COM for oryx/127.20.171.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 10:37:18 dist-test-slave-0b58 krb5kdc[29614](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.171.66@KRBTEST.COM for oryx/127.20.171.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 10:37:18.799629 30663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:37:18.790616 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:35453 (local address 127.20.171.66:49869)
0807 10:37:18.791162 (+ 546us) negotiation.cc:107] Waiting for socket to connect
0807 10:37:18.791178 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 10:37:18.791343 (+ 165us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:37:18.791698 (+ 355us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:37:18.791704 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:37:18.792139 (+ 435us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:37:18.792378 (+ 239us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:18.792390 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:18.793588 (+ 1198us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:18.793594 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:18.794510 (+ 916us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:18.794521 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:18.795415 (+ 894us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:18.795422 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:18.795588 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:18.796326 (+ 738us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:37:18.796343 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:37:18.799396 (+ 3053us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.171.126:35453: Server oryx/127.20.171.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":427,"thread_start_us":293,"threads_started":1}
W20260807 10:37:18.799804 30369 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:37:18.790717 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.66:49869 (local address 127.20.171.126:35453)
0807 10:37:18.790965 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0807 10:37:18.790973 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 10:37:18.791272 (+ 299us) server_negotiation.cc:407] Connection header received
0807 10:37:18.791489 (+ 217us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:37:18.791493 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:37:18.791556 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:37:18.791658 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:37:18.792520 (+ 862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:18.793429 (+ 909us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:18.794652 (+ 1223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:18.795230 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:18.795382 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:18.799592 (+ 4210us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.171.66:49869: BlockingRecv error: recv got EOF from 127.20.171.66:49869 (error 108)
Metrics: {"server-negotiator.queue_time_us":93}
Aug 07 10:37:19 dist-test-slave-0b58 krb5kdc[29614](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.171.67@KRBTEST.COM for oryx/127.20.171.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 10:37:19 dist-test-slave-0b58 krb5kdc[29614](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.171.67@KRBTEST.COM for oryx/127.20.171.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 10:37:19.256470 30664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:37:19.248257 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:35453 (local address 127.20.171.67:48257)
0807 10:37:19.248845 (+ 588us) negotiation.cc:107] Waiting for socket to connect
0807 10:37:19.248861 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 10:37:19.248981 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:37:19.249283 (+ 302us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:37:19.249286 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:37:19.249678 (+ 392us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:37:19.249825 (+ 147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:19.249833 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:19.250792 (+ 959us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:19.250795 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:19.251740 (+ 945us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:19.251750 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:19.252615 (+ 865us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:19.252623 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:19.252788 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:19.253412 (+ 624us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:37:19.253429 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:37:19.256167 (+ 2738us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.171.126:35453: Server oryx/127.20.171.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":451,"thread_start_us":306,"threads_started":1}
W20260807 10:37:19.256659 30369 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:37:19.248376 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.67:48257 (local address 127.20.171.126:35453)
0807 10:37:19.248536 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0807 10:37:19.248540 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 10:37:19.248928 (+ 388us) server_negotiation.cc:407] Connection header received
0807 10:37:19.249067 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:37:19.249070 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:37:19.249128 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:37:19.249222 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:37:19.249968 (+ 746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:19.250667 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:19.251857 (+ 1190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:19.252400 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:19.252552 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:19.256423 (+ 3871us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.171.67:48257: BlockingRecv error: recv got EOF from 127.20.171.67:48257 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
Aug 07 10:37:19 dist-test-slave-0b58 krb5kdc[29614](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.171.65@KRBTEST.COM for oryx/127.20.171.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 10:37:19 dist-test-slave-0b58 krb5kdc[29614](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.171.65@KRBTEST.COM for oryx/127.20.171.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 10:37:19.349052 30665 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:37:19.340402 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:35453 (local address 127.20.171.65:35285)
0807 10:37:19.340950 (+ 548us) negotiation.cc:107] Waiting for socket to connect
0807 10:37:19.340966 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 10:37:19.341082 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:37:19.341392 (+ 310us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:37:19.341395 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:37:19.341804 (+ 409us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:37:19.341960 (+ 156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:19.341968 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:19.342926 (+ 958us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:19.342930 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:19.343873 (+ 943us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:19.343884 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:19.344579 (+ 695us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:19.344583 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:19.344712 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:19.345296 (+ 584us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:37:19.345312 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:37:19.348672 (+ 3360us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.171.126:35453: Server oryx/127.20.171.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":436,"thread_start_us":281,"threads_started":1}
W20260807 10:37:19.349138 30369 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:37:19.340467 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.65:35285 (local address 127.20.171.126:35453)
0807 10:37:19.340652 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0807 10:37:19.340656 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 10:37:19.341034 (+ 378us) server_negotiation.cc:407] Connection header received
0807 10:37:19.341190 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:37:19.341193 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:37:19.341250 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:37:19.341344 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:37:19.342102 (+ 758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:19.342795 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:19.343994 (+ 1199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:19.344450 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:19.344542 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:19.348893 (+ 4351us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.171.65:35285: BlockingRecv error: recv got EOF from 127.20.171.65:35285 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
Aug 07 10:37:19 dist-test-slave-0b58 krb5kdc[29614](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.171.66@KRBTEST.COM for oryx/127.20.171.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 10:37:19 dist-test-slave-0b58 krb5kdc[29614](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.171.66@KRBTEST.COM for oryx/127.20.171.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 10:37:19.809594 30666 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:37:19.800599 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:35453 (local address 127.20.171.66:40129)
0807 10:37:19.801102 (+ 503us) negotiation.cc:107] Waiting for socket to connect
0807 10:37:19.801119 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 10:37:19.801263 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:37:19.801578 (+ 315us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:37:19.801581 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:37:19.801963 (+ 382us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:37:19.802125 (+ 162us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:19.802133 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:19.803193 (+ 1060us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:19.803197 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:19.804230 (+ 1033us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:19.804241 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:19.804998 (+ 757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:19.805003 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:19.805128 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:19.805717 (+ 589us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:37:19.805734 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:37:19.809227 (+ 3493us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.171.126:35453: Server oryx/127.20.171.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":406,"thread_start_us":272,"threads_started":1}
W20260807 10:37:19.809679 30369 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:37:19.800749 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.66:40129 (local address 127.20.171.126:35453)
0807 10:37:19.800999 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0807 10:37:19.801005 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:37:19.801218 (+ 213us) server_negotiation.cc:407] Connection header received
0807 10:37:19.801370 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:37:19.801374 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:37:19.801438 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:37:19.801519 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:37:19.802291 (+ 772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:19.803043 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:19.804399 (+ 1356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:19.804854 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:19.804956 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:19.809425 (+ 4469us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.171.66:40129: BlockingRecv error: recv got EOF from 127.20.171.66:40129 (error 108)
Metrics: {"server-negotiator.queue_time_us":108}
Aug 07 10:37:20 dist-test-slave-0b58 krb5kdc[29614](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.171.67@KRBTEST.COM for oryx/127.20.171.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 10:37:20 dist-test-slave-0b58 krb5kdc[29614](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.171.67@KRBTEST.COM for oryx/127.20.171.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 10:37:20.266984 30667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:37:20.257587 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:35453 (local address 127.20.171.67:34803)
0807 10:37:20.258381 (+ 794us) negotiation.cc:107] Waiting for socket to connect
0807 10:37:20.258398 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 10:37:20.258561 (+ 163us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:37:20.258981 (+ 420us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:37:20.258986 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:37:20.259442 (+ 456us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:37:20.259655 (+ 213us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:20.259664 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:20.261058 (+ 1394us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:20.261066 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:20.262023 (+ 957us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:20.262034 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:20.262761 (+ 727us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:20.262767 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:20.262952 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:20.263534 (+ 582us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:37:20.263550 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:37:20.266611 (+ 3061us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.171.126:35453: Server oryx/127.20.171.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":673,"thread_start_us":476,"threads_started":1}
W20260807 10:37:20.267082 30369 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:37:20.257679 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.67:34803 (local address 127.20.171.126:35453)
0807 10:37:20.257915 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0807 10:37:20.257920 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:37:20.258489 (+ 569us) server_negotiation.cc:407] Connection header received
0807 10:37:20.258714 (+ 225us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:37:20.258723 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:37:20.258832 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:37:20.258940 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:37:20.259815 (+ 875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:20.260826 (+ 1011us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:20.262185 (+ 1359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:20.262595 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:20.262733 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:20.266846 (+ 4113us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.171.67:34803: BlockingRecv error: recv got EOF from 127.20.171.67:34803 (error 108)
Metrics: {"server-negotiator.queue_time_us":64}
Aug 07 10:37:20 dist-test-slave-0b58 krb5kdc[29614](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.171.65@KRBTEST.COM for oryx/127.20.171.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 10:37:20 dist-test-slave-0b58 krb5kdc[29614](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.171.65@KRBTEST.COM for oryx/127.20.171.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 10:37:20.358186 30668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:37:20.350182 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:35453 (local address 127.20.171.65:49145)
0807 10:37:20.350668 (+ 486us) negotiation.cc:107] Waiting for socket to connect
0807 10:37:20.350684 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 10:37:20.350797 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:37:20.351081 (+ 284us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:37:20.351084 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:37:20.351486 (+ 402us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:37:20.351631 (+ 145us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:20.351639 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:20.352700 (+ 1061us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:20.352704 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:20.353592 (+ 888us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:20.353603 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:20.354478 (+ 875us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:20.354485 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:20.354639 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:20.355255 (+ 616us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:37:20.355272 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:37:20.357966 (+ 2694us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.171.126:35453: Server oryx/127.20.171.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":387,"thread_start_us":282,"threads_started":1}
W20260807 10:37:20.358587 30369 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:37:20.350255 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.65:49145 (local address 127.20.171.126:35453)
0807 10:37:20.350478 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0807 10:37:20.350486 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 10:37:20.350770 (+ 284us) server_negotiation.cc:407] Connection header received
0807 10:37:20.350899 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:37:20.350903 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:37:20.350964 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:37:20.351043 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:37:20.351755 (+ 712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:20.352589 (+ 834us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:20.353732 (+ 1143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:20.354295 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:20.354427 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:20.358158 (+ 3731us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.171.65:49145: BlockingRecv error: recv got EOF from 127.20.171.65:49145 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
Aug 07 10:37:20 dist-test-slave-0b58 krb5kdc[29614](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.171.66@KRBTEST.COM for oryx/127.20.171.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 10:37:20 dist-test-slave-0b58 krb5kdc[29614](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.171.66@KRBTEST.COM for oryx/127.20.171.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 10:37:20.819644 30669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:37:20.810712 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:35453 (local address 127.20.171.66:56067)
0807 10:37:20.811255 (+ 543us) negotiation.cc:107] Waiting for socket to connect
0807 10:37:20.811271 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 10:37:20.811386 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:37:20.811728 (+ 342us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:37:20.811731 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:37:20.812099 (+ 368us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:37:20.812331 (+ 232us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:20.812349 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:20.813640 (+ 1291us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:20.813646 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:20.814987 (+ 1341us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:20.815000 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:20.815695 (+ 695us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:20.815699 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:20.815816 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:20.816615 (+ 799us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:37:20.816632 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:37:20.819399 (+ 2767us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.171.126:35453: Server oryx/127.20.171.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":401,"thread_start_us":285,"threads_started":1}
W20260807 10:37:20.819856 30369 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:37:20.810764 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.66:56067 (local address 127.20.171.126:35453)
0807 10:37:20.811003 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0807 10:37:20.811012 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 10:37:20.811361 (+ 349us) server_negotiation.cc:407] Connection header received
0807 10:37:20.811503 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:37:20.811507 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:37:20.811591 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:37:20.811686 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:37:20.812479 (+ 793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:20.813470 (+ 991us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:20.815117 (+ 1647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:20.815559 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:20.815656 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:20.819618 (+ 3962us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.171.66:56067: BlockingRecv error: recv got EOF from 127.20.171.66:56067 (error 108)
Metrics: {"server-negotiator.queue_time_us":71}
Aug 07 10:37:21 dist-test-slave-0b58 krb5kdc[29614](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.171.67@KRBTEST.COM for oryx/127.20.171.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 10:37:21 dist-test-slave-0b58 krb5kdc[29614](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.171.67@KRBTEST.COM for oryx/127.20.171.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 10:37:21.276795 30670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:37:21.268171 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:35453 (local address 127.20.171.67:49329)
0807 10:37:21.268824 (+ 653us) negotiation.cc:107] Waiting for socket to connect
0807 10:37:21.268854 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0807 10:37:21.268998 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:37:21.269352 (+ 354us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:37:21.269357 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:37:21.269869 (+ 512us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:37:21.270031 (+ 162us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:21.270039 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:21.271023 (+ 984us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:21.271029 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:21.271887 (+ 858us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:21.271898 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:21.272657 (+ 759us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:21.272662 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:21.272874 (+ 212us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:21.273494 (+ 620us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:37:21.273511 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:37:21.276466 (+ 2955us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.171.126:35453: Server oryx/127.20.171.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":496,"spinlock_wait_cycles":66944,"thread_start_us":403,"threads_started":1}
W20260807 10:37:21.276929 30369 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:37:21.268398 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.67:49329 (local address 127.20.171.126:35453)
0807 10:37:21.268635 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0807 10:37:21.268642 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:37:21.268940 (+ 298us) server_negotiation.cc:407] Connection header received
0807 10:37:21.269133 (+ 193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:37:21.269150 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:37:21.269219 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:37:21.269316 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:37:21.270178 (+ 862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:21.270889 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:21.272022 (+ 1133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:21.272503 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:21.272628 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:21.276666 (+ 4038us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.171.67:49329: BlockingRecv error: recv got EOF from 127.20.171.67:49329 (error 108)
Metrics: {"server-negotiator.queue_time_us":96}
Aug 07 10:37:21 dist-test-slave-0b58 krb5kdc[29614](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.171.65@KRBTEST.COM for oryx/127.20.171.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 10:37:21 dist-test-slave-0b58 krb5kdc[29614](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.171.65@KRBTEST.COM for oryx/127.20.171.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 10:37:21.367311 30671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:37:21.359114 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:35453 (local address 127.20.171.65:60421)
0807 10:37:21.359652 (+ 538us) negotiation.cc:107] Waiting for socket to connect
0807 10:37:21.359669 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 10:37:21.359797 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:37:21.360087 (+ 290us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:37:21.360090 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:37:21.360531 (+ 441us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:37:21.360719 (+ 188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:21.360729 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:21.361663 (+ 934us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:21.361666 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:21.362572 (+ 906us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:21.362584 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:21.363360 (+ 776us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:21.363366 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:21.363556 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:21.364227 (+ 671us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:37:21.364262 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:37:21.367062 (+ 2800us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.171.126:35453: Server oryx/127.20.171.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":408,"thread_start_us":278,"threads_started":1}
W20260807 10:37:21.367475 30369 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:37:21.359244 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.65:60421 (local address 127.20.171.126:35453)
0807 10:37:21.359435 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0807 10:37:21.359439 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 10:37:21.359739 (+ 300us) server_negotiation.cc:407] Connection header received
0807 10:37:21.359894 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:37:21.359897 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:37:21.359956 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:37:21.360036 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:37:21.360842 (+ 806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:21.361545 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:21.362690 (+ 1145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:21.363194 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:21.363311 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:21.367253 (+ 3942us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.171.65:60421: BlockingRecv error: recv got EOF from 127.20.171.65:60421 (error 108)
Metrics: {"server-negotiator.queue_time_us":69}
Aug 07 10:37:21 dist-test-slave-0b58 krb5kdc[29614](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.171.66@KRBTEST.COM for oryx/127.20.171.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 10:37:21 dist-test-slave-0b58 krb5kdc[29614](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.171.66@KRBTEST.COM for oryx/127.20.171.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 10:37:21.828562 30672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:37:21.820544 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:35453 (local address 127.20.171.66:57373)
0807 10:37:21.821009 (+ 465us) negotiation.cc:107] Waiting for socket to connect
0807 10:37:21.821024 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 10:37:21.821171 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:37:21.821500 (+ 329us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:37:21.821503 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:37:21.821888 (+ 385us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:37:21.822049 (+ 161us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:21.822057 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:21.822958 (+ 901us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:21.822961 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:21.823789 (+ 828us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:21.823801 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:21.824750 (+ 949us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:21.824755 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:21.824933 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:21.825575 (+ 642us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:37:21.825592 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:37:21.828322 (+ 2730us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.171.126:35453: Server oryx/127.20.171.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":375,"thread_start_us":267,"threads_started":1}
W20260807 10:37:21.828737 30369 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:37:21.820636 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.66:57373 (local address 127.20.171.126:35453)
0807 10:37:21.820871 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0807 10:37:21.820877 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:37:21.821119 (+ 242us) server_negotiation.cc:407] Connection header received
0807 10:37:21.821285 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:37:21.821289 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:37:21.821381 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:37:21.821481 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:37:21.822169 (+ 688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:21.822835 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:21.823917 (+ 1082us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:21.824550 (+ 633us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:21.824705 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:21.828482 (+ 3777us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.171.66:57373: BlockingRecv error: recv got EOF from 127.20.171.66:57373 (error 108)
Metrics: {"server-negotiator.queue_time_us":84}
Aug 07 10:37:22 dist-test-slave-0b58 krb5kdc[29614](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.171.67@KRBTEST.COM for oryx/127.20.171.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 10:37:22 dist-test-slave-0b58 krb5kdc[29614](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.171.67@KRBTEST.COM for oryx/127.20.171.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 10:37:22.289131 30673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:37:22.277763 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:35453 (local address 127.20.171.67:52387)
0807 10:37:22.278335 (+ 572us) negotiation.cc:107] Waiting for socket to connect
0807 10:37:22.278350 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 10:37:22.278458 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:37:22.278906 (+ 448us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:37:22.278910 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:37:22.279337 (+ 427us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:37:22.279575 (+ 238us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:22.279586 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:22.280759 (+ 1173us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:22.280764 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:22.281648 (+ 884us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:22.281659 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:22.282239 (+ 580us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:22.282243 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:22.282368 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:22.285846 (+ 3478us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:37:22.285862 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:37:22.288780 (+ 2918us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.171.126:35453: Server oryx/127.20.171.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":484,"thread_start_us":326,"threads_started":1}
W20260807 10:37:22.289260 30369 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:37:22.277852 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.67:52387 (local address 127.20.171.126:35453)
0807 10:37:22.278155 (+ 303us) server_negotiation.cc:206] Beginning negotiation
0807 10:37:22.278161 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:37:22.278430 (+ 269us) server_negotiation.cc:407] Connection header received
0807 10:37:22.278555 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:37:22.278558 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:37:22.278618 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:37:22.278716 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:37:22.279723 (+ 1007us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:22.280558 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:22.281774 (+ 1216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:22.282118 (+ 344us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:22.282211 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:22.288999 (+ 6788us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.171.67:52387: BlockingRecv error: recv got EOF from 127.20.171.67:52387 (error 108)
Metrics: {"server-negotiator.queue_time_us":89}
Aug 07 10:37:22 dist-test-slave-0b58 krb5kdc[29614](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.171.65@KRBTEST.COM for oryx/127.20.171.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 10:37:22 dist-test-slave-0b58 krb5kdc[29614](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.171.65@KRBTEST.COM for oryx/127.20.171.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 10:37:22.376446 30674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:37:22.368207 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:35453 (local address 127.20.171.65:44629)
0807 10:37:22.368705 (+ 498us) negotiation.cc:107] Waiting for socket to connect
0807 10:37:22.368721 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 10:37:22.368828 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:37:22.369113 (+ 285us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:37:22.369116 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:37:22.369513 (+ 397us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:37:22.369653 (+ 140us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:22.369661 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:22.370754 (+ 1093us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:22.370757 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:22.371631 (+ 874us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:22.371642 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:22.372374 (+ 732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:22.372380 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:22.372575 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:22.373239 (+ 664us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:37:22.373261 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:37:22.376113 (+ 2852us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.171.126:35453: Server oryx/127.20.171.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":402,"thread_start_us":311,"threads_started":1}
W20260807 10:37:22.376766 30369 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:37:22.368337 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.65:44629 (local address 127.20.171.126:35453)
0807 10:37:22.368551 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0807 10:37:22.368557 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:37:22.368804 (+ 247us) server_negotiation.cc:407] Connection header received
0807 10:37:22.368923 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:37:22.368926 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:37:22.368986 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:37:22.369063 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:37:22.369791 (+ 728us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:22.370630 (+ 839us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:22.371746 (+ 1116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:22.372171 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:22.372364 (+ 193us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:22.376369 (+ 4005us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.171.65:44629: BlockingRecv error: recv got EOF from 127.20.171.65:44629 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
Aug 07 10:37:22 dist-test-slave-0b58 krb5kdc[29614](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.171.66@KRBTEST.COM for oryx/127.20.171.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 10:37:22 dist-test-slave-0b58 krb5kdc[29614](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.171.66@KRBTEST.COM for oryx/127.20.171.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 10:37:22.837790 30675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:37:22.829470 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:35453 (local address 127.20.171.66:55799)
0807 10:37:22.829982 (+ 512us) negotiation.cc:107] Waiting for socket to connect
0807 10:37:22.829997 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 10:37:22.830163 (+ 166us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:37:22.830645 (+ 482us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:37:22.830661 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:37:22.831220 (+ 559us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:37:22.831461 (+ 241us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:22.831474 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:22.832625 (+ 1151us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:22.832629 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:22.833510 (+ 881us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:22.833521 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:22.834119 (+ 598us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:22.834124 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:22.834249 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:22.834805 (+ 556us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:37:22.834821 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:37:22.837560 (+ 2739us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.171.126:35453: Server oryx/127.20.171.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":424,"thread_start_us":309,"threads_started":1}
W20260807 10:37:22.837945 30369 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:37:22.829550 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.66:55799 (local address 127.20.171.126:35453)
0807 10:37:22.829760 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0807 10:37:22.829768 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 10:37:22.830092 (+ 324us) server_negotiation.cc:407] Connection header received
0807 10:37:22.830333 (+ 241us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:37:22.830339 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:37:22.830425 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:37:22.830534 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:37:22.831606 (+ 1072us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:22.832489 (+ 883us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:22.833625 (+ 1136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:22.834005 (+ 380us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:22.834089 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:22.837743 (+ 3654us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.171.66:55799: BlockingRecv error: recv got EOF from 127.20.171.66:55799 (error 108)
Metrics: {"server-negotiator.queue_time_us":72}
Aug 07 10:37:23 dist-test-slave-0b58 krb5kdc[29614](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.171.67@KRBTEST.COM for oryx/127.20.171.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 10:37:23 dist-test-slave-0b58 krb5kdc[29614](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.171.67@KRBTEST.COM for oryx/127.20.171.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 10:37:23.298610 30676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:37:23.289988 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:35453 (local address 127.20.171.67:53331)
0807 10:37:23.290443 (+ 455us) negotiation.cc:107] Waiting for socket to connect
0807 10:37:23.290458 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 10:37:23.290586 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:37:23.290872 (+ 286us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:37:23.290875 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:37:23.291283 (+ 408us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:37:23.291433 (+ 150us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:23.291441 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:23.292640 (+ 1199us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:23.292645 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:23.293607 (+ 962us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:23.293632 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:23.294331 (+ 699us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:23.294336 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:23.294577 (+ 241us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:23.295253 (+ 676us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:37:23.295271 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:37:23.298374 (+ 3103us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.171.126:35453: Server oryx/127.20.171.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":365,"thread_start_us":272,"threads_started":1}
W20260807 10:37:23.298906 30369 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:37:23.290056 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.67:53331 (local address 127.20.171.126:35453)
0807 10:37:23.290301 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0807 10:37:23.290307 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:37:23.290532 (+ 225us) server_negotiation.cc:407] Connection header received
0807 10:37:23.290684 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:37:23.290693 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:37:23.290753 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:37:23.290839 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:37:23.291582 (+ 743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:23.292496 (+ 914us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:23.293770 (+ 1274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:23.294154 (+ 384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:23.294321 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:23.298614 (+ 4293us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.171.67:53331: BlockingRecv error: recv got EOF from 127.20.171.67:53331 (error 108)
Metrics: {"server-negotiator.queue_time_us":73}
Aug 07 10:37:23 dist-test-slave-0b58 krb5kdc[29614](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.171.65@KRBTEST.COM for oryx/127.20.171.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 10:37:23 dist-test-slave-0b58 krb5kdc[29614](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.171.65@KRBTEST.COM for oryx/127.20.171.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 10:37:23.385429 30677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:37:23.377337 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:35453 (local address 127.20.171.65:40055)
0807 10:37:23.377841 (+ 504us) negotiation.cc:107] Waiting for socket to connect
0807 10:37:23.377856 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 10:37:23.378030 (+ 174us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:37:23.378358 (+ 328us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:37:23.378383 (+ 25us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:37:23.378796 (+ 413us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:37:23.378948 (+ 152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:23.378958 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:23.379973 (+ 1015us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:23.379978 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:23.380908 (+ 930us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:23.380920 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:23.381619 (+ 699us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:23.381625 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:23.381774 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:23.382356 (+ 582us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:37:23.382371 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:37:23.385053 (+ 2682us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.171.126:35453: Server oryx/127.20.171.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":408,"thread_start_us":250,"threads_started":1}
W20260807 10:37:23.385478 30369 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:37:23.377393 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.65:40055 (local address 127.20.171.126:35453)
0807 10:37:23.377600 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0807 10:37:23.377607 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:37:23.377954 (+ 347us) server_negotiation.cc:407] Connection header received
0807 10:37:23.378158 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:37:23.378168 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:37:23.378228 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:37:23.378324 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:37:23.379106 (+ 782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:23.379801 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:23.381043 (+ 1242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:23.381450 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:23.381576 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:23.385249 (+ 3673us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.171.65:40055: BlockingRecv error: recv got EOF from 127.20.171.65:40055 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
Aug 07 10:37:23 dist-test-slave-0b58 krb5kdc[29614](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.171.66@KRBTEST.COM for oryx/127.20.171.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 10:37:23 dist-test-slave-0b58 krb5kdc[29614](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.171.66@KRBTEST.COM for oryx/127.20.171.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 10:37:23.846480 30678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:37:23.838853 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:35453 (local address 127.20.171.66:47931)
0807 10:37:23.839413 (+ 560us) negotiation.cc:107] Waiting for socket to connect
0807 10:37:23.839429 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 10:37:23.839536 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:37:23.839842 (+ 306us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:37:23.839845 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:37:23.840245 (+ 400us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:37:23.840421 (+ 176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:23.840430 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:23.841374 (+ 944us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:23.841378 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:23.842237 (+ 859us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:23.842248 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:23.842856 (+ 608us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:23.842860 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:23.842967 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:23.843525 (+ 558us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:37:23.843541 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:37:23.846253 (+ 2712us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.171.126:35453: Server oryx/127.20.171.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":461,"thread_start_us":297,"threads_started":1}
W20260807 10:37:23.846693 30369 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:37:23.838998 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.66:47931 (local address 127.20.171.126:35453)
0807 10:37:23.839156 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0807 10:37:23.839160 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 10:37:23.839499 (+ 339us) server_negotiation.cc:407] Connection header received
0807 10:37:23.839629 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:37:23.839638 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:37:23.839720 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:37:23.839797 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:37:23.840541 (+ 744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:23.841249 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:23.842345 (+ 1096us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:23.842707 (+ 362us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:23.842789 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:23.846428 (+ 3639us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.171.66:47931: BlockingRecv error: recv got EOF from 127.20.171.66:47931 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
Aug 07 10:37:24 dist-test-slave-0b58 krb5kdc[29614](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.171.67@KRBTEST.COM for oryx/127.20.171.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 10:37:24 dist-test-slave-0b58 krb5kdc[29614](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.171.67@KRBTEST.COM for oryx/127.20.171.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 10:37:24.307260 30679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:37:24.299490 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:35453 (local address 127.20.171.67:48223)
0807 10:37:24.299936 (+ 446us) negotiation.cc:107] Waiting for socket to connect
0807 10:37:24.299950 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 10:37:24.300087 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:37:24.300420 (+ 333us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:37:24.300427 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:37:24.300821 (+ 394us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:37:24.300964 (+ 143us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:24.300972 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:24.301924 (+ 952us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:24.301929 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:24.302787 (+ 858us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:24.302797 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:24.303479 (+ 682us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:24.303484 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:24.303648 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:24.304166 (+ 518us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:37:24.304182 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:37:24.306963 (+ 2781us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.171.126:35453: Server oryx/127.20.171.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":362,"thread_start_us":227,"threads_started":1}
W20260807 10:37:24.307488 30369 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:37:24.299503 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.67:48223 (local address 127.20.171.126:35453)
0807 10:37:24.299690 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0807 10:37:24.299698 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 10:37:24.300022 (+ 324us) server_negotiation.cc:407] Connection header received
0807 10:37:24.300193 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:37:24.300198 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:37:24.300285 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:37:24.300379 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:37:24.301090 (+ 711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:24.301787 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:24.302924 (+ 1137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:24.303306 (+ 382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:24.303441 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:24.307213 (+ 3772us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.171.67:48223: BlockingRecv error: recv got EOF from 127.20.171.67:48223 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
Aug 07 10:37:24 dist-test-slave-0b58 krb5kdc[29614](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.171.65@KRBTEST.COM for oryx/127.20.171.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 10:37:24 dist-test-slave-0b58 krb5kdc[29614](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.171.65@KRBTEST.COM for oryx/127.20.171.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 10:37:24.394762 30680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:37:24.386429 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:35453 (local address 127.20.171.65:55349)
0807 10:37:24.387034 (+ 605us) negotiation.cc:107] Waiting for socket to connect
0807 10:37:24.387049 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 10:37:24.387167 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:37:24.387459 (+ 292us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:37:24.387462 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:37:24.387836 (+ 374us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:37:24.388012 (+ 176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:24.388021 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:24.389061 (+ 1040us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:24.389065 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:24.389944 (+ 879us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:24.389954 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:24.390567 (+ 613us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:24.390571 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:24.390748 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:24.391436 (+ 688us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:37:24.391477 (+ 41us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:37:24.394517 (+ 3040us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.171.126:35453: Server oryx/127.20.171.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":514,"thread_start_us":235,"threads_started":1}
W20260807 10:37:24.394965 30369 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:37:24.386624 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.65:55349 (local address 127.20.171.126:35453)
0807 10:37:24.386881 (+ 257us) server_negotiation.cc:206] Beginning negotiation
0807 10:37:24.386885 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 10:37:24.387136 (+ 251us) server_negotiation.cc:407] Connection header received
0807 10:37:24.387268 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:37:24.387272 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:37:24.387335 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:37:24.387413 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:37:24.388136 (+ 723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:24.388941 (+ 805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:24.390061 (+ 1120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:24.390453 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:24.390540 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:24.394729 (+ 4189us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.171.65:55349: BlockingRecv error: recv got EOF from 127.20.171.65:55349 (error 108)
Metrics: {"server-negotiator.queue_time_us":136}
Aug 07 10:37:24 dist-test-slave-0b58 krb5kdc[29614](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.171.66@KRBTEST.COM for oryx/127.20.171.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 10:37:24 dist-test-slave-0b58 krb5kdc[29614](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.171.66@KRBTEST.COM for oryx/127.20.171.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 10:37:24.855753 30681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:37:24.847376 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:35453 (local address 127.20.171.66:34227)
0807 10:37:24.847935 (+ 559us) negotiation.cc:107] Waiting for socket to connect
0807 10:37:24.847950 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 10:37:24.848116 (+ 166us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:37:24.848484 (+ 368us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:37:24.848490 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:37:24.848899 (+ 409us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:37:24.849100 (+ 201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:24.849108 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:24.850079 (+ 971us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:24.850084 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:24.851051 (+ 967us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:24.851085 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:24.852047 (+ 962us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:24.852054 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:24.852223 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:24.852837 (+ 614us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:37:24.852853 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:37:24.855517 (+ 2664us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.171.126:35453: Server oryx/127.20.171.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":449,"thread_start_us":292,"threads_started":1}
W20260807 10:37:24.855959 30369 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:37:24.847538 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.66:34227 (local address 127.20.171.126:35453)
0807 10:37:24.847777 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0807 10:37:24.847784 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:37:24.848042 (+ 258us) server_negotiation.cc:407] Connection header received
0807 10:37:24.848279 (+ 237us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:37:24.848283 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:37:24.848342 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:37:24.848443 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:37:24.849263 (+ 820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:24.849942 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:24.851210 (+ 1268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:24.851887 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:24.851991 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:24.855755 (+ 3764us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.171.66:34227: BlockingRecv error: recv got EOF from 127.20.171.66:34227 (error 108)
Metrics: {"server-negotiator.queue_time_us":84}
Aug 07 10:37:25 dist-test-slave-0b58 krb5kdc[29614](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.171.67@KRBTEST.COM for oryx/127.20.171.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 10:37:25 dist-test-slave-0b58 krb5kdc[29614](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.171.67@KRBTEST.COM for oryx/127.20.171.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 10:37:25.316354 30682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:37:25.308217 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:35453 (local address 127.20.171.67:34507)
0807 10:37:25.308712 (+ 495us) negotiation.cc:107] Waiting for socket to connect
0807 10:37:25.308728 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 10:37:25.308901 (+ 173us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:37:25.309278 (+ 377us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:37:25.309284 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:37:25.309761 (+ 477us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:37:25.309934 (+ 173us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:25.309943 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:25.310917 (+ 974us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:25.310921 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:25.311725 (+ 804us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:25.311736 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:25.312514 (+ 778us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:25.312520 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:25.312685 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:25.313271 (+ 586us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:37:25.313288 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:37:25.315919 (+ 2631us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.171.126:35453: Server oryx/127.20.171.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":404,"thread_start_us":252,"threads_started":1}
W20260807 10:37:25.316424 30369 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:37:25.308279 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.67:34507 (local address 127.20.171.126:35453)
0807 10:37:25.308500 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0807 10:37:25.308507 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:37:25.308819 (+ 312us) server_negotiation.cc:407] Connection header received
0807 10:37:25.309030 (+ 211us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:37:25.309034 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:37:25.309105 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:37:25.309216 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:37:25.310080 (+ 864us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:25.310779 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:25.311868 (+ 1089us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:25.312366 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:25.312487 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:25.316138 (+ 3651us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.171.67:34507: BlockingRecv error: recv got EOF from 127.20.171.67:34507 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
Aug 07 10:37:25 dist-test-slave-0b58 krb5kdc[29614](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.171.65@KRBTEST.COM for oryx/127.20.171.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 10:37:25 dist-test-slave-0b58 krb5kdc[29614](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.171.65@KRBTEST.COM for oryx/127.20.171.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 10:37:25.404255 30683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:37:25.395960 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:35453 (local address 127.20.171.65:37033)
0807 10:37:25.396545 (+ 585us) negotiation.cc:107] Waiting for socket to connect
0807 10:37:25.396562 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 10:37:25.396674 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:37:25.396960 (+ 286us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:37:25.396963 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:37:25.397443 (+ 480us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:37:25.397645 (+ 202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:25.397654 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:25.398760 (+ 1106us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:25.398766 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:25.399679 (+ 913us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:25.399691 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:25.400389 (+ 698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:25.400394 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:25.400549 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:25.401145 (+ 596us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:37:25.401160 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:37:25.403867 (+ 2707us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.171.126:35453: Server oryx/127.20.171.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":479,"thread_start_us":327,"threads_started":1}
W20260807 10:37:25.404323 30369 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:37:25.395991 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.65:37033 (local address 127.20.171.126:35453)
0807 10:37:25.396232 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0807 10:37:25.396242 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 10:37:25.396641 (+ 399us) server_negotiation.cc:407] Connection header received
0807 10:37:25.396770 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:37:25.396774 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:37:25.396838 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:37:25.396950 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:37:25.397786 (+ 836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:25.398612 (+ 826us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:25.399828 (+ 1216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:25.400227 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:25.400380 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:25.404050 (+ 3670us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.171.65:37033: BlockingRecv error: recv got EOF from 127.20.171.65:37033 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
Aug 07 10:37:25 dist-test-slave-0b58 krb5kdc[29614](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.171.66@KRBTEST.COM for oryx/127.20.171.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 10:37:25 dist-test-slave-0b58 krb5kdc[29614](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.171.66@KRBTEST.COM for oryx/127.20.171.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 10:37:25.865244 30684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:37:25.856959 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:35453 (local address 127.20.171.66:34929)
0807 10:37:25.857566 (+ 607us) negotiation.cc:107] Waiting for socket to connect
0807 10:37:25.857605 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0807 10:37:25.857727 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:37:25.858044 (+ 317us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:37:25.858047 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:37:25.858477 (+ 430us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:37:25.858649 (+ 172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:25.858657 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:25.859643 (+ 986us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:25.859647 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:25.860622 (+ 975us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:25.860633 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:25.861305 (+ 672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:25.861309 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:25.861413 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:25.862026 (+ 613us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:37:25.862049 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:37:25.864973 (+ 2924us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.171.126:35453: Server oryx/127.20.171.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":472,"thread_start_us":312,"threads_started":1}
W20260807 10:37:25.865556 30369 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:37:25.857032 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.66:34929 (local address 127.20.171.126:35453)
0807 10:37:25.857214 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0807 10:37:25.857218 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 10:37:25.857695 (+ 477us) server_negotiation.cc:407] Connection header received
0807 10:37:25.857827 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:37:25.857831 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:37:25.857893 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:37:25.857973 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:37:25.858780 (+ 807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:25.859517 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:25.860747 (+ 1230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:25.861178 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:25.861274 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:25.865180 (+ 3906us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.171.66:34929: BlockingRecv error: recv got EOF from 127.20.171.66:34929 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
I20260807 10:37:26.150342 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 30213
I20260807 10:37:26.162295 30686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:37:26.151431 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40304 (local address 127.20.171.65:38205)
0807 10:37:26.152052 (+ 621us) server_negotiation.cc:206] Beginning negotiation
0807 10:37:26.152059 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:37:26.152084 (+ 25us) server_negotiation.cc:407] Connection header received
0807 10:37:26.152141 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:37:26.152147 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:37:26.152439 (+ 292us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:37:26.152578 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:37:26.153953 (+ 1375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:26.154995 (+ 1042us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:26.156141 (+ 1146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:26.156793 (+ 652us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:26.156893 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:26.159442 (+ 2549us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:37:26.159450 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:37:26.159463 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:37:26.159492 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:37:26.161844 (+ 2352us) server_negotiation.cc:394] Sending RPC error: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.20.171.65@KRBTEST.COM not found in keytab (ticket kvno 2)
0807 10:37:26.162080 (+ 236us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:40304: Request ticket server kudu/127.20.171.65@KRBTEST.COM not found in keytab (ticket kvno 2)
Metrics: {"server-negotiator.queue_time_us":460,"thread_start_us":331,"threads_started":1}
W20260807 10:37:26.162416 30686 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:40304: Request ticket server kudu/127.20.171.65@KRBTEST.COM not found in keytab (ticket kvno 2)
W20260807 10:37:26.162487 21165 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 30213: Not authorized: Client connection negotiation failed: client connection to 127.20.171.65:38205: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.20.171.65@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260807 10:37:26.162706 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 30213
I20260807 10:37:26.183576 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 30370
I20260807 10:37:26.195199 30687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:37:26.184560 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49880 (local address 127.20.171.66:33237)
0807 10:37:26.185151 (+ 591us) server_negotiation.cc:206] Beginning negotiation
0807 10:37:26.185159 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 10:37:26.185190 (+ 31us) server_negotiation.cc:407] Connection header received
0807 10:37:26.185252 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:37:26.185258 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:37:26.185480 (+ 222us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:37:26.185632 (+ 152us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:37:26.186911 (+ 1279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:26.188001 (+ 1090us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:26.189308 (+ 1307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:26.189853 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:26.189954 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:26.192321 (+ 2367us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:37:26.192331 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:37:26.192345 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:37:26.192377 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:37:26.194703 (+ 2326us) server_negotiation.cc:394] Sending RPC error: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.20.171.66@KRBTEST.COM not found in keytab (ticket kvno 2)
0807 10:37:26.194977 (+ 274us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:49880: Request ticket server kudu/127.20.171.66@KRBTEST.COM not found in keytab (ticket kvno 2)
Metrics: {"server-negotiator.queue_time_us":429,"thread_start_us":273,"threads_started":1}
W20260807 10:37:26.195310 30687 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:49880: Request ticket server kudu/127.20.171.66@KRBTEST.COM not found in keytab (ticket kvno 2)
W20260807 10:37:26.195412 21165 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 30370: Not authorized: Client connection negotiation failed: client connection to 127.20.171.66:33237: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.20.171.66@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260807 10:37:26.195586 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 30370
I20260807 10:37:26.215804 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 30504
I20260807 10:37:26.229223 30688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:37:26.216860 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36872 (local address 127.20.171.67:43567)
0807 10:37:26.217425 (+ 565us) server_negotiation.cc:206] Beginning negotiation
0807 10:37:26.217432 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:37:26.217456 (+ 24us) server_negotiation.cc:407] Connection header received
0807 10:37:26.217537 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:37:26.217544 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:37:26.217768 (+ 224us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:37:26.217975 (+ 207us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:37:26.219362 (+ 1387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:26.220371 (+ 1009us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:26.221635 (+ 1264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:26.222283 (+ 648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:26.222423 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:26.225315 (+ 2892us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:37:26.225329 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:37:26.225342 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:37:26.225377 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:37:26.228582 (+ 3205us) server_negotiation.cc:394] Sending RPC error: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.20.171.67@KRBTEST.COM not found in keytab (ticket kvno 2)
0807 10:37:26.228915 (+ 333us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:36872: Request ticket server kudu/127.20.171.67@KRBTEST.COM not found in keytab (ticket kvno 2)
Metrics: {"server-negotiator.queue_time_us":425,"thread_start_us":294,"threads_started":1}
W20260807 10:37:26.229439 30688 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:36872: Request ticket server kudu/127.20.171.67@KRBTEST.COM not found in keytab (ticket kvno 2)
W20260807 10:37:26.233892 21165 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 30504: Not authorized: Client connection negotiation failed: client connection to 127.20.171.67:43567: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.20.171.67@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260807 10:37:26.234103 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 30504
I20260807 10:37:26.253722 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 30143
I20260807 10:37:26.255079 30206 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:37:26.374905 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 30143
2026-08-07T10:37:26Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (21071 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-08-07T10:37:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T10:37:26Z Disabled control of system clock
I20260807 10:37:26.470106 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786098956060137-21165-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786098956060137-21165-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786098956060137-21165-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.171.126:37135
--webserver_interface=127.20.171.126
--webserver_port=0
--builtin_ntp_servers=127.20.171.84:38657
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.171.126:37135
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260807 10:37:26.799347 30693 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:37:26.799614 30693 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:37:26.799710 30693 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:37:26.806758 30693 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 10:37:26.806860 30693 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:37:26.806898 30693 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:37:26.806958 30693 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 10:37:26.807003 30693 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 10:37:26.815439 30693 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.171.84:38657
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786098956060137-21165-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786098956060137-21165-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.171.126:37135
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.171.126:37135
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.171.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786098956060137-21165-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:37:26.816655 30693 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:37:26.818380 30693 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:37:26.830053 30698 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:37:26.830138 30701 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:37:26.830086 30699 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:37:26.830907 30693 server_base.cc:1034] running on GCE node
I20260807 10:37:26.831647 30693 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:37:26.833061 30693 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:37:26.834252 30693 hybrid_clock.cc:648] HybridClock initialized: now 1786099046834198 us; error 46 us; skew 500 ppm
I20260807 10:37:26.834585 30693 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 10:37:26.836862 30693 webserver.cc:460] Webserver started at http://127.20.171.126:45087/ using document root <none> and password file <none>
I20260807 10:37:26.837553 30693 fs_manager.cc:359] Metadata directory not provided
I20260807 10:37:26.837662 30693 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:37:26.838032 30693 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:37:26.840845 30693 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786098956060137-21165-0/minicluster-data/master-0/data/instance:
uuid: "c2e422594fb946a391da709e30c62a6c"
format_stamp: "Formatted at 2026-08-07 10:37:26 on dist-test-slave-0b58"
server_key: "34f99a552b8fff5658072c2041fa8505"
server_key_iv: "2d40c4a62fd35efd824fd4fb4df8051b"
server_key_version: "encryptionkey@0"
I20260807 10:37:26.841600 30693 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786098956060137-21165-0/minicluster-data/master-0/wal/instance:
uuid: "c2e422594fb946a391da709e30c62a6c"
format_stamp: "Formatted at 2026-08-07 10:37:26 on dist-test-slave-0b58"
server_key: "34f99a552b8fff5658072c2041fa8505"
server_key_iv: "2d40c4a62fd35efd824fd4fb4df8051b"
server_key_version: "encryptionkey@0"
I20260807 10:37:26.846444 30693 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.001s
I20260807 10:37:26.849745 30708 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:37:26.850968 30693 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260807 10:37:26.851138 30693 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786098956060137-21165-0/minicluster-data/master-0/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786098956060137-21165-0/minicluster-data/master-0/wal
uuid: "c2e422594fb946a391da709e30c62a6c"
format_stamp: "Formatted at 2026-08-07 10:37:26 on dist-test-slave-0b58"
server_key: "34f99a552b8fff5658072c2041fa8505"
server_key_iv: "2d40c4a62fd35efd824fd4fb4df8051b"
server_key_version: "encryptionkey@0"
I20260807 10:37:26.851353 30693 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786098956060137-21165-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786098956060137-21165-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786098956060137-21165-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:37:26.863677 30693 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:37:26.864689 30693 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:37:26.864992 30693 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:37:26.883752 30693 rpc_server.cc:307] RPC server started. Bound to: 127.20.171.126:37135
I20260807 10:37:26.883775 30760 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.171.126:37135 every 8 connection(s)
I20260807 10:37:26.885164 30693 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
I20260807 10:37:26.888849 30761 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:37:26.894956 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 30693
I20260807 10:37:26.895155 21165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786098956060137-21165-0/minicluster-data/master-0/wal/instance
I20260807 10:37:26.895805 21165 external_mini_cluster.cc:1428] Setting key 1ed3b07f01a5d57c722d060a6bd0af2f
I20260807 10:37:26.899169 30761 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c2e422594fb946a391da709e30c62a6c: Bootstrap starting.
I20260807 10:37:26.902506 30761 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c2e422594fb946a391da709e30c62a6c: Neither blocks nor log segments found. Creating new log.
I20260807 10:37:26.903537 30761 log.cc:824] T 00000000000000000000000000000000 P c2e422594fb946a391da709e30c62a6c: Log is configured to *not* fsync() on all Append() calls
I20260807 10:37:26.906558 30761 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c2e422594fb946a391da709e30c62a6c: No bootstrap required, opened a new log
I20260807 10:37:26.909379 30764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:37:26.897887 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35174 (local address 127.20.171.126:37135)
0807 10:37:26.898895 (+ 1008us) server_negotiation.cc:206] Beginning negotiation
0807 10:37:26.898905 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 10:37:26.898945 (+ 40us) server_negotiation.cc:407] Connection header received
0807 10:37:26.900696 (+ 1751us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:37:26.900721 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:37:26.901120 (+ 399us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:37:26.901401 (+ 281us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:37:26.902112 (+ 711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:26.903415 (+ 1303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:26.905091 (+ 1676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:26.905697 (+ 606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:26.905842 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:26.907147 (+ 1305us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:37:26.907153 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:37:26.907169 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:37:26.907724 (+ 555us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:37:26.907794 (+ 70us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:37:26.907814 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:37:26.907903 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0807 10:37:26.908144 (+ 241us) server_negotiation.cc:299] Negotiation successful
0807 10:37:26.908474 (+ 330us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":551,"thread_start_us":359,"threads_started":1}
I20260807 10:37:26.914572 30761 raft_consensus.cc:348] T 00000000000000000000000000000000 P c2e422594fb946a391da709e30c62a6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2e422594fb946a391da709e30c62a6c" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 37135 } }
I20260807 10:37:26.914907 30761 raft_consensus.cc:374] T 00000000000000000000000000000000 P c2e422594fb946a391da709e30c62a6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:37:26.915009 30761 raft_consensus.cc:729] T 00000000000000000000000000000000 P c2e422594fb946a391da709e30c62a6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2e422594fb946a391da709e30c62a6c, State: Initialized, Role: FOLLOWER
I20260807 10:37:26.915508 30761 consensus_queue.cc:260] T 00000000000000000000000000000000 P c2e422594fb946a391da709e30c62a6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2e422594fb946a391da709e30c62a6c" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 37135 } }
I20260807 10:37:26.915736 30761 raft_consensus.cc:388] T 00000000000000000000000000000000 P c2e422594fb946a391da709e30c62a6c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 10:37:26.915884 30761 raft_consensus.cc:482] T 00000000000000000000000000000000 P c2e422594fb946a391da709e30c62a6c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 10:37:26.916043 30761 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c2e422594fb946a391da709e30c62a6c [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:37:26.918540 30761 raft_consensus.cc:504] T 00000000000000000000000000000000 P c2e422594fb946a391da709e30c62a6c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2e422594fb946a391da709e30c62a6c" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 37135 } }
I20260807 10:37:26.918998 30761 leader_election.cc:302] T 00000000000000000000000000000000 P c2e422594fb946a391da709e30c62a6c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c2e422594fb946a391da709e30c62a6c; no voters:
I20260807 10:37:26.919610 30761 leader_election.cc:288] T 00000000000000000000000000000000 P c2e422594fb946a391da709e30c62a6c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 10:37:26.919741 30766 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c2e422594fb946a391da709e30c62a6c [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:37:26.920436 30766 raft_consensus.cc:686] T 00000000000000000000000000000000 P c2e422594fb946a391da709e30c62a6c [term 1 LEADER]: Becoming Leader. State: Replica: c2e422594fb946a391da709e30c62a6c, State: Running, Role: LEADER
I20260807 10:37:26.920919 30766 consensus_queue.cc:237] T 00000000000000000000000000000000 P c2e422594fb946a391da709e30c62a6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2e422594fb946a391da709e30c62a6c" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 37135 } }
I20260807 10:37:26.921619 30761 sys_catalog.cc:564] T 00000000000000000000000000000000 P c2e422594fb946a391da709e30c62a6c [sys.catalog]: configured and running, proceeding with master startup.
I20260807 10:37:26.923457 30768 sys_catalog.cc:455] T 00000000000000000000000000000000 P c2e422594fb946a391da709e30c62a6c [sys.catalog]: SysCatalogTable state changed. Reason: New leader c2e422594fb946a391da709e30c62a6c. Latest consensus state: current_term: 1 leader_uuid: "c2e422594fb946a391da709e30c62a6c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2e422594fb946a391da709e30c62a6c" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 37135 } } }
I20260807 10:37:26.923925 30768 sys_catalog.cc:458] T 00000000000000000000000000000000 P c2e422594fb946a391da709e30c62a6c [sys.catalog]: This master's current role is: LEADER
I20260807 10:37:26.924325 30767 sys_catalog.cc:455] T 00000000000000000000000000000000 P c2e422594fb946a391da709e30c62a6c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c2e422594fb946a391da709e30c62a6c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2e422594fb946a391da709e30c62a6c" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 37135 } } }
I20260807 10:37:26.924682 30767 sys_catalog.cc:458] T 00000000000000000000000000000000 P c2e422594fb946a391da709e30c62a6c [sys.catalog]: This master's current role is: LEADER
I20260807 10:37:26.925940 30771 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 10:37:26.930655 30771 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 10:37:26.939443 30771 catalog_manager.cc:1347] Generated new cluster ID: 3f2e60c7656b4282896a803997bdf42e
I20260807 10:37:26.939570 30771 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 10:37:26.953011 30771 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 10:37:26.954367 30771 catalog_manager.cc:1504] Loading token signing keys...
I20260807 10:37:26.966312 30771 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c2e422594fb946a391da709e30c62a6c: Generated new TSK 0
I20260807 10:37:26.967109 30771 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 10:37:26.981298 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786098956060137-21165-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786098956060137-21165-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786098956060137-21165-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786098956060137-21165-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.171.65:0
--local_ip_for_outbound_sockets=127.20.171.65
--webserver_interface=127.20.171.65
--webserver_port=0
--tserver_master_addrs=127.20.171.126:37135
--builtin_ntp_servers=127.20.171.84:38657
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260807 10:37:27.316174 30786 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:37:27.316478 30786 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:37:27.316624 30786 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:37:27.323473 30786 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:37:27.323559 30786 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:37:27.323717 30786 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.171.65
I20260807 10:37:27.333099 30786 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.171.84:38657
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786098956060137-21165-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786098956060137-21165-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.171.65:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786098956060137-21165-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.171.65
--webserver_port=0
--tserver_master_addrs=127.20.171.126:37135
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.171.65
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786098956060137-21165-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:37:27.334343 30786 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:37:27.336023 30786 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:37:27.348984 30791 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:37:27.349053 30792 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:37:27.349017 30794 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:37:27.350744 30786 server_base.cc:1034] running on GCE node
I20260807 10:37:27.351261 30786 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:37:27.352036 30786 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:37:27.353257 30786 hybrid_clock.cc:648] HybridClock initialized: now 1786099047353198 us; error 67 us; skew 500 ppm
I20260807 10:37:27.353559 30786 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 10:37:27.363931 30786 webserver.cc:460] Webserver started at http://127.20.171.65:33237/ using document root <none> and password file <none>
I20260807 10:37:27.364683 30786 fs_manager.cc:359] Metadata directory not provided
I20260807 10:37:27.364812 30786 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:37:27.365126 30786 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:37:27.368021 30786 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786098956060137-21165-0/minicluster-data/ts-0/data/instance:
uuid: "004f7f1cea084fab8cea34e9adbee73e"
format_stamp: "Formatted at 2026-08-07 10:37:27 on dist-test-slave-0b58"
server_key: "71781246aef1ca6d8e6b69f779884779"
server_key_iv: "8fa521f5d365e0177f53b46b75ade1bd"
server_key_version: "encryptionkey@0"
I20260807 10:37:27.368928 30786 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786098956060137-21165-0/minicluster-data/ts-0/wal/instance:
uuid: "004f7f1cea084fab8cea34e9adbee73e"
format_stamp: "Formatted at 2026-08-07 10:37:27 on dist-test-slave-0b58"
server_key: "71781246aef1ca6d8e6b69f779884779"
server_key_iv: "8fa521f5d365e0177f53b46b75ade1bd"
server_key_version: "encryptionkey@0"
I20260807 10:37:27.373813 30786 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.002s
I20260807 10:37:27.376901 30800 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:37:27.378137 30786 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 10:37:27.378324 30786 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786098956060137-21165-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786098956060137-21165-0/minicluster-data/ts-0/wal
uuid: "004f7f1cea084fab8cea34e9adbee73e"
format_stamp: "Formatted at 2026-08-07 10:37:27 on dist-test-slave-0b58"
server_key: "71781246aef1ca6d8e6b69f779884779"
server_key_iv: "8fa521f5d365e0177f53b46b75ade1bd"
server_key_version: "encryptionkey@0"
I20260807 10:37:27.378547 30786 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786098956060137-21165-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786098956060137-21165-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786098956060137-21165-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:37:27.396409 30786 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:37:27.397181 30786 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:37:27.397490 30786 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:37:27.398409 30786 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:37:27.399806 30786 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:37:27.399936 30786 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:37:27.400054 30786 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:37:27.400147 30786 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:37:27.433373 30786 rpc_server.cc:307] RPC server started. Bound to: 127.20.171.65:37011
I20260807 10:37:27.433465 30917 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.171.65:37011 every 8 connection(s)
I20260807 10:37:27.434736 30786 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786098956060137-21165-0/minicluster-data/ts-0/data/info.pb
I20260807 10:37:27.442001 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 30786
I20260807 10:37:27.442190 21165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786098956060137-21165-0/minicluster-data/ts-0/wal/instance
I20260807 10:37:27.442816 21165 external_mini_cluster.cc:1428] Setting key 5b52386c84dbe047a44143dd53a26d53
I20260807 10:37:27.445343 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786098956060137-21165-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786098956060137-21165-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786098956060137-21165-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786098956060137-21165-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.171.66:0
--local_ip_for_outbound_sockets=127.20.171.66
--webserver_interface=127.20.171.66
--webserver_port=0
--tserver_master_addrs=127.20.171.126:37135
--builtin_ntp_servers=127.20.171.84:38657
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260807 10:37:27.447057 30920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:37:27.437335 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.65:33463 (local address 127.20.171.126:37135)
0807 10:37:27.437828 (+ 493us) server_negotiation.cc:206] Beginning negotiation
0807 10:37:27.437832 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 10:37:27.438959 (+ 1127us) server_negotiation.cc:407] Connection header received
0807 10:37:27.440721 (+ 1762us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:37:27.440726 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:37:27.440819 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:37:27.440931 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:37:27.441914 (+ 983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:27.442738 (+ 824us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:27.444428 (+ 1690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:27.444808 (+ 380us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:27.444937 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:27.446217 (+ 1280us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:37:27.446222 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:37:27.446225 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:37:27.446242 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:37:27.446285 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:37:27.446297 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:37:27.446396 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0807 10:37:27.446625 (+ 229us) server_negotiation.cc:299] Negotiation successful
0807 10:37:27.446729 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":388,"thread_start_us":281,"threads_started":1}
I20260807 10:37:27.448021 30921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:37:27.437952 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:37135 (local address 127.20.171.65:33463)
0807 10:37:27.438814 (+ 862us) negotiation.cc:107] Waiting for socket to connect
0807 10:37:27.438853 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0807 10:37:27.440471 (+ 1618us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:37:27.441145 (+ 674us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:37:27.441152 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:37:27.441225 (+ 73us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:37:27.441745 (+ 520us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:27.441760 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:27.442897 (+ 1137us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:27.442901 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:27.444246 (+ 1345us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:27.444302 (+ 56us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:27.445019 (+ 717us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:27.445029 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:27.445245 (+ 216us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:27.445905 (+ 660us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 10:37:27.445907 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:37:27.445941 (+ 34us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 10:37:27.446014 (+ 73us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:37:27.446398 (+ 384us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:37:27.446412 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:37:27.446422 (+ 10us) client_negotiation.cc:769] Sending connection context
0807 10:37:27.446611 (+ 189us) client_negotiation.cc:240] Negotiation successful
0807 10:37:27.446983 (+ 372us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":460,"thread_start_us":271,"threads_started":1}
I20260807 10:37:27.449453 30918 heartbeater.cc:347] Connected to a master server at 127.20.171.126:37135
I20260807 10:37:27.449755 30918 heartbeater.cc:464] Registering TS with master...
I20260807 10:37:27.450472 30918 heartbeater.cc:511] Master 127.20.171.126:37135 requested a full tablet report, sending...
I20260807 10:37:27.452652 30725 ts_manager.cc:194] Registered new tserver with Master: 004f7f1cea084fab8cea34e9adbee73e (127.20.171.65:37011)
I20260807 10:37:27.454746 30725 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.20.171.65:33463
W20260807 10:37:27.770304 30922 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:37:27.770562 30922 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:37:27.770648 30922 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:37:27.777683 30922 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:37:27.777777 30922 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:37:27.777878 30922 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.171.66
I20260807 10:37:27.786605 30922 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.171.84:38657
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786098956060137-21165-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786098956060137-21165-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.171.66:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786098956060137-21165-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.171.66
--webserver_port=0
--tserver_master_addrs=127.20.171.126:37135
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.171.66
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786098956060137-21165-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:37:27.787809 30922 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:37:27.789511 30922 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:37:27.802309 30927 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:37:27.802213 30928 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:37:27.802286 30930 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:37:27.803028 30922 server_base.cc:1034] running on GCE node
I20260807 10:37:27.803653 30922 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:37:27.804633 30922 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:37:27.805856 30922 hybrid_clock.cc:648] HybridClock initialized: now 1786099047805818 us; error 55 us; skew 500 ppm
I20260807 10:37:27.806164 30922 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 10:37:27.808413 30922 webserver.cc:460] Webserver started at http://127.20.171.66:34327/ using document root <none> and password file <none>
I20260807 10:37:27.809084 30922 fs_manager.cc:359] Metadata directory not provided
I20260807 10:37:27.809216 30922 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:37:27.809528 30922 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:37:27.812144 30922 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786098956060137-21165-0/minicluster-data/ts-1/data/instance:
uuid: "cb9a3cfc748b49e381ae11eccb61b96b"
format_stamp: "Formatted at 2026-08-07 10:37:27 on dist-test-slave-0b58"
server_key: "fed57a87ce7199580db115a426a0fc59"
server_key_iv: "fdfb616c9b714c1195a09a19525111f4"
server_key_version: "encryptionkey@0"
I20260807 10:37:27.813046 30922 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786098956060137-21165-0/minicluster-data/ts-1/wal/instance:
uuid: "cb9a3cfc748b49e381ae11eccb61b96b"
format_stamp: "Formatted at 2026-08-07 10:37:27 on dist-test-slave-0b58"
server_key: "fed57a87ce7199580db115a426a0fc59"
server_key_iv: "fdfb616c9b714c1195a09a19525111f4"
server_key_version: "encryptionkey@0"
I20260807 10:37:27.817981 30922 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260807 10:37:27.821117 30936 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:37:27.822367 30922 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260807 10:37:27.822532 30922 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786098956060137-21165-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786098956060137-21165-0/minicluster-data/ts-1/wal
uuid: "cb9a3cfc748b49e381ae11eccb61b96b"
format_stamp: "Formatted at 2026-08-07 10:37:27 on dist-test-slave-0b58"
server_key: "fed57a87ce7199580db115a426a0fc59"
server_key_iv: "fdfb616c9b714c1195a09a19525111f4"
server_key_version: "encryptionkey@0"
I20260807 10:37:27.822750 30922 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786098956060137-21165-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786098956060137-21165-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786098956060137-21165-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:37:27.833597 30922 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:37:27.834425 30922 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:37:27.834710 30922 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:37:27.835584 30922 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:37:27.836910 30922 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:37:27.837034 30922 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:37:27.837167 30922 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:37:27.837267 30922 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:37:27.869656 30922 rpc_server.cc:307] RPC server started. Bound to: 127.20.171.66:32819
I20260807 10:37:27.869709 31051 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.171.66:32819 every 8 connection(s)
I20260807 10:37:27.870915 30922 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786098956060137-21165-0/minicluster-data/ts-1/data/info.pb
I20260807 10:37:27.875129 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 30922
I20260807 10:37:27.875313 21165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786098956060137-21165-0/minicluster-data/ts-1/wal/instance
I20260807 10:37:27.875785 21165 external_mini_cluster.cc:1428] Setting key d4ff50ade45bb372279b3f8e0c8ad673
I20260807 10:37:27.878505 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786098956060137-21165-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786098956060137-21165-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786098956060137-21165-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786098956060137-21165-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.171.67:0
--local_ip_for_outbound_sockets=127.20.171.67
--webserver_interface=127.20.171.67
--webserver_port=0
--tserver_master_addrs=127.20.171.126:37135
--builtin_ntp_servers=127.20.171.84:38657
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260807 10:37:27.883630 30920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:37:27.873428 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.66:51495 (local address 127.20.171.126:37135)
0807 10:37:27.873638 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0807 10:37:27.873644 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:37:27.874963 (+ 1319us) server_negotiation.cc:407] Connection header received
0807 10:37:27.877079 (+ 2116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:37:27.877084 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:37:27.877174 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:37:27.877291 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:37:27.878307 (+ 1016us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:27.879080 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:27.880732 (+ 1652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:27.881182 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:27.881264 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:27.882729 (+ 1465us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:37:27.882755 (+ 26us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:37:27.882762 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:37:27.882785 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:37:27.882840 (+ 55us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:37:27.882859 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:37:27.882948 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0807 10:37:27.883222 (+ 274us) server_negotiation.cc:299] Negotiation successful
0807 10:37:27.883339 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260807 10:37:27.885530 31054 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:37:27.873923 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:37135 (local address 127.20.171.66:51495)
0807 10:37:27.874814 (+ 891us) negotiation.cc:107] Waiting for socket to connect
0807 10:37:27.874853 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0807 10:37:27.876820 (+ 1967us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:37:27.877511 (+ 691us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:37:27.877518 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:37:27.877602 (+ 84us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:37:27.878129 (+ 527us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:27.878144 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:27.879242 (+ 1098us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:27.879246 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:27.880523 (+ 1277us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:27.880556 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:27.881497 (+ 941us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:27.881502 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:27.881693 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:27.882448 (+ 755us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 10:37:27.882451 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:37:27.882491 (+ 40us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 10:37:27.882559 (+ 68us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:37:27.882966 (+ 407us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:37:27.882976 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:37:27.882983 (+ 7us) client_negotiation.cc:769] Sending connection context
0807 10:37:27.883936 (+ 953us) client_negotiation.cc:240] Negotiation successful
0807 10:37:27.884309 (+ 373us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":476,"thread_start_us":307,"threads_started":1}
I20260807 10:37:27.887230 31052 heartbeater.cc:347] Connected to a master server at 127.20.171.126:37135
I20260807 10:37:27.887530 31052 heartbeater.cc:464] Registering TS with master...
I20260807 10:37:27.888413 31052 heartbeater.cc:511] Master 127.20.171.126:37135 requested a full tablet report, sending...
I20260807 10:37:27.889935 30725 ts_manager.cc:194] Registered new tserver with Master: cb9a3cfc748b49e381ae11eccb61b96b (127.20.171.66:32819)
I20260807 10:37:27.891001 30725 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.20.171.66:51495
W20260807 10:37:28.202710 31055 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:37:28.202952 31055 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:37:28.203085 31055 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:37:28.209879 31055 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:37:28.209968 31055 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:37:28.210152 31055 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.171.67
I20260807 10:37:28.218541 31055 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.171.84:38657
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786098956060137-21165-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786098956060137-21165-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.171.67:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786098956060137-21165-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.171.67
--webserver_port=0
--tserver_master_addrs=127.20.171.126:37135
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.171.67
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786098956060137-21165-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:37:28.219765 31055 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:37:28.221573 31055 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:37:28.236322 31061 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:37:28.236346 31060 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:37:28.236443 31063 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:37:28.237370 31055 server_base.cc:1034] running on GCE node
I20260807 10:37:28.238020 31055 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:37:28.238940 31055 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:37:28.240151 31055 hybrid_clock.cc:648] HybridClock initialized: now 1786099048240117 us; error 32 us; skew 500 ppm
I20260807 10:37:28.240491 31055 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 10:37:28.242594 31055 webserver.cc:460] Webserver started at http://127.20.171.67:38625/ using document root <none> and password file <none>
I20260807 10:37:28.243211 31055 fs_manager.cc:359] Metadata directory not provided
I20260807 10:37:28.243292 31055 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:37:28.243559 31055 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:37:28.246500 31055 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786098956060137-21165-0/minicluster-data/ts-2/data/instance:
uuid: "27b06a6d4ae3467eb0e5978b7a31685a"
format_stamp: "Formatted at 2026-08-07 10:37:28 on dist-test-slave-0b58"
server_key: "e54fc9c4a5007e412a94a283e3684582"
server_key_iv: "68dff1bf093d066806d0bc1d8e5c07fc"
server_key_version: "encryptionkey@0"
I20260807 10:37:28.247304 31055 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786098956060137-21165-0/minicluster-data/ts-2/wal/instance:
uuid: "27b06a6d4ae3467eb0e5978b7a31685a"
format_stamp: "Formatted at 2026-08-07 10:37:28 on dist-test-slave-0b58"
server_key: "e54fc9c4a5007e412a94a283e3684582"
server_key_iv: "68dff1bf093d066806d0bc1d8e5c07fc"
server_key_version: "encryptionkey@0"
I20260807 10:37:28.252321 31055 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.004s
I20260807 10:37:28.255753 31069 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:37:28.257129 31055 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260807 10:37:28.257278 31055 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786098956060137-21165-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786098956060137-21165-0/minicluster-data/ts-2/wal
uuid: "27b06a6d4ae3467eb0e5978b7a31685a"
format_stamp: "Formatted at 2026-08-07 10:37:28 on dist-test-slave-0b58"
server_key: "e54fc9c4a5007e412a94a283e3684582"
server_key_iv: "68dff1bf093d066806d0bc1d8e5c07fc"
server_key_version: "encryptionkey@0"
I20260807 10:37:28.257453 31055 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786098956060137-21165-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786098956060137-21165-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786098956060137-21165-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:37:28.269832 31055 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:37:28.270646 31055 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:37:28.270910 31055 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:37:28.271765 31055 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:37:28.273145 31055 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:37:28.273236 31055 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:37:28.273315 31055 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:37:28.273370 31055 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:37:28.306275 31055 rpc_server.cc:307] RPC server started. Bound to: 127.20.171.67:34253
I20260807 10:37:28.306325 31183 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.171.67:34253 every 8 connection(s)
I20260807 10:37:28.307622 31055 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786098956060137-21165-0/minicluster-data/ts-2/data/info.pb
I20260807 10:37:28.317732 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 31055
I20260807 10:37:28.317927 21165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786098956060137-21165-0/minicluster-data/ts-2/wal/instance
I20260807 10:37:28.318468 21165 external_mini_cluster.cc:1428] Setting key cf65e3ee8f2a546b00be88a9c9426fa8
I20260807 10:37:28.319140 30920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:37:28.310138 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.67:55597 (local address 127.20.171.126:37135)
0807 10:37:28.310363 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0807 10:37:28.310369 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:37:28.311606 (+ 1237us) server_negotiation.cc:407] Connection header received
0807 10:37:28.313167 (+ 1561us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:37:28.313171 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:37:28.313245 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:37:28.313330 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:37:28.314280 (+ 950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:28.314952 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:28.316342 (+ 1390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:28.316788 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:28.316880 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:28.318324 (+ 1444us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:37:28.318330 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:37:28.318334 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:37:28.318354 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:37:28.318393 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:37:28.318408 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:37:28.318503 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0807 10:37:28.318738 (+ 235us) server_negotiation.cc:299] Negotiation successful
0807 10:37:28.318840 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260807 10:37:28.320050 31187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:37:28.310645 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:37135 (local address 127.20.171.67:55597)
0807 10:37:28.311465 (+ 820us) negotiation.cc:107] Waiting for socket to connect
0807 10:37:28.311503 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0807 10:37:28.312942 (+ 1439us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:37:28.313506 (+ 564us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:37:28.313513 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:37:28.313593 (+ 80us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:37:28.314124 (+ 531us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:28.314138 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:28.315075 (+ 937us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:28.315078 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:28.316211 (+ 1133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:28.316222 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:28.316966 (+ 744us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:28.316970 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:28.317163 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:28.317951 (+ 788us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 10:37:28.317955 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:37:28.318036 (+ 81us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 10:37:28.318129 (+ 93us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:37:28.318512 (+ 383us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:37:28.318520 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:37:28.318544 (+ 24us) client_negotiation.cc:769] Sending connection context
0807 10:37:28.318698 (+ 154us) client_negotiation.cc:240] Negotiation successful
0807 10:37:28.318958 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":421,"thread_start_us":245,"threads_started":1}
I20260807 10:37:28.321331 31184 heartbeater.cc:347] Connected to a master server at 127.20.171.126:37135
I20260807 10:37:28.321620 31184 heartbeater.cc:464] Registering TS with master...
I20260807 10:37:28.322520 31184 heartbeater.cc:511] Master 127.20.171.126:37135 requested a full tablet report, sending...
I20260807 10:37:28.323827 30725 ts_manager.cc:194] Registered new tserver with Master: 27b06a6d4ae3467eb0e5978b7a31685a (127.20.171.67:34253)
I20260807 10:37:28.324654 30725 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.20.171.67:55597
I20260807 10:37:28.333978 21165 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260807 10:37:28.340013 30920 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:37:28.338514 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35190 (local address 127.20.171.126:37135)
0807 10:37:28.338745 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0807 10:37:28.338754 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 10:37:28.339121 (+ 367us) server_negotiation.cc:407] Connection header received
0807 10:37:28.339251 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:37:28.339254 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:37:28.339323 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:37:28.339399 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:37:28.339803 (+ 404us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35190: BlockingRecv error: recv got EOF from 127.0.0.1:35190 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
I20260807 10:37:28.340590 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 30786
I20260807 10:37:28.347714 31194 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:37:28.341495 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58344 (local address 127.20.171.65:37011)
0807 10:37:28.342020 (+ 525us) server_negotiation.cc:206] Beginning negotiation
0807 10:37:28.342026 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:37:28.342049 (+ 23us) server_negotiation.cc:407] Connection header received
0807 10:37:28.342099 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:37:28.342104 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:37:28.342317 (+ 213us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:37:28.342429 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:37:28.342721 (+ 292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:28.343659 (+ 938us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:28.344822 (+ 1163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:28.345392 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:28.345485 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:28.346445 (+ 960us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:37:28.346453 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:37:28.346464 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:37:28.347028 (+ 564us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:37:28.347075 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:37:28.347094 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:37:28.347188 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0807 10:37:28.347305 (+ 117us) server_negotiation.cc:299] Negotiation successful
0807 10:37:28.347424 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":389,"thread_start_us":278,"threads_started":1}
I20260807 10:37:28.348863 30913 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:37:28.429064 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 30786
I20260807 10:37:28.448693 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 30922
I20260807 10:37:28.456135 31196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:37:28.449595 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50778 (local address 127.20.171.66:32819)
0807 10:37:28.450107 (+ 512us) server_negotiation.cc:206] Beginning negotiation
0807 10:37:28.450114 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:37:28.450139 (+ 25us) server_negotiation.cc:407] Connection header received
0807 10:37:28.450203 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:37:28.450209 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:37:28.450415 (+ 206us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:37:28.450550 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:37:28.450910 (+ 360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:28.451920 (+ 1010us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:28.453120 (+ 1200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:28.453626 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:28.453720 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:28.454717 (+ 997us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:37:28.454725 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:37:28.454737 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:37:28.455366 (+ 629us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:37:28.455435 (+ 69us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:37:28.455456 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:37:28.455549 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0807 10:37:28.455723 (+ 174us) server_negotiation.cc:299] Negotiation successful
0807 10:37:28.455824 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":372,"thread_start_us":260,"threads_started":1}
I20260807 10:37:28.457494 31046 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:37:28.535459 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 30922
I20260807 10:37:28.554561 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 31055
I20260807 10:37:28.562903 31198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:37:28.555754 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49058 (local address 127.20.171.67:34253)
0807 10:37:28.556469 (+ 715us) server_negotiation.cc:206] Beginning negotiation
0807 10:37:28.556475 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:37:28.556524 (+ 49us) server_negotiation.cc:407] Connection header received
0807 10:37:28.556587 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:37:28.556594 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:37:28.556822 (+ 228us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:37:28.556952 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:37:28.557368 (+ 416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:28.558410 (+ 1042us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:28.559759 (+ 1349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:28.560333 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:28.560473 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:28.561485 (+ 1012us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:37:28.561493 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:37:28.561505 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:37:28.562165 (+ 660us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:37:28.562212 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:37:28.562230 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:37:28.562317 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0807 10:37:28.562453 (+ 136us) server_negotiation.cc:299] Negotiation successful
0807 10:37:28.562562 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":564,"thread_start_us":344,"threads_started":1}
I20260807 10:37:28.564136 31179 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:37:28.644623 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 31055
I20260807 10:37:28.664646 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 30693
I20260807 10:37:28.665926 30755 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:37:28.769579 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 30693
2026-08-07T10:37:28Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (2387 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-08-07T10:37:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T10:37:28Z Disabled control of system clock
I20260807 10:37:28.858330 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786098956060137-21165-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786098956060137-21165-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786098956060137-21165-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.171.126:37779
--webserver_interface=127.20.171.126
--webserver_port=0
--builtin_ntp_servers=127.20.171.84:45611
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.171.126:37779
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260807 10:37:29.175637 31204 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:37:29.175921 31204 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:37:29.176076 31204 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:37:29.183357 31204 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 10:37:29.183472 31204 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:37:29.183574 31204 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:37:29.183670 31204 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 10:37:29.183753 31204 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 10:37:29.192584 31204 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.171.84:45611
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786098956060137-21165-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786098956060137-21165-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.171.126:37779
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.171.126:37779
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.171.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786098956060137-21165-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:37:29.193856 31204 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:37:29.195618 31204 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:37:29.206744 31209 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:37:29.206810 31212 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:37:29.206837 31210 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:37:29.207949 31204 server_base.cc:1034] running on GCE node
I20260807 10:37:29.208781 31204 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:37:29.210044 31204 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:37:29.211270 31204 hybrid_clock.cc:648] HybridClock initialized: now 1786099049211237 us; error 39 us; skew 500 ppm
I20260807 10:37:29.211591 31204 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 10:37:29.213706 31204 webserver.cc:460] Webserver started at http://127.20.171.126:32831/ using document root <none> and password file <none>
I20260807 10:37:29.214346 31204 fs_manager.cc:359] Metadata directory not provided
I20260807 10:37:29.214471 31204 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:37:29.214782 31204 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:37:29.217728 31204 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786098956060137-21165-0/minicluster-data/master-0/data/instance:
uuid: "71c47db1827e4bcd9bf4e0642c0af2d8"
format_stamp: "Formatted at 2026-08-07 10:37:29 on dist-test-slave-0b58"
server_key: "2690b5e1e9b6d22353ecb0b53ac48fdb"
server_key_iv: "9ccf5f1879122d0d1dedb29a02ffa6ae"
server_key_version: "encryptionkey@0"
I20260807 10:37:29.218526 31204 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786098956060137-21165-0/minicluster-data/master-0/wal/instance:
uuid: "71c47db1827e4bcd9bf4e0642c0af2d8"
format_stamp: "Formatted at 2026-08-07 10:37:29 on dist-test-slave-0b58"
server_key: "2690b5e1e9b6d22353ecb0b53ac48fdb"
server_key_iv: "9ccf5f1879122d0d1dedb29a02ffa6ae"
server_key_version: "encryptionkey@0"
I20260807 10:37:29.223351 31204 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.006s
I20260807 10:37:29.226500 31218 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:37:29.227741 31204 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260807 10:37:29.227928 31204 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786098956060137-21165-0/minicluster-data/master-0/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786098956060137-21165-0/minicluster-data/master-0/wal
uuid: "71c47db1827e4bcd9bf4e0642c0af2d8"
format_stamp: "Formatted at 2026-08-07 10:37:29 on dist-test-slave-0b58"
server_key: "2690b5e1e9b6d22353ecb0b53ac48fdb"
server_key_iv: "9ccf5f1879122d0d1dedb29a02ffa6ae"
server_key_version: "encryptionkey@0"
I20260807 10:37:29.228154 31204 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786098956060137-21165-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786098956060137-21165-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786098956060137-21165-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:37:29.235955 31204 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:37:29.237035 31204 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:37:29.237370 31204 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:37:29.256330 31204 rpc_server.cc:307] RPC server started. Bound to: 127.20.171.126:37779
I20260807 10:37:29.256376 31272 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.171.126:37779 every 8 connection(s)
I20260807 10:37:29.257679 31204 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
I20260807 10:37:29.261438 31273 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:37:29.262519 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 31204
I20260807 10:37:29.262784 21165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786098956060137-21165-0/minicluster-data/master-0/wal/instance
I20260807 10:37:29.263409 21165 external_mini_cluster.cc:1428] Setting key 0cba9fcbc39cf80979c69a9f10eea5f1
I20260807 10:37:29.272321 31276 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:37:29.265521 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44282 (local address 127.20.171.126:37779)
0807 10:37:29.266735 (+ 1214us) server_negotiation.cc:206] Beginning negotiation
0807 10:37:29.266753 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0807 10:37:29.266812 (+ 59us) server_negotiation.cc:407] Connection header received
0807 10:37:29.268527 (+ 1715us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:37:29.268557 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:37:29.269042 (+ 485us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:37:29.269465 (+ 423us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:37:29.270415 (+ 950us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:37:29.270421 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:37:29.270435 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:37:29.270455 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:37:29.270531 (+ 76us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:37:29.270551 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:37:29.270747 (+ 196us) server_negotiation.cc:1035] Waiting for connection context
0807 10:37:29.270861 (+ 114us) server_negotiation.cc:299] Negotiation successful
0807 10:37:29.271123 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":718,"thread_start_us":406,"threads_started":1}
I20260807 10:37:29.275321 31273 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 71c47db1827e4bcd9bf4e0642c0af2d8: Bootstrap starting.
I20260807 10:37:29.278244 31273 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 71c47db1827e4bcd9bf4e0642c0af2d8: Neither blocks nor log segments found. Creating new log.
I20260807 10:37:29.279135 31273 log.cc:824] T 00000000000000000000000000000000 P 71c47db1827e4bcd9bf4e0642c0af2d8: Log is configured to *not* fsync() on all Append() calls
I20260807 10:37:29.281983 31273 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 71c47db1827e4bcd9bf4e0642c0af2d8: No bootstrap required, opened a new log
I20260807 10:37:29.294225 31273 raft_consensus.cc:348] T 00000000000000000000000000000000 P 71c47db1827e4bcd9bf4e0642c0af2d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71c47db1827e4bcd9bf4e0642c0af2d8" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 37779 } }
I20260807 10:37:29.294678 31273 raft_consensus.cc:374] T 00000000000000000000000000000000 P 71c47db1827e4bcd9bf4e0642c0af2d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:37:29.294785 31273 raft_consensus.cc:729] T 00000000000000000000000000000000 P 71c47db1827e4bcd9bf4e0642c0af2d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71c47db1827e4bcd9bf4e0642c0af2d8, State: Initialized, Role: FOLLOWER
I20260807 10:37:29.295482 31273 consensus_queue.cc:260] T 00000000000000000000000000000000 P 71c47db1827e4bcd9bf4e0642c0af2d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71c47db1827e4bcd9bf4e0642c0af2d8" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 37779 } }
I20260807 10:37:29.295801 31273 raft_consensus.cc:388] T 00000000000000000000000000000000 P 71c47db1827e4bcd9bf4e0642c0af2d8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 10:37:29.295944 31273 raft_consensus.cc:482] T 00000000000000000000000000000000 P 71c47db1827e4bcd9bf4e0642c0af2d8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 10:37:29.296110 31273 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 71c47db1827e4bcd9bf4e0642c0af2d8 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:37:29.299683 31273 raft_consensus.cc:504] T 00000000000000000000000000000000 P 71c47db1827e4bcd9bf4e0642c0af2d8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71c47db1827e4bcd9bf4e0642c0af2d8" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 37779 } }
I20260807 10:37:29.300320 31273 leader_election.cc:302] T 00000000000000000000000000000000 P 71c47db1827e4bcd9bf4e0642c0af2d8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 71c47db1827e4bcd9bf4e0642c0af2d8; no voters:
I20260807 10:37:29.301033 31273 leader_election.cc:288] T 00000000000000000000000000000000 P 71c47db1827e4bcd9bf4e0642c0af2d8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 10:37:29.301139 31278 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 71c47db1827e4bcd9bf4e0642c0af2d8 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:37:29.302147 31278 raft_consensus.cc:686] T 00000000000000000000000000000000 P 71c47db1827e4bcd9bf4e0642c0af2d8 [term 1 LEADER]: Becoming Leader. State: Replica: 71c47db1827e4bcd9bf4e0642c0af2d8, State: Running, Role: LEADER
I20260807 10:37:29.302721 31278 consensus_queue.cc:237] T 00000000000000000000000000000000 P 71c47db1827e4bcd9bf4e0642c0af2d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71c47db1827e4bcd9bf4e0642c0af2d8" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 37779 } }
I20260807 10:37:29.303668 31273 sys_catalog.cc:564] T 00000000000000000000000000000000 P 71c47db1827e4bcd9bf4e0642c0af2d8 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 10:37:29.305655 31279 sys_catalog.cc:455] T 00000000000000000000000000000000 P 71c47db1827e4bcd9bf4e0642c0af2d8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "71c47db1827e4bcd9bf4e0642c0af2d8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71c47db1827e4bcd9bf4e0642c0af2d8" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 37779 } } }
I20260807 10:37:29.305655 31280 sys_catalog.cc:455] T 00000000000000000000000000000000 P 71c47db1827e4bcd9bf4e0642c0af2d8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 71c47db1827e4bcd9bf4e0642c0af2d8. Latest consensus state: current_term: 1 leader_uuid: "71c47db1827e4bcd9bf4e0642c0af2d8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71c47db1827e4bcd9bf4e0642c0af2d8" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 37779 } } }
I20260807 10:37:29.306032 31279 sys_catalog.cc:458] T 00000000000000000000000000000000 P 71c47db1827e4bcd9bf4e0642c0af2d8 [sys.catalog]: This master's current role is: LEADER
I20260807 10:37:29.306097 31280 sys_catalog.cc:458] T 00000000000000000000000000000000 P 71c47db1827e4bcd9bf4e0642c0af2d8 [sys.catalog]: This master's current role is: LEADER
I20260807 10:37:29.307536 31283 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 10:37:29.312664 31283 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 10:37:29.323799 31283 catalog_manager.cc:1347] Generated new cluster ID: 4b8aee817704442a87c3669929bb65d3
I20260807 10:37:29.323906 31283 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 10:37:29.341042 31283 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 10:37:29.341493 31283 catalog_manager.cc:1504] Loading token signing keys...
I20260807 10:37:29.354046 31283 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 71c47db1827e4bcd9bf4e0642c0af2d8: Generated new TSK 0
I20260807 10:37:29.354831 31283 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 10:37:29.368819 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786098956060137-21165-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786098956060137-21165-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786098956060137-21165-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786098956060137-21165-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.171.65:0
--local_ip_for_outbound_sockets=127.20.171.65
--webserver_interface=127.20.171.65
--webserver_port=0
--tserver_master_addrs=127.20.171.126:37779
--builtin_ntp_servers=127.20.171.84:45611
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260807 10:37:29.722234 31297 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:37:29.722458 31297 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:37:29.722539 31297 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:37:29.729485 31297 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:37:29.729578 31297 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:37:29.729718 31297 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.171.65
I20260807 10:37:29.738631 31297 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.171.84:45611
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786098956060137-21165-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786098956060137-21165-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.171.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786098956060137-21165-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.171.65
--webserver_port=0
--tserver_master_addrs=127.20.171.126:37779
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.171.65
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786098956060137-21165-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:37:29.739800 31297 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:37:29.741557 31297 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:37:29.753520 31302 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:37:29.753494 31305 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:37:29.753552 31303 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:37:29.754623 31297 server_base.cc:1034] running on GCE node
I20260807 10:37:29.755187 31297 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:37:29.756094 31297 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:37:29.757311 31297 hybrid_clock.cc:648] HybridClock initialized: now 1786099049757274 us; error 55 us; skew 500 ppm
I20260807 10:37:29.757623 31297 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 10:37:29.759845 31297 webserver.cc:460] Webserver started at http://127.20.171.65:34683/ using document root <none> and password file <none>
I20260807 10:37:29.760587 31297 fs_manager.cc:359] Metadata directory not provided
I20260807 10:37:29.760710 31297 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:37:29.761015 31297 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:37:29.765525 31297 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786098956060137-21165-0/minicluster-data/ts-0/data/instance:
uuid: "62b1a23e295d4938b52725d428f4b2c7"
format_stamp: "Formatted at 2026-08-07 10:37:29 on dist-test-slave-0b58"
server_key: "6659667da1f8a5582511789763cb65c1"
server_key_iv: "f4f292fcd8b053466f4816e454e0c2a2"
server_key_version: "encryptionkey@0"
I20260807 10:37:29.766337 31297 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786098956060137-21165-0/minicluster-data/ts-0/wal/instance:
uuid: "62b1a23e295d4938b52725d428f4b2c7"
format_stamp: "Formatted at 2026-08-07 10:37:29 on dist-test-slave-0b58"
server_key: "6659667da1f8a5582511789763cb65c1"
server_key_iv: "f4f292fcd8b053466f4816e454e0c2a2"
server_key_version: "encryptionkey@0"
I20260807 10:37:29.771210 31297 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260807 10:37:29.774461 31311 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:37:29.775655 31297 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.001s
I20260807 10:37:29.775840 31297 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786098956060137-21165-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786098956060137-21165-0/minicluster-data/ts-0/wal
uuid: "62b1a23e295d4938b52725d428f4b2c7"
format_stamp: "Formatted at 2026-08-07 10:37:29 on dist-test-slave-0b58"
server_key: "6659667da1f8a5582511789763cb65c1"
server_key_iv: "f4f292fcd8b053466f4816e454e0c2a2"
server_key_version: "encryptionkey@0"
I20260807 10:37:29.776074 31297 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786098956060137-21165-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786098956060137-21165-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786098956060137-21165-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:37:29.781543 31297 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:37:29.782306 31297 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:37:29.782596 31297 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:37:29.783439 31297 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:37:29.784931 31297 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:37:29.785051 31297 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:37:29.785190 31297 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:37:29.785277 31297 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:37:29.817730 31297 rpc_server.cc:307] RPC server started. Bound to: 127.20.171.65:35753
I20260807 10:37:29.817786 31426 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.171.65:35753 every 8 connection(s)
I20260807 10:37:29.819036 31297 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786098956060137-21165-0/minicluster-data/ts-0/data/info.pb
I20260807 10:37:29.822539 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 31297
I20260807 10:37:29.822737 21165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786098956060137-21165-0/minicluster-data/ts-0/wal/instance
I20260807 10:37:29.823563 21165 external_mini_cluster.cc:1428] Setting key 4c734c578bd28f720f3b52bd49e14feb
I20260807 10:37:29.826644 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786098956060137-21165-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786098956060137-21165-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786098956060137-21165-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786098956060137-21165-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.171.66:0
--local_ip_for_outbound_sockets=127.20.171.66
--webserver_interface=127.20.171.66
--webserver_port=0
--tserver_master_addrs=127.20.171.126:37779
--builtin_ntp_servers=127.20.171.84:45611
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260807 10:37:29.827582 31429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:37:29.821489 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.65:38829 (local address 127.20.171.126:37779)
0807 10:37:29.821913 (+ 424us) server_negotiation.cc:206] Beginning negotiation
0807 10:37:29.821917 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 10:37:29.823133 (+ 1216us) server_negotiation.cc:407] Connection header received
0807 10:37:29.825048 (+ 1915us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:37:29.825053 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:37:29.825122 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:37:29.825239 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:37:29.826673 (+ 1434us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:37:29.826678 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:37:29.826681 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:37:29.826697 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:37:29.826770 (+ 73us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:37:29.826791 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:37:29.826932 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0807 10:37:29.827206 (+ 274us) server_negotiation.cc:299] Negotiation successful
0807 10:37:29.827279 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":323,"thread_start_us":235,"threads_started":1}
I20260807 10:37:29.828513 31430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:37:29.821896 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:37779 (local address 127.20.171.65:38829)
0807 10:37:29.822954 (+ 1058us) negotiation.cc:107] Waiting for socket to connect
0807 10:37:29.823006 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0807 10:37:29.824804 (+ 1798us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:37:29.825470 (+ 666us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:37:29.825478 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:37:29.825593 (+ 115us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:37:29.826322 (+ 729us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 10:37:29.826328 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:37:29.826379 (+ 51us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 10:37:29.826491 (+ 112us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:37:29.826983 (+ 492us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:37:29.826992 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:37:29.826998 (+ 6us) client_negotiation.cc:769] Sending connection context
0807 10:37:29.827278 (+ 280us) client_negotiation.cc:240] Negotiation successful
0807 10:37:29.827518 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":508,"thread_start_us":290,"threads_started":1}
I20260807 10:37:29.830015 31427 heartbeater.cc:347] Connected to a master server at 127.20.171.126:37779
I20260807 10:37:29.830312 31427 heartbeater.cc:464] Registering TS with master...
I20260807 10:37:29.830837 31427 heartbeater.cc:511] Master 127.20.171.126:37779 requested a full tablet report, sending...
I20260807 10:37:29.832826 31235 ts_manager.cc:194] Registered new tserver with Master: 62b1a23e295d4938b52725d428f4b2c7 (127.20.171.65:35753)
W20260807 10:37:30.142642 31431 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:37:30.142872 31431 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:37:30.143015 31431 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:37:30.150007 31431 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:37:30.150090 31431 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:37:30.150265 31431 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.171.66
I20260807 10:37:30.158660 31431 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.171.84:45611
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786098956060137-21165-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786098956060137-21165-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.171.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786098956060137-21165-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.171.66
--webserver_port=0
--tserver_master_addrs=127.20.171.126:37779
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.171.66
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786098956060137-21165-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:37:30.159811 31431 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:37:30.161542 31431 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:37:30.173974 31436 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:37:30.173936 31439 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:37:30.174014 31437 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:37:30.177404 31431 server_base.cc:1034] running on GCE node
I20260807 10:37:30.177964 31431 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:37:30.178824 31431 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:37:30.180020 31431 hybrid_clock.cc:648] HybridClock initialized: now 1786099050179968 us; error 46 us; skew 500 ppm
I20260807 10:37:30.180490 31431 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 10:37:30.182690 31431 webserver.cc:460] Webserver started at http://127.20.171.66:35305/ using document root <none> and password file <none>
I20260807 10:37:30.183315 31431 fs_manager.cc:359] Metadata directory not provided
I20260807 10:37:30.183418 31431 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:37:30.183736 31431 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:37:30.186620 31431 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786098956060137-21165-0/minicluster-data/ts-1/data/instance:
uuid: "84bc9b172aa84590998e2bb2d200e06c"
format_stamp: "Formatted at 2026-08-07 10:37:30 on dist-test-slave-0b58"
server_key: "e839bdb98e662cb023bb60dd473236ce"
server_key_iv: "68198bcf537d5f40c554b43a1c66f934"
server_key_version: "encryptionkey@0"
I20260807 10:37:30.187439 31431 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786098956060137-21165-0/minicluster-data/ts-1/wal/instance:
uuid: "84bc9b172aa84590998e2bb2d200e06c"
format_stamp: "Formatted at 2026-08-07 10:37:30 on dist-test-slave-0b58"
server_key: "e839bdb98e662cb023bb60dd473236ce"
server_key_iv: "68198bcf537d5f40c554b43a1c66f934"
server_key_version: "encryptionkey@0"
I20260807 10:37:30.192351 31431 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.006s
I20260807 10:37:30.195345 31445 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:37:30.196604 31431 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 10:37:30.196746 31431 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786098956060137-21165-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786098956060137-21165-0/minicluster-data/ts-1/wal
uuid: "84bc9b172aa84590998e2bb2d200e06c"
format_stamp: "Formatted at 2026-08-07 10:37:30 on dist-test-slave-0b58"
server_key: "e839bdb98e662cb023bb60dd473236ce"
server_key_iv: "68198bcf537d5f40c554b43a1c66f934"
server_key_version: "encryptionkey@0"
I20260807 10:37:30.197006 31431 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786098956060137-21165-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786098956060137-21165-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786098956060137-21165-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:37:30.202239 31431 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:37:30.202916 31431 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:37:30.203166 31431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:37:30.204171 31431 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:37:30.205539 31431 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:37:30.205652 31431 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:37:30.205787 31431 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:37:30.205873 31431 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:37:30.240375 31431 rpc_server.cc:307] RPC server started. Bound to: 127.20.171.66:45651
I20260807 10:37:30.240422 31559 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.171.66:45651 every 8 connection(s)
I20260807 10:37:30.241731 31431 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786098956060137-21165-0/minicluster-data/ts-1/data/info.pb
I20260807 10:37:30.244637 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 31431
I20260807 10:37:30.244822 21165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786098956060137-21165-0/minicluster-data/ts-1/wal/instance
I20260807 10:37:30.245422 21165 external_mini_cluster.cc:1428] Setting key c2139793a44c069a09914af76d181ce4
I20260807 10:37:30.248776 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786098956060137-21165-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786098956060137-21165-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786098956060137-21165-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786098956060137-21165-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.171.67:0
--local_ip_for_outbound_sockets=127.20.171.67
--webserver_interface=127.20.171.67
--webserver_port=0
--tserver_master_addrs=127.20.171.126:37779
--builtin_ntp_servers=127.20.171.84:45611
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260807 10:37:30.250427 31429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:37:30.244197 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.66:48943 (local address 127.20.171.126:37779)
0807 10:37:30.244382 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0807 10:37:30.244386 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 10:37:30.246004 (+ 1618us) server_negotiation.cc:407] Connection header received
0807 10:37:30.248187 (+ 2183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:37:30.248192 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:37:30.248325 (+ 133us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:37:30.248449 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:37:30.249830 (+ 1381us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:37:30.249834 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:37:30.249837 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:37:30.249851 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:37:30.249882 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:37:30.249893 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:37:30.249975 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0807 10:37:30.250193 (+ 218us) server_negotiation.cc:299] Negotiation successful
0807 10:37:30.250238 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260807 10:37:30.251600 31562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:37:30.244884 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:37779 (local address 127.20.171.66:48943)
0807 10:37:30.245860 (+ 976us) negotiation.cc:107] Waiting for socket to connect
0807 10:37:30.245893 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0807 10:37:30.247905 (+ 2012us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:37:30.248718 (+ 813us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:37:30.248728 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:37:30.248857 (+ 129us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:37:30.249513 (+ 656us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 10:37:30.249518 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:37:30.249567 (+ 49us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 10:37:30.249669 (+ 102us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:37:30.249985 (+ 316us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:37:30.249997 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:37:30.250007 (+ 10us) client_negotiation.cc:769] Sending connection context
0807 10:37:30.250269 (+ 262us) client_negotiation.cc:240] Negotiation successful
0807 10:37:30.250491 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":499,"thread_start_us":315,"threads_started":1}
I20260807 10:37:30.252828 31560 heartbeater.cc:347] Connected to a master server at 127.20.171.126:37779
I20260807 10:37:30.253103 31560 heartbeater.cc:464] Registering TS with master...
I20260807 10:37:30.253631 31560 heartbeater.cc:511] Master 127.20.171.126:37779 requested a full tablet report, sending...
I20260807 10:37:30.254886 31235 ts_manager.cc:194] Registered new tserver with Master: 84bc9b172aa84590998e2bb2d200e06c (127.20.171.66:45651)
W20260807 10:37:30.576941 31563 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:37:30.577184 31563 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:37:30.577358 31563 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:37:30.584434 31563 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:37:30.584517 31563 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:37:30.584682 31563 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.171.67
I20260807 10:37:30.593348 31563 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.171.84:45611
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786098956060137-21165-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786098956060137-21165-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.171.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786098956060137-21165-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.171.67
--webserver_port=0
--tserver_master_addrs=127.20.171.126:37779
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.171.67
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786098956060137-21165-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:37:30.594460 31563 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:37:30.595986 31563 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:37:30.608513 31569 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:37:30.608551 31568 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:37:30.608450 31571 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:37:30.609475 31563 server_base.cc:1034] running on GCE node
I20260807 10:37:30.609951 31563 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:37:30.610710 31563 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:37:30.611917 31563 hybrid_clock.cc:648] HybridClock initialized: now 1786099050611881 us; error 46 us; skew 500 ppm
I20260807 10:37:30.612191 31563 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 10:37:30.614420 31563 webserver.cc:460] Webserver started at http://127.20.171.67:39595/ using document root <none> and password file <none>
I20260807 10:37:30.615021 31563 fs_manager.cc:359] Metadata directory not provided
I20260807 10:37:30.615137 31563 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:37:30.615437 31563 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:37:30.618161 31563 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786098956060137-21165-0/minicluster-data/ts-2/data/instance:
uuid: "c9210960ff3046f4b3c1de60d9f7f4a4"
format_stamp: "Formatted at 2026-08-07 10:37:30 on dist-test-slave-0b58"
server_key: "365c1aaaab64d670c8e3f4672739dbe6"
server_key_iv: "8cba066b4c6293ff667a5a32bcc522a6"
server_key_version: "encryptionkey@0"
I20260807 10:37:30.618978 31563 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786098956060137-21165-0/minicluster-data/ts-2/wal/instance:
uuid: "c9210960ff3046f4b3c1de60d9f7f4a4"
format_stamp: "Formatted at 2026-08-07 10:37:30 on dist-test-slave-0b58"
server_key: "365c1aaaab64d670c8e3f4672739dbe6"
server_key_iv: "8cba066b4c6293ff667a5a32bcc522a6"
server_key_version: "encryptionkey@0"
I20260807 10:37:30.623698 31563 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.006s
I20260807 10:37:30.626740 31578 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:37:30.627889 31563 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260807 10:37:30.628051 31563 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786098956060137-21165-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786098956060137-21165-0/minicluster-data/ts-2/wal
uuid: "c9210960ff3046f4b3c1de60d9f7f4a4"
format_stamp: "Formatted at 2026-08-07 10:37:30 on dist-test-slave-0b58"
server_key: "365c1aaaab64d670c8e3f4672739dbe6"
server_key_iv: "8cba066b4c6293ff667a5a32bcc522a6"
server_key_version: "encryptionkey@0"
I20260807 10:37:30.628319 31563 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786098956060137-21165-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786098956060137-21165-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786098956060137-21165-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:37:30.633535 31563 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:37:30.634269 31563 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:37:30.634510 31563 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:37:30.635339 31563 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:37:30.636721 31563 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:37:30.636845 31563 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:37:30.636982 31563 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:37:30.637107 31563 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.001s sys 0.000s
I20260807 10:37:30.668622 31563 rpc_server.cc:307] RPC server started. Bound to: 127.20.171.67:41415
I20260807 10:37:30.668696 31693 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.171.67:41415 every 8 connection(s)
I20260807 10:37:30.669775 31563 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786098956060137-21165-0/minicluster-data/ts-2/data/info.pb
I20260807 10:37:30.670521 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 31563
I20260807 10:37:30.670717 21165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786098956060137-21165-0/minicluster-data/ts-2/wal/instance
I20260807 10:37:30.671223 21165 external_mini_cluster.cc:1428] Setting key 1c763080814efc5ae2c9de4d0d13f1cc
I20260807 10:37:30.677853 31429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:37:30.672336 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.67:55063 (local address 127.20.171.126:37779)
0807 10:37:30.672516 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0807 10:37:30.672521 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:37:30.673898 (+ 1377us) server_negotiation.cc:407] Connection header received
0807 10:37:30.675561 (+ 1663us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:37:30.675567 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:37:30.675649 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:37:30.675774 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:37:30.677092 (+ 1318us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:37:30.677098 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:37:30.677103 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:37:30.677122 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:37:30.677165 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:37:30.677177 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:37:30.677303 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0807 10:37:30.677497 (+ 194us) server_negotiation.cc:299] Negotiation successful
0807 10:37:30.677564 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260807 10:37:30.678709 31696 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:37:30.672872 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:37779 (local address 127.20.171.67:55063)
0807 10:37:30.673769 (+ 897us) negotiation.cc:107] Waiting for socket to connect
0807 10:37:30.673801 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0807 10:37:30.675314 (+ 1513us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:37:30.675984 (+ 670us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:37:30.675991 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:37:30.676066 (+ 75us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:37:30.676812 (+ 746us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 10:37:30.676815 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:37:30.676848 (+ 33us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 10:37:30.676926 (+ 78us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:37:30.677280 (+ 354us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:37:30.677292 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:37:30.677299 (+ 7us) client_negotiation.cc:769] Sending connection context
0807 10:37:30.677584 (+ 285us) client_negotiation.cc:240] Negotiation successful
0807 10:37:30.677816 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":526,"thread_start_us":314,"threads_started":1}
I20260807 10:37:30.679855 31694 heartbeater.cc:347] Connected to a master server at 127.20.171.126:37779
I20260807 10:37:30.680075 31694 heartbeater.cc:464] Registering TS with master...
I20260807 10:37:30.680629 31694 heartbeater.cc:511] Master 127.20.171.126:37779 requested a full tablet report, sending...
I20260807 10:37:30.681896 31235 ts_manager.cc:194] Registered new tserver with Master: c9210960ff3046f4b3c1de60d9f7f4a4 (127.20.171.67:41415)
I20260807 10:37:30.686693 21165 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260807 10:37:30.692564 31429 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:37:30.691017 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39082 (local address 127.20.171.126:37779)
0807 10:37:30.691165 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0807 10:37:30.691169 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 10:37:30.691708 (+ 539us) server_negotiation.cc:407] Connection header received
0807 10:37:30.691840 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:37:30.691843 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:37:30.691886 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:37:30.691960 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:37:30.692320 (+ 360us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39082: BlockingRecv error: recv got EOF from 127.0.0.1:39082 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
I20260807 10:37:30.693058 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 31297
I20260807 10:37:30.696472 31704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:37:30.694212 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47726 (local address 127.20.171.65:35753)
0807 10:37:30.694718 (+ 506us) server_negotiation.cc:206] Beginning negotiation
0807 10:37:30.694726 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 10:37:30.694753 (+ 27us) server_negotiation.cc:407] Connection header received
0807 10:37:30.694838 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:37:30.694846 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:37:30.695023 (+ 177us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:37:30.695139 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:37:30.695894 (+ 755us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:37:30.695899 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:37:30.695906 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:37:30.695922 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:37:30.695954 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:37:30.695968 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:37:30.696061 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0807 10:37:30.696140 (+ 79us) server_negotiation.cc:299] Negotiation successful
0807 10:37:30.696208 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":361,"thread_start_us":249,"threads_started":1}
I20260807 10:37:30.697548 31422 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:37:30.775959 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 31297
I20260807 10:37:30.794833 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 31431
I20260807 10:37:30.798441 31706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:37:30.795743 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60590 (local address 127.20.171.66:45651)
0807 10:37:30.796208 (+ 465us) server_negotiation.cc:206] Beginning negotiation
0807 10:37:30.796215 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:37:30.796239 (+ 24us) server_negotiation.cc:407] Connection header received
0807 10:37:30.796351 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:37:30.796358 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:37:30.796576 (+ 218us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:37:30.796765 (+ 189us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:37:30.797750 (+ 985us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:37:30.797756 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:37:30.797767 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:37:30.797780 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:37:30.797818 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:37:30.797830 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:37:30.797986 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0807 10:37:30.798091 (+ 105us) server_negotiation.cc:299] Negotiation successful
0807 10:37:30.798187 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":338,"thread_start_us":215,"threads_started":1}
I20260807 10:37:30.799628 31555 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:37:30.875319 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 31431
I20260807 10:37:30.895100 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 31563
I20260807 10:37:30.899039 31708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:37:30.895948 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60690 (local address 127.20.171.67:41415)
0807 10:37:30.896566 (+ 618us) server_negotiation.cc:206] Beginning negotiation
0807 10:37:30.896571 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:37:30.896598 (+ 27us) server_negotiation.cc:407] Connection header received
0807 10:37:30.896678 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:37:30.896684 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:37:30.896908 (+ 224us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:37:30.897074 (+ 166us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:37:30.898248 (+ 1174us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:37:30.898254 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:37:30.898265 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:37:30.898280 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:37:30.898315 (+ 35us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:37:30.898328 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:37:30.898531 (+ 203us) server_negotiation.cc:1035] Waiting for connection context
0807 10:37:30.898603 (+ 72us) server_negotiation.cc:299] Negotiation successful
0807 10:37:30.898728 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":490,"thread_start_us":341,"threads_started":1}
I20260807 10:37:30.900213 31689 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:37:30.975505 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 31563
I20260807 10:37:30.993710 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 31204
I20260807 10:37:30.994776 31268 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:37:31.090276 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 31204
2026-08-07T10:37:31Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (2318 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786098956060137-21165-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 10:37:31 dist-test-slave-0b58 krb5kdc[31713](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 10:37:31 dist-test-slave-0b58 krb5kdc[31713](info): set up 2 sockets
Aug 07 10:37:31 dist-test-slave-0b58 krb5kdc[31713](info): commencing operation
krb5kdc: starting...
W20260807 10:37:32.145464 21165 mini_kdc.cc:121] Time spent starting KDC: real 1.012s user 0.004s sys 0.028s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786098956060137-21165-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786098956060137-21165-0/krb5kdc/test-user.keytab.
Aug 07 10:37:32 dist-test-slave-0b58 krb5kdc[31713](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099052, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T10:37:32Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T10:37:32Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.171.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.171.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.171.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.126.keytab.
Entry for principal kudu/127.20.171.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.126.keytab.
I20260807 10:37:32.379760 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786098956060137-21165-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786098956060137-21165-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786098956060137-21165-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.171.126:36631
--webserver_interface=127.20.171.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.126.keytab
--principal=kudu/127.20.171.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.171.84:43649
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.171.126:36631
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786098956060137-21165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786098956060137-21165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786098956060137-21165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:37:32.681397 31726 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:37:32.681670 31726 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:37:32.681826 31726 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:37:32.688583 31726 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 10:37:32.688701 31726 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:37:32.688802 31726 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:37:32.688921 31726 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 10:37:32.688998 31726 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 10:37:32.697830 31726 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.171.84:43649
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786098956060137-21165-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786098956060137-21165-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.171.126:36631
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.126.keytab
--principal=kudu/127.20.171.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.171.126:36631
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.171.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786098956060137-21165-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:37:32.698951 31726 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:37:32.700091 31726 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:37:32.711098 31731 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:37:32.711139 31732 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:37:32.711344 31735 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:37:32.712013 31726 server_base.cc:1034] running on GCE node
I20260807 10:37:32.712713 31726 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:37:32.713908 31726 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:37:32.715119 31726 hybrid_clock.cc:648] HybridClock initialized: now 1786099052715062 us; error 48 us; skew 500 ppm
I20260807 10:37:32.715514 31726 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:37:32 dist-test-slave-0b58 krb5kdc[31713](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099052, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:37:32.722667 31726 init.cc:377] Logged in from keytab as kudu/127.20.171.126@KRBTEST.COM (short username kudu)
I20260807 10:37:32.724023 31726 webserver.cc:460] Webserver started at http://127.20.171.126:38435/ using document root <none> and password file <none>
I20260807 10:37:32.724675 31726 fs_manager.cc:359] Metadata directory not provided
I20260807 10:37:32.724821 31726 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:37:32.725103 31726 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:37:32.727986 31726 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786098956060137-21165-0/minicluster-data/master-0/data/instance:
uuid: "53d1e91327b44d3eac1611fbd501b67f"
format_stamp: "Formatted at 2026-08-07 10:37:32 on dist-test-slave-0b58"
server_key: "166d31b964bcf772b097ec9ba1d83c8b"
server_key_iv: "0ea416b428e8fe027eeb5d934d6849e5"
server_key_version: "encryptionkey@0"
I20260807 10:37:32.728722 31726 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786098956060137-21165-0/minicluster-data/master-0/wal/instance:
uuid: "53d1e91327b44d3eac1611fbd501b67f"
format_stamp: "Formatted at 2026-08-07 10:37:32 on dist-test-slave-0b58"
server_key: "166d31b964bcf772b097ec9ba1d83c8b"
server_key_iv: "0ea416b428e8fe027eeb5d934d6849e5"
server_key_version: "encryptionkey@0"
I20260807 10:37:32.733258 31726 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260807 10:37:32.736239 31742 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:37:32.737457 31726 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260807 10:37:32.737634 31726 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786098956060137-21165-0/minicluster-data/master-0/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786098956060137-21165-0/minicluster-data/master-0/wal
uuid: "53d1e91327b44d3eac1611fbd501b67f"
format_stamp: "Formatted at 2026-08-07 10:37:32 on dist-test-slave-0b58"
server_key: "166d31b964bcf772b097ec9ba1d83c8b"
server_key_iv: "0ea416b428e8fe027eeb5d934d6849e5"
server_key_version: "encryptionkey@0"
I20260807 10:37:32.737881 31726 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786098956060137-21165-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786098956060137-21165-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786098956060137-21165-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:37:32.766961 31726 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:37:32.771006 31726 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:37:32.771258 31726 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:37:32.788857 31726 rpc_server.cc:307] RPC server started. Bound to: 127.20.171.126:36631
I20260807 10:37:32.788957 31795 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.171.126:36631 every 8 connection(s)
I20260807 10:37:32.790103 31726 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
I20260807 10:37:32.793423 31796 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:37:32.798862 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 31726
I20260807 10:37:32.799069 21165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786098956060137-21165-0/minicluster-data/master-0/wal/instance
I20260807 10:37:32.799672 21165 external_mini_cluster.cc:1428] Setting key 3c471b934e96dd589abdc6b18bf216a1
I20260807 10:37:32.802749 31796 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 53d1e91327b44d3eac1611fbd501b67f: Bootstrap starting.
I20260807 10:37:32.805922 31796 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 53d1e91327b44d3eac1611fbd501b67f: Neither blocks nor log segments found. Creating new log.
I20260807 10:37:32.807039 31796 log.cc:824] T 00000000000000000000000000000000 P 53d1e91327b44d3eac1611fbd501b67f: Log is configured to *not* fsync() on all Append() calls
I20260807 10:37:32.809959 31796 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 53d1e91327b44d3eac1611fbd501b67f: No bootstrap required, opened a new log
Aug 07 10:37:32 dist-test-slave-0b58 krb5kdc[31713](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099052, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.171.126@KRBTEST.COM
I20260807 10:37:32.818240 31796 raft_consensus.cc:348] T 00000000000000000000000000000000 P 53d1e91327b44d3eac1611fbd501b67f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "53d1e91327b44d3eac1611fbd501b67f" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 36631 } }
I20260807 10:37:32.818576 31796 raft_consensus.cc:374] T 00000000000000000000000000000000 P 53d1e91327b44d3eac1611fbd501b67f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:37:32.818693 31796 raft_consensus.cc:729] T 00000000000000000000000000000000 P 53d1e91327b44d3eac1611fbd501b67f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53d1e91327b44d3eac1611fbd501b67f, State: Initialized, Role: FOLLOWER
I20260807 10:37:32.819278 31796 consensus_queue.cc:260] T 00000000000000000000000000000000 P 53d1e91327b44d3eac1611fbd501b67f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "53d1e91327b44d3eac1611fbd501b67f" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 36631 } }
I20260807 10:37:32.819532 31796 raft_consensus.cc:388] T 00000000000000000000000000000000 P 53d1e91327b44d3eac1611fbd501b67f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 10:37:32.819661 31796 raft_consensus.cc:482] T 00000000000000000000000000000000 P 53d1e91327b44d3eac1611fbd501b67f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 10:37:32.819834 31796 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 53d1e91327b44d3eac1611fbd501b67f [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:37:32.820832 31799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:37:32.801417 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41738 (local address 127.20.171.126:36631)
0807 10:37:32.802193 (+ 776us) server_negotiation.cc:206] Beginning negotiation
0807 10:37:32.802203 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 10:37:32.802236 (+ 33us) server_negotiation.cc:407] Connection header received
0807 10:37:32.803820 (+ 1584us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:37:32.803841 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:37:32.804144 (+ 303us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:37:32.804485 (+ 341us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:37:32.806392 (+ 1907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:32.807705 (+ 1313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:32.809145 (+ 1440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:32.810129 (+ 984us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:32.810320 (+ 191us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:32.814130 (+ 3810us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:37:32.814136 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:37:32.814150 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:37:32.814188 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:37:32.816912 (+ 2724us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:37:32.817696 (+ 784us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:37:32.817702 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:37:32.817707 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:37:32.817846 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:37:32.818221 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:37:32.818227 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:37:32.818229 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:37:32.818812 (+ 583us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:37:32.819115 (+ 303us) server_negotiation.cc:1035] Waiting for connection context
0807 10:37:32.819365 (+ 250us) server_negotiation.cc:299] Negotiation successful
0807 10:37:32.819867 (+ 502us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":588,"thread_start_us":385,"threads_started":1}
I20260807 10:37:32.822207 31796 raft_consensus.cc:504] T 00000000000000000000000000000000 P 53d1e91327b44d3eac1611fbd501b67f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "53d1e91327b44d3eac1611fbd501b67f" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 36631 } }
I20260807 10:37:32.822708 31796 leader_election.cc:302] T 00000000000000000000000000000000 P 53d1e91327b44d3eac1611fbd501b67f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 53d1e91327b44d3eac1611fbd501b67f; no voters:
I20260807 10:37:32.823367 31796 leader_election.cc:288] T 00000000000000000000000000000000 P 53d1e91327b44d3eac1611fbd501b67f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 10:37:32.823447 31801 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 53d1e91327b44d3eac1611fbd501b67f [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:37:32.824182 31801 raft_consensus.cc:686] T 00000000000000000000000000000000 P 53d1e91327b44d3eac1611fbd501b67f [term 1 LEADER]: Becoming Leader. State: Replica: 53d1e91327b44d3eac1611fbd501b67f, State: Running, Role: LEADER
I20260807 10:37:32.824673 31801 consensus_queue.cc:237] T 00000000000000000000000000000000 P 53d1e91327b44d3eac1611fbd501b67f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "53d1e91327b44d3eac1611fbd501b67f" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 36631 } }
I20260807 10:37:32.825280 31796 sys_catalog.cc:564] T 00000000000000000000000000000000 P 53d1e91327b44d3eac1611fbd501b67f [sys.catalog]: configured and running, proceeding with master startup.
I20260807 10:37:32.828310 31803 sys_catalog.cc:455] T 00000000000000000000000000000000 P 53d1e91327b44d3eac1611fbd501b67f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 53d1e91327b44d3eac1611fbd501b67f. Latest consensus state: current_term: 1 leader_uuid: "53d1e91327b44d3eac1611fbd501b67f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "53d1e91327b44d3eac1611fbd501b67f" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 36631 } } }
I20260807 10:37:32.828111 31802 sys_catalog.cc:455] T 00000000000000000000000000000000 P 53d1e91327b44d3eac1611fbd501b67f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "53d1e91327b44d3eac1611fbd501b67f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "53d1e91327b44d3eac1611fbd501b67f" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 36631 } } }
I20260807 10:37:32.828886 31802 sys_catalog.cc:458] T 00000000000000000000000000000000 P 53d1e91327b44d3eac1611fbd501b67f [sys.catalog]: This master's current role is: LEADER
I20260807 10:37:32.828882 31803 sys_catalog.cc:458] T 00000000000000000000000000000000 P 53d1e91327b44d3eac1611fbd501b67f [sys.catalog]: This master's current role is: LEADER
I20260807 10:37:32.829867 31810 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 10:37:32.834699 31810 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 10:37:32.842717 31810 catalog_manager.cc:1347] Generated new cluster ID: 32e751ff9d8e4ef0ad5da32f3f9add46
I20260807 10:37:32.842801 31810 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 10:37:32.861884 31810 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 10:37:32.862946 31810 catalog_manager.cc:1504] Loading token signing keys...
I20260807 10:37:32.872642 31810 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 53d1e91327b44d3eac1611fbd501b67f: Generated new TSK 0
I20260807 10:37:32.873265 31810 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.171.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.171.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.171.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.65.keytab.
Entry for principal kudu/127.20.171.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.65.keytab.
I20260807 10:37:32.949535 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786098956060137-21165-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786098956060137-21165-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786098956060137-21165-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786098956060137-21165-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.171.65:0
--local_ip_for_outbound_sockets=127.20.171.65
--webserver_interface=127.20.171.65
--webserver_port=0
--tserver_master_addrs=127.20.171.126:36631
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.65.keytab
--principal=kudu/127.20.171.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.171.84:43649
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786098956060137-21165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786098956060137-21165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786098956060137-21165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:37:33.257772 31822 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:37:33.258014 31822 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:37:33.258173 31822 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:37:33.265319 31822 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:37:33.265424 31822 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:37:33.265650 31822 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.171.65
I20260807 10:37:33.274948 31822 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.171.84:43649
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786098956060137-21165-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786098956060137-21165-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.65.keytab
--principal=kudu/127.20.171.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.171.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786098956060137-21165-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.171.65
--webserver_port=0
--tserver_master_addrs=127.20.171.126:36631
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.171.65
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786098956060137-21165-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:37:33.276088 31822 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:37:33.277372 31822 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:37:33.290066 31828 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:37:33.290130 31827 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:37:33.290364 31830 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:37:33.291003 31822 server_base.cc:1034] running on GCE node
I20260807 10:37:33.291646 31822 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:37:33.292546 31822 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:37:33.293768 31822 hybrid_clock.cc:648] HybridClock initialized: now 1786099053293699 us; error 45 us; skew 500 ppm
I20260807 10:37:33.294020 31822 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:37:33 dist-test-slave-0b58 krb5kdc[31713](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099053, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:37:33.297021 31822 init.cc:377] Logged in from keytab as kudu/127.20.171.65@KRBTEST.COM (short username kudu)
I20260807 10:37:33.298286 31822 webserver.cc:460] Webserver started at http://127.20.171.65:43269/ using document root <none> and password file <none>
I20260807 10:37:33.298877 31822 fs_manager.cc:359] Metadata directory not provided
I20260807 10:37:33.298969 31822 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:37:33.299273 31822 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:37:33.301975 31822 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786098956060137-21165-0/minicluster-data/ts-0/data/instance:
uuid: "8bfc102604184050a09029363d18c2ec"
format_stamp: "Formatted at 2026-08-07 10:37:33 on dist-test-slave-0b58"
server_key: "0c82f8ff73eb689020e6b5809c789a8d"
server_key_iv: "a7a9f0530e1967703aabef04ef5fd316"
server_key_version: "encryptionkey@0"
I20260807 10:37:33.302637 31822 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786098956060137-21165-0/minicluster-data/ts-0/wal/instance:
uuid: "8bfc102604184050a09029363d18c2ec"
format_stamp: "Formatted at 2026-08-07 10:37:33 on dist-test-slave-0b58"
server_key: "0c82f8ff73eb689020e6b5809c789a8d"
server_key_iv: "a7a9f0530e1967703aabef04ef5fd316"
server_key_version: "encryptionkey@0"
I20260807 10:37:33.307353 31822 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260807 10:37:33.310606 31837 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:37:33.311793 31822 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 10:37:33.311925 31822 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786098956060137-21165-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786098956060137-21165-0/minicluster-data/ts-0/wal
uuid: "8bfc102604184050a09029363d18c2ec"
format_stamp: "Formatted at 2026-08-07 10:37:33 on dist-test-slave-0b58"
server_key: "0c82f8ff73eb689020e6b5809c789a8d"
server_key_iv: "a7a9f0530e1967703aabef04ef5fd316"
server_key_version: "encryptionkey@0"
I20260807 10:37:33.312072 31822 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786098956060137-21165-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786098956060137-21165-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786098956060137-21165-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:37:33.335284 31822 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:37:33.339342 31822 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:37:33.339630 31822 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:37:33.340497 31822 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:37:33.341787 31822 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:37:33.341863 31822 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:37:33.342017 31822 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:37:33.342087 31822 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:37:33.373878 31822 rpc_server.cc:307] RPC server started. Bound to: 127.20.171.65:45279
I20260807 10:37:33.373970 31952 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.171.65:45279 every 8 connection(s)
I20260807 10:37:33.375092 31822 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786098956060137-21165-0/minicluster-data/ts-0/data/info.pb
I20260807 10:37:33.380522 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 31822
I20260807 10:37:33.380765 21165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786098956060137-21165-0/minicluster-data/ts-0/wal/instance
I20260807 10:37:33.381603 21165 external_mini_cluster.cc:1428] Setting key 26a8d2d559c142ba0acc9faab652b0a7
Aug 07 10:37:33 dist-test-slave-0b58 krb5kdc[31713](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099053, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.65@KRBTEST.COM for kudu/127.20.171.126@KRBTEST.COM
I20260807 10:37:33.396106 31955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:37:33.377337 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.65:59813 (local address 127.20.171.126:36631)
0807 10:37:33.377778 (+ 441us) server_negotiation.cc:206] Beginning negotiation
0807 10:37:33.377783 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:37:33.378588 (+ 805us) server_negotiation.cc:407] Connection header received
0807 10:37:33.380405 (+ 1817us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:37:33.380409 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:37:33.380471 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:37:33.380557 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:37:33.382540 (+ 1983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:33.383500 (+ 960us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:33.385812 (+ 2312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:33.386224 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:33.386324 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:33.390295 (+ 3971us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:37:33.390300 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:37:33.390303 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:37:33.390333 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:37:33.393161 (+ 2828us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:37:33.393873 (+ 712us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:37:33.393879 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:37:33.393884 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:37:33.394002 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:37:33.394428 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:37:33.394433 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:37:33.394436 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:37:33.394692 (+ 256us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:37:33.394875 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0807 10:37:33.395524 (+ 649us) server_negotiation.cc:299] Negotiation successful
0807 10:37:33.395753 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":336,"thread_start_us":254,"threads_started":1}
I20260807 10:37:33.396953 31956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:37:33.377705 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:36631 (local address 127.20.171.65:59813)
0807 10:37:33.378431 (+ 726us) negotiation.cc:107] Waiting for socket to connect
0807 10:37:33.378466 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0807 10:37:33.380107 (+ 1641us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:37:33.380838 (+ 731us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:37:33.380850 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:37:33.381567 (+ 717us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:37:33.382333 (+ 766us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:33.382353 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:33.383681 (+ 1328us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:33.383688 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:33.385656 (+ 1968us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:33.385674 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:33.386443 (+ 769us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:33.386449 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:33.386739 (+ 290us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:33.387456 (+ 717us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:37:33.387489 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:37:33.390084 (+ 2595us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:37:33.393305 (+ 3221us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:37:33.393313 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:37:33.393327 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:37:33.393746 (+ 419us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:37:33.394116 (+ 370us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:37:33.394121 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:37:33.394125 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:37:33.394306 (+ 181us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:37:33.394832 (+ 526us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:37:33.394840 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:37:33.395160 (+ 320us) client_negotiation.cc:769] Sending connection context
0807 10:37:33.395409 (+ 249us) client_negotiation.cc:240] Negotiation successful
0807 10:37:33.395901 (+ 492us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":516,"thread_start_us":316,"threads_started":1}
I20260807 10:37:33.398393 31953 heartbeater.cc:347] Connected to a master server at 127.20.171.126:36631
I20260807 10:37:33.398716 31953 heartbeater.cc:464] Registering TS with master...
I20260807 10:37:33.399526 31953 heartbeater.cc:511] Master 127.20.171.126:36631 requested a full tablet report, sending...
I20260807 10:37:33.401679 31759 ts_manager.cc:194] Registered new tserver with Master: 8bfc102604184050a09029363d18c2ec (127.20.171.65:45279)
I20260807 10:37:33.403093 31759 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.171.65@KRBTEST.COM'} at 127.20.171.65:59813
WARNING: no policy specified for kudu/127.20.171.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.171.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.171.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.66.keytab.
Entry for principal kudu/127.20.171.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.66.keytab.
I20260807 10:37:33.444895 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786098956060137-21165-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786098956060137-21165-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786098956060137-21165-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786098956060137-21165-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.171.66:0
--local_ip_for_outbound_sockets=127.20.171.66
--webserver_interface=127.20.171.66
--webserver_port=0
--tserver_master_addrs=127.20.171.126:36631
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.66.keytab
--principal=kudu/127.20.171.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.171.84:43649
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786098956060137-21165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786098956060137-21165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786098956060137-21165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:37:33.770855 31959 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:37:33.771102 31959 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:37:33.771261 31959 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:37:33.778213 31959 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:37:33.778306 31959 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:37:33.778466 31959 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.171.66
I20260807 10:37:33.787367 31959 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.171.84:43649
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786098956060137-21165-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786098956060137-21165-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.66.keytab
--principal=kudu/127.20.171.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.171.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786098956060137-21165-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.171.66
--webserver_port=0
--tserver_master_addrs=127.20.171.126:36631
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.171.66
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786098956060137-21165-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:37:33.788606 31959 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:37:33.789790 31959 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:37:33.804514 31964 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:37:33.804590 31965 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:37:33.804622 31967 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:37:33.805238 31959 server_base.cc:1034] running on GCE node
I20260807 10:37:33.805744 31959 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:37:33.806612 31959 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:37:33.807853 31959 hybrid_clock.cc:648] HybridClock initialized: now 1786099053807807 us; error 33 us; skew 500 ppm
I20260807 10:37:33.808171 31959 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:37:33 dist-test-slave-0b58 krb5kdc[31713](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099053, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:37:33.811185 31959 init.cc:377] Logged in from keytab as kudu/127.20.171.66@KRBTEST.COM (short username kudu)
I20260807 10:37:33.812508 31959 webserver.cc:460] Webserver started at http://127.20.171.66:46483/ using document root <none> and password file <none>
I20260807 10:37:33.813087 31959 fs_manager.cc:359] Metadata directory not provided
I20260807 10:37:33.813182 31959 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:37:33.813427 31959 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:37:33.816120 31959 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786098956060137-21165-0/minicluster-data/ts-1/data/instance:
uuid: "9f5560b5da69449fa0097024d3fe8a49"
format_stamp: "Formatted at 2026-08-07 10:37:33 on dist-test-slave-0b58"
server_key: "68efd19d880f504d534fc5407f9e3c42"
server_key_iv: "dd2d63ac871a2561f0ea313c742c48c2"
server_key_version: "encryptionkey@0"
I20260807 10:37:33.816820 31959 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786098956060137-21165-0/minicluster-data/ts-1/wal/instance:
uuid: "9f5560b5da69449fa0097024d3fe8a49"
format_stamp: "Formatted at 2026-08-07 10:37:33 on dist-test-slave-0b58"
server_key: "68efd19d880f504d534fc5407f9e3c42"
server_key_iv: "dd2d63ac871a2561f0ea313c742c48c2"
server_key_version: "encryptionkey@0"
I20260807 10:37:33.821485 31959 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.003s
I20260807 10:37:33.824546 31974 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:37:33.825829 31959 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260807 10:37:33.826011 31959 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786098956060137-21165-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786098956060137-21165-0/minicluster-data/ts-1/wal
uuid: "9f5560b5da69449fa0097024d3fe8a49"
format_stamp: "Formatted at 2026-08-07 10:37:33 on dist-test-slave-0b58"
server_key: "68efd19d880f504d534fc5407f9e3c42"
server_key_iv: "dd2d63ac871a2561f0ea313c742c48c2"
server_key_version: "encryptionkey@0"
I20260807 10:37:33.826205 31959 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786098956060137-21165-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786098956060137-21165-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786098956060137-21165-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:37:33.850332 31959 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:37:33.854637 31959 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:37:33.854853 31959 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:37:33.855580 31959 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:37:33.856829 31959 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:37:33.856900 31959 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:37:33.856997 31959 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:37:33.857041 31959 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:37:33.887992 31959 rpc_server.cc:307] RPC server started. Bound to: 127.20.171.66:33227
I20260807 10:37:33.888082 32088 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.171.66:33227 every 8 connection(s)
I20260807 10:37:33.889173 31959 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786098956060137-21165-0/minicluster-data/ts-1/data/info.pb
I20260807 10:37:33.898134 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 31959
I20260807 10:37:33.898334 21165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786098956060137-21165-0/minicluster-data/ts-1/wal/instance
I20260807 10:37:33.898777 21165 external_mini_cluster.cc:1428] Setting key 42c5fbb7a2257a677965ef6a55b41668
Aug 07 10:37:33 dist-test-slave-0b58 krb5kdc[31713](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099053, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.66@KRBTEST.COM for kudu/127.20.171.126@KRBTEST.COM
I20260807 10:37:33.908128 31955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:37:33.891490 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.66:43613 (local address 127.20.171.126:36631)
0807 10:37:33.891686 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0807 10:37:33.891690 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 10:37:33.892829 (+ 1139us) server_negotiation.cc:407] Connection header received
0807 10:37:33.894520 (+ 1691us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:37:33.894524 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:37:33.894608 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:37:33.894716 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:37:33.896040 (+ 1324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:33.896722 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:33.898448 (+ 1726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:33.898843 (+ 395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:33.898969 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:33.902509 (+ 3540us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:37:33.902514 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:37:33.902517 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:37:33.902555 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:37:33.905032 (+ 2477us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:37:33.905718 (+ 686us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:37:33.905725 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:37:33.905729 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:37:33.905859 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:37:33.906308 (+ 449us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:37:33.906313 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:37:33.906316 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:37:33.906565 (+ 249us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:37:33.906722 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0807 10:37:33.907408 (+ 686us) server_negotiation.cc:299] Negotiation successful
0807 10:37:33.907676 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260807 10:37:33.908766 32091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:37:33.891938 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:36631 (local address 127.20.171.66:43613)
0807 10:37:33.892663 (+ 725us) negotiation.cc:107] Waiting for socket to connect
0807 10:37:33.892704 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0807 10:37:33.894260 (+ 1556us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:37:33.894928 (+ 668us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:37:33.894935 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:37:33.895406 (+ 471us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:37:33.895889 (+ 483us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:33.895904 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:33.896862 (+ 958us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:33.896866 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:33.898308 (+ 1442us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:33.898326 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:33.899075 (+ 749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:33.899083 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:33.899409 (+ 326us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:33.900024 (+ 615us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:37:33.900047 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:37:33.902313 (+ 2266us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:37:33.905169 (+ 2856us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:37:33.905178 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:37:33.905191 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:37:33.905593 (+ 402us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:37:33.905970 (+ 377us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:37:33.905975 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:37:33.905979 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:37:33.906168 (+ 189us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:37:33.906702 (+ 534us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:37:33.906709 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:37:33.907004 (+ 295us) client_negotiation.cc:769] Sending connection context
0807 10:37:33.907262 (+ 258us) client_negotiation.cc:240] Negotiation successful
0807 10:37:33.907712 (+ 450us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":489,"thread_start_us":299,"threads_started":1}
I20260807 10:37:33.910012 32089 heartbeater.cc:347] Connected to a master server at 127.20.171.126:36631
I20260807 10:37:33.910348 32089 heartbeater.cc:464] Registering TS with master...
I20260807 10:37:33.911144 32089 heartbeater.cc:511] Master 127.20.171.126:36631 requested a full tablet report, sending...
I20260807 10:37:33.912601 31759 ts_manager.cc:194] Registered new tserver with Master: 9f5560b5da69449fa0097024d3fe8a49 (127.20.171.66:33227)
I20260807 10:37:33.913350 31759 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.171.66@KRBTEST.COM'} at 127.20.171.66:43613
WARNING: no policy specified for kudu/127.20.171.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.171.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.171.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.67.keytab.
Entry for principal kudu/127.20.171.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.67.keytab.
I20260807 10:37:33.958642 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786098956060137-21165-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786098956060137-21165-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786098956060137-21165-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786098956060137-21165-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.171.67:0
--local_ip_for_outbound_sockets=127.20.171.67
--webserver_interface=127.20.171.67
--webserver_port=0
--tserver_master_addrs=127.20.171.126:36631
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.67.keytab
--principal=kudu/127.20.171.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.171.84:43649
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786098956060137-21165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786098956060137-21165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786098956060137-21165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:37:34.280851 32094 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:37:34.281092 32094 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:37:34.281183 32094 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:37:34.288098 32094 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:37:34.288208 32094 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:37:34.288403 32094 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.171.67
I20260807 10:37:34.297365 32094 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.171.84:43649
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786098956060137-21165-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786098956060137-21165-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.67.keytab
--principal=kudu/127.20.171.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.171.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786098956060137-21165-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.171.67
--webserver_port=0
--tserver_master_addrs=127.20.171.126:36631
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.171.67
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786098956060137-21165-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:37:34.298427 32094 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:37:34.299566 32094 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:37:34.311496 32102 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:37:34.311467 32099 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:37:34.311525 32100 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:37:34.312322 32094 server_base.cc:1034] running on GCE node
I20260807 10:37:34.312904 32094 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:37:34.313706 32094 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:37:34.314973 32094 hybrid_clock.cc:648] HybridClock initialized: now 1786099054314901 us; error 47 us; skew 500 ppm
I20260807 10:37:34.315296 32094 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:37:34 dist-test-slave-0b58 krb5kdc[31713](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099054, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:37:34.318356 32094 init.cc:377] Logged in from keytab as kudu/127.20.171.67@KRBTEST.COM (short username kudu)
I20260807 10:37:34.319599 32094 webserver.cc:460] Webserver started at http://127.20.171.67:34365/ using document root <none> and password file <none>
I20260807 10:37:34.320183 32094 fs_manager.cc:359] Metadata directory not provided
I20260807 10:37:34.320324 32094 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:37:34.320585 32094 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:37:34.323063 32094 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786098956060137-21165-0/minicluster-data/ts-2/data/instance:
uuid: "af77b1eac70746c990e9b303e915f7dc"
format_stamp: "Formatted at 2026-08-07 10:37:34 on dist-test-slave-0b58"
server_key: "da3fdcaf7b823e9c2557235d13fe7482"
server_key_iv: "729aa6875aa078644cb72c87634af207"
server_key_version: "encryptionkey@0"
I20260807 10:37:34.323849 32094 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786098956060137-21165-0/minicluster-data/ts-2/wal/instance:
uuid: "af77b1eac70746c990e9b303e915f7dc"
format_stamp: "Formatted at 2026-08-07 10:37:34 on dist-test-slave-0b58"
server_key: "da3fdcaf7b823e9c2557235d13fe7482"
server_key_iv: "729aa6875aa078644cb72c87634af207"
server_key_version: "encryptionkey@0"
I20260807 10:37:34.328706 32094 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.003s
I20260807 10:37:34.331926 32109 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:37:34.333273 32094 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 10:37:34.333434 32094 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786098956060137-21165-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786098956060137-21165-0/minicluster-data/ts-2/wal
uuid: "af77b1eac70746c990e9b303e915f7dc"
format_stamp: "Formatted at 2026-08-07 10:37:34 on dist-test-slave-0b58"
server_key: "da3fdcaf7b823e9c2557235d13fe7482"
server_key_iv: "729aa6875aa078644cb72c87634af207"
server_key_version: "encryptionkey@0"
I20260807 10:37:34.333627 32094 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786098956060137-21165-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786098956060137-21165-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786098956060137-21165-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:37:34.357793 32094 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:37:34.361055 32094 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:37:34.361316 32094 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:37:34.362138 32094 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:37:34.363305 32094 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:37:34.363399 32094 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:37:34.363533 32094 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:37:34.363601 32094 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:37:34.395247 32094 rpc_server.cc:307] RPC server started. Bound to: 127.20.171.67:32825
I20260807 10:37:34.395321 32223 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.171.67:32825 every 8 connection(s)
I20260807 10:37:34.396327 32094 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786098956060137-21165-0/minicluster-data/ts-2/data/info.pb
I20260807 10:37:34.401206 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 32094
I20260807 10:37:34.401387 21165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786098956060137-21165-0/minicluster-data/ts-2/wal/instance
I20260807 10:37:34.401921 21165 external_mini_cluster.cc:1428] Setting key f015f68551a814b60f7d097739d45ea8
I20260807 10:37:34.406536 31953 heartbeater.cc:503] Master 127.20.171.126:36631 was elected leader, sending a full tablet report...
Aug 07 10:37:34 dist-test-slave-0b58 krb5kdc[31713](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099054, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.67@KRBTEST.COM for kudu/127.20.171.126@KRBTEST.COM
I20260807 10:37:34.414565 31955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:37:34.398816 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.67:43493 (local address 127.20.171.126:36631)
0807 10:37:34.398981 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0807 10:37:34.398985 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 10:37:34.399928 (+ 943us) server_negotiation.cc:407] Connection header received
0807 10:37:34.401622 (+ 1694us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:37:34.401627 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:37:34.401707 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:37:34.401810 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:37:34.403429 (+ 1619us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:34.404295 (+ 866us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:34.405835 (+ 1540us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:34.406222 (+ 387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:34.406354 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:34.409991 (+ 3637us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:37:34.409995 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:37:34.409998 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:37:34.410026 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:37:34.412202 (+ 2176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:37:34.412801 (+ 599us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:37:34.412804 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:37:34.412806 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:37:34.412918 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:37:34.413325 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:37:34.413328 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:37:34.413329 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:37:34.413554 (+ 225us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:37:34.413674 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0807 10:37:34.414188 (+ 514us) server_negotiation.cc:299] Negotiation successful
0807 10:37:34.414328 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260807 10:37:34.415437 32226 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:37:34.399187 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:36631 (local address 127.20.171.67:43493)
0807 10:37:34.399788 (+ 601us) negotiation.cc:107] Waiting for socket to connect
0807 10:37:34.399825 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0807 10:37:34.401291 (+ 1466us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:37:34.401983 (+ 692us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:37:34.401990 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:37:34.402564 (+ 574us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:37:34.403275 (+ 711us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:34.403293 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:34.404455 (+ 1162us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:34.404461 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:34.405717 (+ 1256us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:34.405732 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:34.406417 (+ 685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:34.406422 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:34.406589 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:34.407375 (+ 786us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:37:34.407403 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:37:34.409825 (+ 2422us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:37:34.412350 (+ 2525us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:37:34.412355 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:37:34.412363 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:37:34.412709 (+ 346us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:37:34.413002 (+ 293us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:37:34.413004 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:37:34.413006 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:37:34.413194 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:37:34.413657 (+ 463us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:37:34.413662 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:37:34.413896 (+ 234us) client_negotiation.cc:769] Sending connection context
0807 10:37:34.414085 (+ 189us) client_negotiation.cc:240] Negotiation successful
0807 10:37:34.414388 (+ 303us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":412,"thread_start_us":243,"threads_started":1}
I20260807 10:37:34.416671 32224 heartbeater.cc:347] Connected to a master server at 127.20.171.126:36631
I20260807 10:37:34.416934 32224 heartbeater.cc:464] Registering TS with master...
I20260807 10:37:34.417615 32224 heartbeater.cc:511] Master 127.20.171.126:36631 requested a full tablet report, sending...
I20260807 10:37:34.418870 31759 ts_manager.cc:194] Registered new tserver with Master: af77b1eac70746c990e9b303e915f7dc (127.20.171.67:32825)
I20260807 10:37:34.419528 31759 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.171.67@KRBTEST.COM'} at 127.20.171.67:43493
I20260807 10:37:34.428828 21165 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 10:37:34.444289 31955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:37:34.433552 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41754 (local address 127.20.171.126:36631)
0807 10:37:34.433705 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0807 10:37:34.433709 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 10:37:34.434237 (+ 528us) server_negotiation.cc:407] Connection header received
0807 10:37:34.434353 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:37:34.434357 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:37:34.434404 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:37:34.434484 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:37:34.435619 (+ 1135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:34.436183 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:34.437454 (+ 1271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:34.437850 (+ 396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:34.437939 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:34.439875 (+ 1936us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:37:34.439879 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:37:34.439882 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:37:34.439907 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:37:34.442259 (+ 2352us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:37:34.442847 (+ 588us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:37:34.442850 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:37:34.442852 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:37:34.442956 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:37:34.443266 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:37:34.443269 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:37:34.443271 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:37:34.443505 (+ 234us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:37:34.443667 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0807 10:37:34.443911 (+ 244us) server_negotiation.cc:299] Negotiation successful
0807 10:37:34.444034 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260807 10:37:34.447639 31759 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41754:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 10:37:34.453969 31759 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 10:37:34.475178 32236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:37:34.464128 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.65:45279 (local address 127.0.0.1:53362)
0807 10:37:34.465256 (+ 1128us) negotiation.cc:107] Waiting for socket to connect
0807 10:37:34.465303 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0807 10:37:34.465486 (+ 183us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:37:34.467123 (+ 1637us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:37:34.467133 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:37:34.467171 (+ 38us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:37:34.467709 (+ 538us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:34.467725 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:34.469930 (+ 2205us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:34.469936 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:34.472420 (+ 2484us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:34.472435 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:34.474284 (+ 1849us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:34.474291 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:34.474512 (+ 221us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:34.474548 (+ 36us) client_negotiation.cc:769] Sending connection context
0807 10:37:34.474625 (+ 77us) client_negotiation.cc:240] Negotiation successful
0807 10:37:34.474747 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":874,"mutex_wait_us":2,"thread_start_us":697,"threads_started":1}
I20260807 10:37:34.475889 32239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:37:34.465035 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.66:33227 (local address 127.0.0.1:41754)
0807 10:37:34.468302 (+ 3267us) negotiation.cc:107] Waiting for socket to connect
0807 10:37:34.468321 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 10:37:34.468437 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:37:34.469187 (+ 750us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:37:34.469192 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:37:34.469219 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:37:34.469682 (+ 463us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:34.469695 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:34.471342 (+ 1647us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:34.471349 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:34.473165 (+ 1816us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:34.473179 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:34.474998 (+ 1819us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:34.475004 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:34.475207 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:34.475344 (+ 137us) client_negotiation.cc:769] Sending connection context
0807 10:37:34.475435 (+ 91us) client_negotiation.cc:240] Negotiation successful
0807 10:37:34.475573 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3104,"thread_start_us":2927,"threads_started":1}
I20260807 10:37:34.476011 32237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:37:34.464453 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53362 (local address 127.20.171.65:45279)
0807 10:37:34.466385 (+ 1932us) server_negotiation.cc:206] Beginning negotiation
0807 10:37:34.466394 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 10:37:34.466427 (+ 33us) server_negotiation.cc:407] Connection header received
0807 10:37:34.466543 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:37:34.466554 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:37:34.466825 (+ 271us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:37:34.467973 (+ 1148us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:37:34.468245 (+ 272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:34.469807 (+ 1562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:34.472579 (+ 2772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:34.474029 (+ 1450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:34.475203 (+ 1174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:34.475422 (+ 219us) server_negotiation.cc:1035] Waiting for connection context
0807 10:37:34.475500 (+ 78us) server_negotiation.cc:299] Negotiation successful
0807 10:37:34.475654 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1702,"thread_start_us":1508,"threads_started":1}
I20260807 10:37:34.476349 32238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:37:34.465064 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41754 (local address 127.20.171.66:33227)
0807 10:37:34.468659 (+ 3595us) server_negotiation.cc:206] Beginning negotiation
0807 10:37:34.468668 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 10:37:34.468694 (+ 26us) server_negotiation.cc:407] Connection header received
0807 10:37:34.468786 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:37:34.468792 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:37:34.468981 (+ 189us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:37:34.469693 (+ 712us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:37:34.469966 (+ 273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:34.471220 (+ 1254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:34.473344 (+ 2124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:34.474783 (+ 1439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:34.474912 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:34.475087 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0807 10:37:34.475604 (+ 517us) server_negotiation.cc:299] Negotiation successful
0807 10:37:34.475782 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3418,"thread_start_us":3447,"threads_started":1}
I20260807 10:37:34.478058 32240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:37:34.465627 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.67:32825 (local address 127.0.0.1:60528)
0807 10:37:34.469740 (+ 4113us) negotiation.cc:107] Waiting for socket to connect
0807 10:37:34.469755 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 10:37:34.469850 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:37:34.470729 (+ 879us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:37:34.470733 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:37:34.470756 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:37:34.471209 (+ 453us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:34.471220 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:34.473029 (+ 1809us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:34.473036 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:34.475150 (+ 2114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:34.475168 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:34.477248 (+ 2080us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:34.477255 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:34.477433 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:34.477455 (+ 22us) client_negotiation.cc:769] Sending connection context
0807 10:37:34.477561 (+ 106us) client_negotiation.cc:240] Negotiation successful
0807 10:37:34.477679 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3976,"mutex_wait_us":45,"thread_start_us":3800,"threads_started":1}
I20260807 10:37:34.478088 32241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:37:34.466102 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60528 (local address 127.20.171.67:32825)
0807 10:37:34.469234 (+ 3132us) server_negotiation.cc:206] Beginning negotiation
0807 10:37:34.469243 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 10:37:34.469984 (+ 741us) server_negotiation.cc:407] Connection header received
0807 10:37:34.470078 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:37:34.470086 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:37:34.470263 (+ 177us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:37:34.470430 (+ 167us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:37:34.471403 (+ 973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:34.472887 (+ 1484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:34.475447 (+ 2560us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:34.476980 (+ 1533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:34.477115 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:34.477337 (+ 222us) server_negotiation.cc:1035] Waiting for connection context
0807 10:37:34.477623 (+ 286us) server_negotiation.cc:299] Negotiation successful
0807 10:37:34.477762 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2948,"thread_start_us":2809,"threads_started":1}
I20260807 10:37:34.479672 32022 tablet_service.cc:1467] Processing CreateTablet for tablet f75bef3487d345eba1c0b63397866765 (DEFAULT_TABLE table=test-table [id=16ea5e4ef23a46378dd99313a2659600]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:37:34.479663 31886 tablet_service.cc:1467] Processing CreateTablet for tablet f75bef3487d345eba1c0b63397866765 (DEFAULT_TABLE table=test-table [id=16ea5e4ef23a46378dd99313a2659600]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:37:34.481063 31886 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f75bef3487d345eba1c0b63397866765. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:37:34.481081 32022 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f75bef3487d345eba1c0b63397866765. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:37:34.481343 32157 tablet_service.cc:1467] Processing CreateTablet for tablet f75bef3487d345eba1c0b63397866765 (DEFAULT_TABLE table=test-table [id=16ea5e4ef23a46378dd99313a2659600]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:37:34.482366 32157 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f75bef3487d345eba1c0b63397866765. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:37:34.493330 32242 tablet_bootstrap.cc:492] T f75bef3487d345eba1c0b63397866765 P af77b1eac70746c990e9b303e915f7dc: Bootstrap starting.
I20260807 10:37:34.496475 32242 tablet_bootstrap.cc:654] T f75bef3487d345eba1c0b63397866765 P af77b1eac70746c990e9b303e915f7dc: Neither blocks nor log segments found. Creating new log.
I20260807 10:37:34.497603 32242 log.cc:824] T f75bef3487d345eba1c0b63397866765 P af77b1eac70746c990e9b303e915f7dc: Log is configured to *not* fsync() on all Append() calls
I20260807 10:37:34.498929 32243 tablet_bootstrap.cc:492] T f75bef3487d345eba1c0b63397866765 P 8bfc102604184050a09029363d18c2ec: Bootstrap starting.
I20260807 10:37:34.500722 32242 tablet_bootstrap.cc:492] T f75bef3487d345eba1c0b63397866765 P af77b1eac70746c990e9b303e915f7dc: No bootstrap required, opened a new log
I20260807 10:37:34.500969 32242 ts_tablet_manager.cc:1397] T f75bef3487d345eba1c0b63397866765 P af77b1eac70746c990e9b303e915f7dc: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.005s
I20260807 10:37:34.502368 32243 tablet_bootstrap.cc:654] T f75bef3487d345eba1c0b63397866765 P 8bfc102604184050a09029363d18c2ec: Neither blocks nor log segments found. Creating new log.
I20260807 10:37:34.503134 32244 tablet_bootstrap.cc:492] T f75bef3487d345eba1c0b63397866765 P 9f5560b5da69449fa0097024d3fe8a49: Bootstrap starting.
I20260807 10:37:34.503522 32243 log.cc:824] T f75bef3487d345eba1c0b63397866765 P 8bfc102604184050a09029363d18c2ec: Log is configured to *not* fsync() on all Append() calls
I20260807 10:37:34.506393 32243 tablet_bootstrap.cc:492] T f75bef3487d345eba1c0b63397866765 P 8bfc102604184050a09029363d18c2ec: No bootstrap required, opened a new log
I20260807 10:37:34.506671 32243 ts_tablet_manager.cc:1397] T f75bef3487d345eba1c0b63397866765 P 8bfc102604184050a09029363d18c2ec: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.006s
I20260807 10:37:34.507432 32244 tablet_bootstrap.cc:654] T f75bef3487d345eba1c0b63397866765 P 9f5560b5da69449fa0097024d3fe8a49: Neither blocks nor log segments found. Creating new log.
I20260807 10:37:34.508630 32244 log.cc:824] T f75bef3487d345eba1c0b63397866765 P 9f5560b5da69449fa0097024d3fe8a49: Log is configured to *not* fsync() on all Append() calls
I20260807 10:37:34.509682 32242 raft_consensus.cc:348] T f75bef3487d345eba1c0b63397866765 P af77b1eac70746c990e9b303e915f7dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bfc102604184050a09029363d18c2ec" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 45279 } } peers { permanent_uuid: "af77b1eac70746c990e9b303e915f7dc" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 32825 } } peers { permanent_uuid: "9f5560b5da69449fa0097024d3fe8a49" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 33227 } }
I20260807 10:37:34.510084 32242 raft_consensus.cc:374] T f75bef3487d345eba1c0b63397866765 P af77b1eac70746c990e9b303e915f7dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:37:34.510212 32242 raft_consensus.cc:729] T f75bef3487d345eba1c0b63397866765 P af77b1eac70746c990e9b303e915f7dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af77b1eac70746c990e9b303e915f7dc, State: Initialized, Role: FOLLOWER
I20260807 10:37:34.510782 32242 consensus_queue.cc:260] T f75bef3487d345eba1c0b63397866765 P af77b1eac70746c990e9b303e915f7dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bfc102604184050a09029363d18c2ec" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 45279 } } peers { permanent_uuid: "af77b1eac70746c990e9b303e915f7dc" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 32825 } } peers { permanent_uuid: "9f5560b5da69449fa0097024d3fe8a49" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 33227 } }
I20260807 10:37:34.511405 32244 tablet_bootstrap.cc:492] T f75bef3487d345eba1c0b63397866765 P 9f5560b5da69449fa0097024d3fe8a49: No bootstrap required, opened a new log
I20260807 10:37:34.511636 32244 ts_tablet_manager.cc:1397] T f75bef3487d345eba1c0b63397866765 P 9f5560b5da69449fa0097024d3fe8a49: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.000s
I20260807 10:37:34.511838 32224 heartbeater.cc:503] Master 127.20.171.126:36631 was elected leader, sending a full tablet report...
I20260807 10:37:34.512405 32242 ts_tablet_manager.cc:1428] T f75bef3487d345eba1c0b63397866765 P af77b1eac70746c990e9b303e915f7dc: Time spent starting tablet: real 0.011s user 0.008s sys 0.004s
I20260807 10:37:34.516371 32243 raft_consensus.cc:348] T f75bef3487d345eba1c0b63397866765 P 8bfc102604184050a09029363d18c2ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bfc102604184050a09029363d18c2ec" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 45279 } } peers { permanent_uuid: "af77b1eac70746c990e9b303e915f7dc" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 32825 } } peers { permanent_uuid: "9f5560b5da69449fa0097024d3fe8a49" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 33227 } }
I20260807 10:37:34.516733 32243 raft_consensus.cc:374] T f75bef3487d345eba1c0b63397866765 P 8bfc102604184050a09029363d18c2ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:37:34.516844 32243 raft_consensus.cc:729] T f75bef3487d345eba1c0b63397866765 P 8bfc102604184050a09029363d18c2ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8bfc102604184050a09029363d18c2ec, State: Initialized, Role: FOLLOWER
I20260807 10:37:34.517400 32243 consensus_queue.cc:260] T f75bef3487d345eba1c0b63397866765 P 8bfc102604184050a09029363d18c2ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bfc102604184050a09029363d18c2ec" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 45279 } } peers { permanent_uuid: "af77b1eac70746c990e9b303e915f7dc" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 32825 } } peers { permanent_uuid: "9f5560b5da69449fa0097024d3fe8a49" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 33227 } }
I20260807 10:37:34.518949 32243 ts_tablet_manager.cc:1428] T f75bef3487d345eba1c0b63397866765 P 8bfc102604184050a09029363d18c2ec: Time spent starting tablet: real 0.012s user 0.013s sys 0.000s
I20260807 10:37:34.520970 32244 raft_consensus.cc:348] T f75bef3487d345eba1c0b63397866765 P 9f5560b5da69449fa0097024d3fe8a49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bfc102604184050a09029363d18c2ec" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 45279 } } peers { permanent_uuid: "af77b1eac70746c990e9b303e915f7dc" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 32825 } } peers { permanent_uuid: "9f5560b5da69449fa0097024d3fe8a49" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 33227 } }
I20260807 10:37:34.521355 32244 raft_consensus.cc:374] T f75bef3487d345eba1c0b63397866765 P 9f5560b5da69449fa0097024d3fe8a49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:37:34.521471 32244 raft_consensus.cc:729] T f75bef3487d345eba1c0b63397866765 P 9f5560b5da69449fa0097024d3fe8a49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f5560b5da69449fa0097024d3fe8a49, State: Initialized, Role: FOLLOWER
I20260807 10:37:34.521962 32244 consensus_queue.cc:260] T f75bef3487d345eba1c0b63397866765 P 9f5560b5da69449fa0097024d3fe8a49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bfc102604184050a09029363d18c2ec" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 45279 } } peers { permanent_uuid: "af77b1eac70746c990e9b303e915f7dc" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 32825 } } peers { permanent_uuid: "9f5560b5da69449fa0097024d3fe8a49" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 33227 } }
I20260807 10:37:34.522810 32089 heartbeater.cc:503] Master 127.20.171.126:36631 was elected leader, sending a full tablet report...
I20260807 10:37:34.523124 32244 ts_tablet_manager.cc:1428] T f75bef3487d345eba1c0b63397866765 P 9f5560b5da69449fa0097024d3fe8a49: Time spent starting tablet: real 0.011s user 0.009s sys 0.004s
I20260807 10:37:34.600098 32248 raft_consensus.cc:482] T f75bef3487d345eba1c0b63397866765 P af77b1eac70746c990e9b303e915f7dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 10:37:34.600445 32248 raft_consensus.cc:504] T f75bef3487d345eba1c0b63397866765 P af77b1eac70746c990e9b303e915f7dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bfc102604184050a09029363d18c2ec" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 45279 } } peers { permanent_uuid: "af77b1eac70746c990e9b303e915f7dc" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 32825 } } peers { permanent_uuid: "9f5560b5da69449fa0097024d3fe8a49" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 33227 } }
I20260807 10:37:34.601974 32248 leader_election.cc:288] T f75bef3487d345eba1c0b63397866765 P af77b1eac70746c990e9b303e915f7dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8bfc102604184050a09029363d18c2ec (127.20.171.65:45279), 9f5560b5da69449fa0097024d3fe8a49 (127.20.171.66:33227)
I20260807 10:37:34.608213 32226 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:37:34.602389 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.65:45279 (local address 127.20.171.67:40725)
0807 10:37:34.602793 (+ 404us) negotiation.cc:107] Waiting for socket to connect
0807 10:37:34.602830 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0807 10:37:34.602977 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:37:34.603394 (+ 417us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:37:34.603403 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:37:34.603451 (+ 48us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:37:34.603631 (+ 180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:34.603645 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:34.604816 (+ 1171us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:34.604821 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:34.606153 (+ 1332us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:34.606168 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:34.607505 (+ 1337us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:34.607512 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:34.607716 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:34.607750 (+ 34us) client_negotiation.cc:769] Sending connection context
0807 10:37:34.607842 (+ 92us) client_negotiation.cc:240] Negotiation successful
0807 10:37:34.607976 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":227}
I20260807 10:37:34.608319 32237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:37:34.602444 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.67:40725 (local address 127.20.171.65:45279)
0807 10:37:34.602651 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0807 10:37:34.602657 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:37:34.602923 (+ 266us) server_negotiation.cc:407] Connection header received
0807 10:37:34.603127 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:37:34.603132 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:37:34.603239 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:37:34.603353 (+ 114us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:37:34.603779 (+ 426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:34.604687 (+ 908us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:34.606361 (+ 1674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:34.607354 (+ 993us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:34.607472 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:34.607523 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0807 10:37:34.607887 (+ 364us) server_negotiation.cc:299] Negotiation successful
0807 10:37:34.608018 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260807 10:37:34.608721 32238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:37:34.602434 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.67:47899 (local address 127.20.171.66:33227)
0807 10:37:34.602651 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0807 10:37:34.602657 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:37:34.603361 (+ 704us) server_negotiation.cc:407] Connection header received
0807 10:37:34.603504 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:37:34.603508 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:37:34.603577 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:37:34.603665 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:37:34.604318 (+ 653us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:34.605078 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:34.606864 (+ 1786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:34.607744 (+ 880us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:34.607891 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:34.607955 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0807 10:37:34.608341 (+ 386us) server_negotiation.cc:299] Negotiation successful
0807 10:37:34.608473 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260807 10:37:34.609099 32251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:37:34.602399 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.66:33227 (local address 127.20.171.67:47899)
0807 10:37:34.603240 (+ 841us) negotiation.cc:107] Waiting for socket to connect
0807 10:37:34.603256 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 10:37:34.603381 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:37:34.603701 (+ 320us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:37:34.603704 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:37:34.603746 (+ 42us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:37:34.604131 (+ 385us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:34.604143 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:34.605226 (+ 1083us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:34.605230 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:34.606708 (+ 1478us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:37:34.606726 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:37:34.607960 (+ 1234us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:37:34.607966 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:37:34.608133 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:34.608177 (+ 44us) client_negotiation.cc:769] Sending connection context
0807 10:37:34.608654 (+ 477us) client_negotiation.cc:240] Negotiation successful
0807 10:37:34.608752 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":709,"mutex_wait_us":53,"thread_start_us":412,"threads_started":1}
I20260807 10:37:34.609300 31906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f75bef3487d345eba1c0b63397866765" candidate_uuid: "af77b1eac70746c990e9b303e915f7dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8bfc102604184050a09029363d18c2ec" is_pre_election: true
I20260807 10:37:34.609846 31906 raft_consensus.cc:2454] T f75bef3487d345eba1c0b63397866765 P 8bfc102604184050a09029363d18c2ec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af77b1eac70746c990e9b303e915f7dc in term 0.
I20260807 10:37:34.610049 32042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f75bef3487d345eba1c0b63397866765" candidate_uuid: "af77b1eac70746c990e9b303e915f7dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f5560b5da69449fa0097024d3fe8a49" is_pre_election: true
I20260807 10:37:34.610481 32042 raft_consensus.cc:2454] T f75bef3487d345eba1c0b63397866765 P 9f5560b5da69449fa0097024d3fe8a49 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af77b1eac70746c990e9b303e915f7dc in term 0.
I20260807 10:37:34.610486 32110 leader_election.cc:302] T f75bef3487d345eba1c0b63397866765 P af77b1eac70746c990e9b303e915f7dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8bfc102604184050a09029363d18c2ec, af77b1eac70746c990e9b303e915f7dc; no voters:
I20260807 10:37:34.610874 32248 raft_consensus.cc:2781] T f75bef3487d345eba1c0b63397866765 P af77b1eac70746c990e9b303e915f7dc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 10:37:34.611032 32248 raft_consensus.cc:482] T f75bef3487d345eba1c0b63397866765 P af77b1eac70746c990e9b303e915f7dc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 10:37:34.611157 32248 raft_consensus.cc:3037] T f75bef3487d345eba1c0b63397866765 P af77b1eac70746c990e9b303e915f7dc [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:37:34.613341 32248 raft_consensus.cc:504] T f75bef3487d345eba1c0b63397866765 P af77b1eac70746c990e9b303e915f7dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bfc102604184050a09029363d18c2ec" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 45279 } } peers { permanent_uuid: "af77b1eac70746c990e9b303e915f7dc" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 32825 } } peers { permanent_uuid: "9f5560b5da69449fa0097024d3fe8a49" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 33227 } }
I20260807 10:37:34.613981 32248 leader_election.cc:288] T f75bef3487d345eba1c0b63397866765 P af77b1eac70746c990e9b303e915f7dc [CANDIDATE]: Term 1 election: Requested vote from peers 8bfc102604184050a09029363d18c2ec (127.20.171.65:45279), 9f5560b5da69449fa0097024d3fe8a49 (127.20.171.66:33227)
I20260807 10:37:34.614384 31906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f75bef3487d345eba1c0b63397866765" candidate_uuid: "af77b1eac70746c990e9b303e915f7dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8bfc102604184050a09029363d18c2ec"
I20260807 10:37:34.614398 32042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f75bef3487d345eba1c0b63397866765" candidate_uuid: "af77b1eac70746c990e9b303e915f7dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f5560b5da69449fa0097024d3fe8a49"
I20260807 10:37:34.614576 31906 raft_consensus.cc:3037] T f75bef3487d345eba1c0b63397866765 P 8bfc102604184050a09029363d18c2ec [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:37:34.614581 32042 raft_consensus.cc:3037] T f75bef3487d345eba1c0b63397866765 P 9f5560b5da69449fa0097024d3fe8a49 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:37:34.617128 32042 raft_consensus.cc:2454] T f75bef3487d345eba1c0b63397866765 P 9f5560b5da69449fa0097024d3fe8a49 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af77b1eac70746c990e9b303e915f7dc in term 1.
I20260807 10:37:34.617403 31906 raft_consensus.cc:2454] T f75bef3487d345eba1c0b63397866765 P 8bfc102604184050a09029363d18c2ec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af77b1eac70746c990e9b303e915f7dc in term 1.
I20260807 10:37:34.617508 32112 leader_election.cc:302] T f75bef3487d345eba1c0b63397866765 P af77b1eac70746c990e9b303e915f7dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f5560b5da69449fa0097024d3fe8a49, af77b1eac70746c990e9b303e915f7dc; no voters:
I20260807 10:37:34.617863 32248 raft_consensus.cc:2781] T f75bef3487d345eba1c0b63397866765 P af77b1eac70746c990e9b303e915f7dc [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:37:34.618290 32248 raft_consensus.cc:686] T f75bef3487d345eba1c0b63397866765 P af77b1eac70746c990e9b303e915f7dc [term 1 LEADER]: Becoming Leader. State: Replica: af77b1eac70746c990e9b303e915f7dc, State: Running, Role: LEADER
I20260807 10:37:34.618716 32248 consensus_queue.cc:237] T f75bef3487d345eba1c0b63397866765 P af77b1eac70746c990e9b303e915f7dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bfc102604184050a09029363d18c2ec" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 45279 } } peers { permanent_uuid: "af77b1eac70746c990e9b303e915f7dc" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 32825 } } peers { permanent_uuid: "9f5560b5da69449fa0097024d3fe8a49" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 33227 } }
I20260807 10:37:34.623128 31759 catalog_manager.cc:5495] T f75bef3487d345eba1c0b63397866765 P af77b1eac70746c990e9b303e915f7dc reported cstate change: term changed from 0 to 1, leader changed from <none> to af77b1eac70746c990e9b303e915f7dc (127.20.171.67). New cstate: current_term: 1 leader_uuid: "af77b1eac70746c990e9b303e915f7dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bfc102604184050a09029363d18c2ec" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af77b1eac70746c990e9b303e915f7dc" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 32825 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f5560b5da69449fa0097024d3fe8a49" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 33227 } health_report { overall_health: UNKNOWN } } }
W20260807 10:37:34.627383 31954 tablet.cc:2369] T f75bef3487d345eba1c0b63397866765 P 8bfc102604184050a09029363d18c2ec: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 10:37:34.640924 32090 tablet.cc:2369] T f75bef3487d345eba1c0b63397866765 P 9f5560b5da69449fa0097024d3fe8a49: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 10:37:34.647719 32225 tablet.cc:2369] T f75bef3487d345eba1c0b63397866765 P af77b1eac70746c990e9b303e915f7dc: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 10:37:34.663690 32241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:37:34.659062 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60540 (local address 127.20.171.67:32825)
0807 10:37:34.659236 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0807 10:37:34.659240 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 10:37:34.659385 (+ 145us) server_negotiation.cc:407] Connection header received
0807 10:37:34.659521 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:37:34.659524 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:37:34.659590 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:37:34.659709 (+ 119us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 10:37:34.659986 (+ 277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:34.660746 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:34.661979 (+ 1233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:34.662371 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:34.662453 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:34.662848 (+ 395us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 10:37:34.663266 (+ 418us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 10:37:34.663361 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0807 10:37:34.663439 (+ 78us) server_negotiation.cc:299] Negotiation successful
0807 10:37:34.663496 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260807 10:37:34.671053 32042 raft_consensus.cc:1261] T f75bef3487d345eba1c0b63397866765 P 9f5560b5da69449fa0097024d3fe8a49 [term 1 FOLLOWER]: Refusing update from remote peer af77b1eac70746c990e9b303e915f7dc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 10:37:34.671135 31906 raft_consensus.cc:1261] T f75bef3487d345eba1c0b63397866765 P 8bfc102604184050a09029363d18c2ec [term 1 FOLLOWER]: Refusing update from remote peer af77b1eac70746c990e9b303e915f7dc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 10:37:34.672010 32252 consensus_queue.cc:1035] T f75bef3487d345eba1c0b63397866765 P af77b1eac70746c990e9b303e915f7dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f5560b5da69449fa0097024d3fe8a49" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 33227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 10:37:34.672407 32248 consensus_queue.cc:1035] T f75bef3487d345eba1c0b63397866765 P af77b1eac70746c990e9b303e915f7dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8bfc102604184050a09029363d18c2ec" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 10:37:34.681668 32255 mvcc.cc:205] Tried to move back new op lower bound from 7315861727923924992 to 7315861727721906176. Current Snapshot: MvccSnapshot[applied={T|T < 7315861727923924992}]
I20260807 10:37:34.683887 32257 mvcc.cc:205] Tried to move back new op lower bound from 7315861727923924992 to 7315861727721906176. Current Snapshot: MvccSnapshot[applied={T|T < 7315861727923924992}]
I20260807 10:37:34.702409 31759 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41754:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 10:37:34.702689 31759 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41754:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 10:37:34.705943 31759 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 53d1e91327b44d3eac1611fbd501b67f: Sending DeleteTablet for 3 replicas of tablet f75bef3487d345eba1c0b63397866765
I20260807 10:37:34.707088 31886 tablet_service.cc:1514] Processing DeleteTablet for tablet f75bef3487d345eba1c0b63397866765 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:37:34 UTC) from {username='kudu', principal='kudu/127.20.171.126@KRBTEST.COM'} at 127.0.0.1:53362
I20260807 10:37:34.707111 32157 tablet_service.cc:1514] Processing DeleteTablet for tablet f75bef3487d345eba1c0b63397866765 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:37:34 UTC) from {username='kudu', principal='kudu/127.20.171.126@KRBTEST.COM'} at 127.0.0.1:60528
I20260807 10:37:34.707744 32022 tablet_service.cc:1514] Processing DeleteTablet for tablet f75bef3487d345eba1c0b63397866765 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:37:34 UTC) from {username='kudu', principal='kudu/127.20.171.126@KRBTEST.COM'} at 127.0.0.1:41754
I20260807 10:37:34.708954 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 31822
I20260807 10:37:34.718025 32264 tablet_replica.cc:330] T f75bef3487d345eba1c0b63397866765 P af77b1eac70746c990e9b303e915f7dc: stopping tablet replica
I20260807 10:37:34.718701 32266 tablet_replica.cc:330] T f75bef3487d345eba1c0b63397866765 P 9f5560b5da69449fa0097024d3fe8a49: stopping tablet replica
I20260807 10:37:34.719178 32266 raft_consensus.cc:2229] T f75bef3487d345eba1c0b63397866765 P 9f5560b5da69449fa0097024d3fe8a49 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 10:37:34.719738 32266 raft_consensus.cc:2258] T f75bef3487d345eba1c0b63397866765 P 9f5560b5da69449fa0097024d3fe8a49 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:37:34.721345 32264 raft_consensus.cc:2229] T f75bef3487d345eba1c0b63397866765 P af77b1eac70746c990e9b303e915f7dc [term 1 LEADER]: Raft consensus shutting down.
I20260807 10:37:34.722003 32264 raft_consensus.cc:2258] T f75bef3487d345eba1c0b63397866765 P af77b1eac70746c990e9b303e915f7dc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:37:34.725211 32264 ts_tablet_manager.cc:1905] T f75bef3487d345eba1c0b63397866765 P af77b1eac70746c990e9b303e915f7dc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 10:37:34.725857 32266 ts_tablet_manager.cc:1905] T f75bef3487d345eba1c0b63397866765 P 9f5560b5da69449fa0097024d3fe8a49: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 10:37:34.728681 32265 tablet_replica.cc:330] T f75bef3487d345eba1c0b63397866765 P 8bfc102604184050a09029363d18c2ec: stopping tablet replica
I20260807 10:37:34.729068 32265 raft_consensus.cc:2229] T f75bef3487d345eba1c0b63397866765 P 8bfc102604184050a09029363d18c2ec [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 10:37:34.729617 32265 raft_consensus.cc:2258] T f75bef3487d345eba1c0b63397866765 P 8bfc102604184050a09029363d18c2ec [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:37:34.731887 32265 ts_tablet_manager.cc:1905] T f75bef3487d345eba1c0b63397866765 P 8bfc102604184050a09029363d18c2ec: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 07 10:37:34 dist-test-slave-0b58 krb5kdc[31713](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099052, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.171.65@KRBTEST.COM
I20260807 10:37:34.733470 32266 ts_tablet_manager.cc:1918] T f75bef3487d345eba1c0b63397866765 P 9f5560b5da69449fa0097024d3fe8a49: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 10:37:34.733633 32266 log.cc:1196] T f75bef3487d345eba1c0b63397866765 P 9f5560b5da69449fa0097024d3fe8a49: Deleting WAL directory at /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786098956060137-21165-0/minicluster-data/ts-1/wal/wals/f75bef3487d345eba1c0b63397866765
I20260807 10:37:34.734153 32266 ts_tablet_manager.cc:1939] T f75bef3487d345eba1c0b63397866765 P 9f5560b5da69449fa0097024d3fe8a49: Deleting consensus metadata
I20260807 10:37:34.735364 32264 ts_tablet_manager.cc:1918] T f75bef3487d345eba1c0b63397866765 P af77b1eac70746c990e9b303e915f7dc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 10:37:34.735528 32264 log.cc:1196] T f75bef3487d345eba1c0b63397866765 P af77b1eac70746c990e9b303e915f7dc: Deleting WAL directory at /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786098956060137-21165-0/minicluster-data/ts-2/wal/wals/f75bef3487d345eba1c0b63397866765
I20260807 10:37:34.736138 31745 catalog_manager.cc:4841] TS 9f5560b5da69449fa0097024d3fe8a49 (127.20.171.66:33227): tablet f75bef3487d345eba1c0b63397866765 (table test-table [id=16ea5e4ef23a46378dd99313a2659600]) successfully deleted
I20260807 10:37:34.737159 32264 ts_tablet_manager.cc:1939] T f75bef3487d345eba1c0b63397866765 P af77b1eac70746c990e9b303e915f7dc: Deleting consensus metadata
I20260807 10:37:34.738847 31743 catalog_manager.cc:4841] TS af77b1eac70746c990e9b303e915f7dc (127.20.171.67:32825): tablet f75bef3487d345eba1c0b63397866765 (table test-table [id=16ea5e4ef23a46378dd99313a2659600]) successfully deleted
I20260807 10:37:34.739234 32265 ts_tablet_manager.cc:1918] T f75bef3487d345eba1c0b63397866765 P 8bfc102604184050a09029363d18c2ec: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 10:37:34.739382 32265 log.cc:1196] T f75bef3487d345eba1c0b63397866765 P 8bfc102604184050a09029363d18c2ec: Deleting WAL directory at /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786098956060137-21165-0/minicluster-data/ts-0/wal/wals/f75bef3487d345eba1c0b63397866765
I20260807 10:37:34.739840 32265 ts_tablet_manager.cc:1939] T f75bef3487d345eba1c0b63397866765 P 8bfc102604184050a09029363d18c2ec: Deleting consensus metadata
I20260807 10:37:34.741426 31743 catalog_manager.cc:4841] TS 8bfc102604184050a09029363d18c2ec (127.20.171.65:45279): tablet f75bef3487d345eba1c0b63397866765 (table test-table [id=16ea5e4ef23a46378dd99313a2659600]) successfully deleted
I20260807 10:37:34.741989 32237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:37:34.710662 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53378 (local address 127.20.171.65:45279)
0807 10:37:34.710863 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0807 10:37:34.710871 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 10:37:34.720873 (+ 10002us) server_negotiation.cc:407] Connection header received
0807 10:37:34.721336 (+ 463us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:37:34.721343 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:37:34.721432 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:37:34.721508 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:37:34.723481 (+ 1973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:34.724527 (+ 1046us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:34.727099 (+ 2572us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:34.728072 (+ 973us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:34.728194 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:34.734388 (+ 6194us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:37:34.734402 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:37:34.734417 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:37:34.734459 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:37:34.738516 (+ 4057us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:37:34.739553 (+ 1037us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:37:34.739561 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:37:34.739565 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:37:34.739726 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:37:34.740187 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:37:34.740194 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:37:34.740198 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:37:34.740748 (+ 550us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:37:34.741055 (+ 307us) server_negotiation.cc:1035] Waiting for connection context
0807 10:37:34.741378 (+ 323us) server_negotiation.cc:299] Negotiation successful
0807 10:37:34.741639 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260807 10:37:34.742643 31948 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:37:34.826967 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 31822
I20260807 10:37:34.848316 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 31959
Aug 07 10:37:34 dist-test-slave-0b58 krb5kdc[31713](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099052, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.171.66@KRBTEST.COM
I20260807 10:37:34.862594 32238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:37:34.849199 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41760 (local address 127.20.171.66:33227)
0807 10:37:34.849396 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0807 10:37:34.849401 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:37:34.849420 (+ 19us) server_negotiation.cc:407] Connection header received
0807 10:37:34.849520 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:37:34.849525 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:37:34.849592 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:37:34.849690 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:37:34.850846 (+ 1156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:34.851554 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:34.852761 (+ 1207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:34.853129 (+ 368us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:34.853263 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:34.857161 (+ 3898us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:37:34.857175 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:37:34.857191 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:37:34.857225 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:37:34.859816 (+ 2591us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:37:34.860592 (+ 776us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:37:34.860599 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:37:34.860619 (+ 20us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:37:34.860748 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:37:34.861140 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:37:34.861145 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:37:34.861147 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:37:34.861506 (+ 359us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:37:34.861810 (+ 304us) server_negotiation.cc:1035] Waiting for connection context
0807 10:37:34.862094 (+ 284us) server_negotiation.cc:299] Negotiation successful
0807 10:37:34.862296 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260807 10:37:34.863204 32084 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:37:34.949295 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 31959
I20260807 10:37:34.976236 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 32094
Aug 07 10:37:34 dist-test-slave-0b58 krb5kdc[31713](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099052, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.171.67@KRBTEST.COM
I20260807 10:37:34.992168 32241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:37:34.977164 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60542 (local address 127.20.171.67:32825)
0807 10:37:34.977356 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0807 10:37:34.977361 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:37:34.977382 (+ 21us) server_negotiation.cc:407] Connection header received
0807 10:37:34.977587 (+ 205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:37:34.977593 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:37:34.977702 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:37:34.977821 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:37:34.979244 (+ 1423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:34.980068 (+ 824us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:34.981386 (+ 1318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:37:34.981830 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:37:34.981970 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:37:34.986112 (+ 4142us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:37:34.986122 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:37:34.986144 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:37:34.986198 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:37:34.989190 (+ 2992us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:37:34.990037 (+ 847us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:37:34.990044 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:37:34.990046 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:37:34.990240 (+ 194us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:37:34.990657 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:37:34.990662 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:37:34.990665 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:37:34.991030 (+ 365us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:37:34.991344 (+ 314us) server_negotiation.cc:1035] Waiting for connection context
0807 10:37:34.991626 (+ 282us) server_negotiation.cc:299] Negotiation successful
0807 10:37:34.991841 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260807 10:37:34.992856 32218 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:37:35.105405 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 32094
I20260807 10:37:35.127542 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 31726
I20260807 10:37:35.128705 31791 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:37:35.235199 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 31726
2026-08-07T10:37:35Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (4146 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786098956060137-21165-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 10:37:35 dist-test-slave-0b58 krb5kdc[32274](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 10:37:35 dist-test-slave-0b58 krb5kdc[32274](info): set up 2 sockets
Aug 07 10:37:35 dist-test-slave-0b58 krb5kdc[32274](info): commencing operation
krb5kdc: starting...
W20260807 10:37:36.298172 21165 mini_kdc.cc:121] Time spent starting KDC: real 1.018s user 0.000s sys 0.032s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786098956060137-21165-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786098956060137-21165-0/krb5kdc/test-user.keytab.
Aug 07 10:37:36 dist-test-slave-0b58 krb5kdc[32274](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099056, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T10:37:36Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T10:37:36Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.20.171.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.20.171.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.20.171.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786098956060137-21165-0/krb5kdc/rangeradmin_127.20.171.84@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.20.171.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786098956060137-21165-0/krb5kdc/rangeradmin_127.20.171.84@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.20.171.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.20.171.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.20.171.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786098956060137-21165-0/krb5kdc/rangerlookup_127.20.171.84@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.20.171.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786098956060137-21165-0/krb5kdc/rangerlookup_127.20.171.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.20.171.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.20.171.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.20.171.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786098956060137-21165-0/krb5kdc/HTTP_127.20.171.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.20.171.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786098956060137-21165-0/krb5kdc/HTTP_127.20.171.84@KRBTEST.COM.keytab.
I20260807 10:37:36.621518 21165 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786098956060137-21165-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskXRtsKb/build/asan/bin/postgres/pg_ctl -D /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786098956060137-21165-0/minicluster-data/postgres -l logfile start
2026-08-07 10:37:38.976 UTC [32305] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-07 10:37:38.976 UTC [32305] LOG: listening on IPv4 address "127.20.171.84", port 40371
2026-08-07 10:37:38.980 UTC [32305] LOG: listening on Unix socket "/tmp/.s.PGSQL.40371"
2026-08-07 10:37:38.999 UTC [32308] LOG: database system was shut down at 2026-08-07 10:37:37 UTC
2026-08-07 10:37:39.003 UTC [32305] LOG: database system is ready to accept connections
I20260807 10:37:39.953769 21165 mini_postgres.cc:96] Postgres bound to 40371
2026-08-07 10:37:39.979 UTC [32316] FATAL: database "slave" does not exist
127.20.171.84:40371 - accepting connections
I20260807 10:37:39.980506 21165 mini_ranger.cc:161] Starting Ranger...
I20260807 10:37:40.008946 21165 mini_ranger.cc:84] Created miniranger Postgres user
I20260807 10:37:40.427830 21165 mini_ranger.cc:87] Created ranger Postgres database
I20260807 10:37:40.427980 21165 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786098956060137-21165-0/minicluster-data/ranger-admin
2026-08-07 10:37:40,750 [I] DB FLAVOR :POSTGRES
2026-08-07 10:37:40,750 [I] --------- Verifying Ranger DB connection ---------
2026-08-07 10:37:40,750 [I] Checking connection..
2026-08-07 10:37:40,750 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXRtsKb/build/asan/bin/postgresql.jar:/tmp/dist-test-taskXRtsKb/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.171.84:40371/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-07 10:37:40,997 [I] Checking connection passed.
2026-08-07 10:37:40,997 [I] --------- Verifying version history table ---------
2026-08-07 10:37:40,997 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXRtsKb/build/asan/bin/postgresql.jar:/tmp/dist-test-taskXRtsKb/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.171.84:40371/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-07 10:37:41,213 [I] Table x_db_version_h does not exist in database ranger
2026-08-07 10:37:41,214 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXRtsKb/build/asan/bin/postgresql.jar:/tmp/dist-test-taskXRtsKb/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.171.84:40371/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-07 10:37:41,458 [I] Table x_db_version_h does not exist in database ranger
2026-08-07 10:37:41,458 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-07 10:37:41,458 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXRtsKb/build/asan/bin/postgresql.jar:/tmp/dist-test-taskXRtsKb/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.171.84:40371/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskXRtsKb/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-07 10:37:41.705 UTC [32380] WARNING: there is no transaction in progress
2026-08-07 10:37:41,712 [I] create_dbversion_catalog.sql file imported successfully
2026-08-07 10:37:41,712 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXRtsKb/build/asan/bin/postgresql.jar:/tmp/dist-test-taskXRtsKb/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.171.84:40371/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-07 10:37:41,963 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-07 10:37:41,963 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-07 10:37:41,964 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXRtsKb/build/asan/bin/postgresql.jar:/tmp/dist-test-taskXRtsKb/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.171.84:40371/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-07 10:37:42,209 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXRtsKb/build/asan/bin/postgresql.jar:/tmp/dist-test-taskXRtsKb/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.171.84:40371/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-07 10:37:42,460 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXRtsKb/build/asan/bin/postgresql.jar:/tmp/dist-test-taskXRtsKb/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.171.84:40371/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-0b58.c.gcp-upstream.internal','N') ;"
2026-08-07 10:37:42,683 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXRtsKb/build/asan/bin/postgresql.jar:/tmp/dist-test-taskXRtsKb/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.171.84:40371/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-07 10:37:42,928 [I] Table x_portal_user does not exist in database ranger
2026-08-07 10:37:42,929 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXRtsKb/build/asan/bin/postgresql.jar:/tmp/dist-test-taskXRtsKb/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.171.84:40371/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-07 10:37:43,145 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-07 10:37:43,146 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXRtsKb/build/asan/bin/postgresql.jar:/tmp/dist-test-taskXRtsKb/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.171.84:40371/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-07 10:37:43,386 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXRtsKb/build/asan/bin/postgresql.jar:/tmp/dist-test-taskXRtsKb/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.171.84:40371/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-07 10:37:43,651 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-07 10:37:43,652 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXRtsKb/build/asan/bin/postgresql.jar:/tmp/dist-test-taskXRtsKb/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.171.84:40371/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskXRtsKb/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-07 10:37:44.599 UTC [32490] WARNING: there is no transaction in progress
2026-08-07 10:37:44.614 UTC [32490] WARNING: there is no transaction in progress
2026-08-07 10:37:44.629 UTC [32490] WARNING: there is no transaction in progress
2026-08-07 10:37:44.644 UTC [32490] WARNING: there is no transaction in progress
2026-08-07 10:37:44.662 UTC [32490] WARNING: there is no transaction in progress
2026-08-07 10:37:44.682 UTC [32490] WARNING: there is no transaction in progress
2026-08-07 10:37:44.744 UTC [32490] WARNING: there is no transaction in progress
2026-08-07 10:37:44.750 UTC [32490] WARNING: there is no transaction in progress
2026-08-07 10:37:44.764 UTC [32490] WARNING: there is no transaction in progress
2026-08-07 10:37:44.773 UTC [32490] WARNING: there is no transaction in progress
2026-08-07 10:37:44.783 UTC [32490] WARNING: there is no transaction in progress
2026-08-07 10:37:44.795 UTC [32490] WARNING: there is no transaction in progress
2026-08-07 10:37:44.804 UTC [32490] WARNING: there is no transaction in progress
2026-08-07 10:37:44.810 UTC [32490] WARNING: there is no transaction in progress
2026-08-07 10:37:44.817 UTC [32490] WARNING: there is no transaction in progress
2026-08-07 10:37:44.823 UTC [32490] WARNING: there is no transaction in progress
2026-08-07 10:37:45,405 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-07 10:37:45,406 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXRtsKb/build/asan/bin/postgresql.jar:/tmp/dist-test-taskXRtsKb/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.171.84:40371/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-07 10:37:45,642 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-07 10:37:45,642 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXRtsKb/build/asan/bin/postgresql.jar:/tmp/dist-test-taskXRtsKb/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.171.84:40371/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-07 10:37:45,867 [I] Table x_portal_user already exists in database 'ranger'
2026-08-07 10:37:45,867 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXRtsKb/build/asan/bin/postgresql.jar:/tmp/dist-test-taskXRtsKb/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.171.84:40371/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-07 10:37:46,088 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-07 10:37:46,089 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXRtsKb/build/asan/bin/postgresql.jar:/tmp/dist-test-taskXRtsKb/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.171.84:40371/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-07 10:37:46,335 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXRtsKb/build/asan/bin/postgresql.jar:/tmp/dist-test-taskXRtsKb/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.171.84:40371/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-07 10:37:46,565 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXRtsKb/build/asan/bin/postgresql.jar:/tmp/dist-test-taskXRtsKb/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.171.84:40371/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-0b58.c.gcp-upstream.internal';"
2026-08-07 10:37:46,797 [I] CORE_DB_SCHEMA import status has been updated
2026-08-07 10:37:46,797 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXRtsKb/build/asan/bin/postgresql.jar:/tmp/dist-test-taskXRtsKb/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.171.84:40371/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-07 10:37:47,015 [I] DB_PATCHES have already been applied
I20260807 10:37:47.021745 21165 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786098956060137-21165-0/minicluster-data/ranger-admin:/tmp/dist-test-taskXRtsKb/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskXRtsKb/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskXRtsKb/build/asan/bin/postgresql.jar:/tmp/dist-test-taskXRtsKb/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260807 10:37:47.021842 21165 mini_ranger.cc:193] Using host: 127.20.171.84
I20260807 10:37:47.044507 21165 mini_ranger.cc:227] Ranger admin URL: http://127.20.171.84:34389
Aug 07, 2026 10:37:47 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 07, 2026 10:37:47 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 07, 2026 10:37:47 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786098956060137-21165-0/minicluster-data/ranger-admin/ews/webapp
Aug 07, 2026 10:37:47 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786098956060137-21165-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 07, 2026 10:37:47 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786098956060137-21165-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 07, 2026 10:37:47 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786098956060137-21165-0/minicluster-data/ranger-admin/ews/webapp].
Aug 07, 2026 10:37:47 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260807 10:37:48.153317 21165 mini_ranger.cc:160] Time spent starting Ranger: real 8.173s user 0.001s sys 0.057s
Aug 07, 2026 10:38:08 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 07, 2026 10:38:08 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.UserREST
Aug 07, 2026 10:38:08 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 07, 2026 10:38:08 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 07, 2026 10:38:08 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 07, 2026 10:38:08 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 07, 2026 10:38:08 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 07, 2026 10:38:08 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 07, 2026 10:38:08 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 07, 2026 10:38:08 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 07, 2026 10:38:08 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 07, 2026 10:38:08 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 07, 2026 10:38:08 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 07, 2026 10:38:08 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 07, 2026 10:38:08 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 07, 2026 10:38:08 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 07, 2026 10:38:08 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 07, 2026 10:38:09 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260807 10:38:09.624183 21165 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.20.171.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.20.171.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.20.171.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786098956060137-21165-0/krb5kdc/rangerkms_127.20.171.84@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.20.171.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786098956060137-21165-0/krb5kdc/rangerkms_127.20.171.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.20.171.84@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.20.171.84@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.20.171.84@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786098956060137-21165-0/krb5kdc/HTTP_127.20.171.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.20.171.84@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786098956060137-21165-0/krb5kdc/HTTP_127.20.171.84@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 07 10:38:09 dist-test-slave-0b58 krb5kdc[32274](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099089, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260807 10:38:09.842716 21165 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260807 10:38:09.880177 21165 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260807 10:38:10.687541 21165 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260807 10:38:10.687676 21165 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786098956060137-21165-0/minicluster-data/ranger-kms
I20260807 10:38:10.687813 21165 mini_ranger_kms.cc:227] Using postgres at 127.20.171.84:40371
2026-08-07 10:38:11,172 [I] DB FLAVOR :POSTGRES
2026-08-07 10:38:11,172 [I] --------- Verifying Ranger DB connection ---------
2026-08-07 10:38:11,172 [I] Checking connection
2026-08-07 10:38:11,172 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXRtsKb/build/asan/bin/postgresql.jar:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786098956060137-21165-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.171.84:40371/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-07 10:38:11,420 [I] connection success
2026-08-07 10:38:11,420 [I] --------- Verifying Ranger DB tables ---------
2026-08-07 10:38:11,420 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-07 10:38:11,420 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXRtsKb/build/asan/bin/postgresql.jar:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786098956060137-21165-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.171.84:40371/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-07 10:38:11,641 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-07 10:38:11,641 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-07 10:38:11,641 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-07 10:38:11,641 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXRtsKb/build/asan/bin/postgresql.jar:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786098956060137-21165-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.171.84:40371/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786098956060137-21165-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-07 10:38:11,893 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260807 10:38:12.352030 21165 mini_ranger_kms.cc:310] Created kms service
I20260807 10:38:12.551069 21165 mini_ranger_kms.cc:326] Created kudu user
I20260807 10:38:12.594358 21165 mini_ranger_kms.cc:343] Created rangerkms user
Aug 07 10:38:12 dist-test-slave-0b58 krb5kdc[32274](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099089, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.20.171.84@KRBTEST.COM
I20260807 10:38:12.970714 21165 mini_ranger_kms.cc:384] Added ranger policy
I20260807 10:38:12.971160 21165 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786098956060137-21165-0/minicluster-data/ranger-kms:/tmp/dist-test-taskXRtsKb/build/asan/bin/postgresql.jar:/tmp/dist-test-taskXRtsKb/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskXRtsKb/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260807 10:38:12.971246 21165 mini_ranger_kms.cc:240] Using host: 127.20.171.84
I20260807 10:38:13.007016 21165 mini_ranger_kms.cc:276] Ranger KMS PID: 32672
I20260807 10:38:13.007217 21165 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.20.171.84:46615
Aug 07, 2026 10:38:13 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 07, 2026 10:38:13 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 07, 2026 10:38:14 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786098956060137-21165-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 07, 2026 10:38:14 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786098956060137-21165-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 07, 2026 10:38:14 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786098956060137-21165-0/minicluster-data/ranger-kms/ews/webapp].
Aug 07, 2026 10:38:14 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
I20260807 10:38:15.253877 21165 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.411s user 0.129s sys 0.407s
I20260807 10:38:15.254230 21165 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260807 10:38:15.254448 21165 mini_ranger_kms.cc:401] 127.20.171.84:46615/kms/v1/keys
Aug 07 10:38:15 dist-test-slave-0b58 krb5kdc[32274](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786099095, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.20.171.84@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Aug 07 10:38:15 dist-test-slave-0b58 krb5kdc[32274](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099095, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.20.171.84@KRBTEST.COM for HTTP/127.20.171.84@KRBTEST.COM
Aug 07 10:38:16 dist-test-slave-0b58 krb5kdc[32274](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099095, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.20.171.84@KRBTEST.COM for HTTP/127.20.171.84@KRBTEST.COM
Aug 07 10:38:18 dist-test-slave-0b58 krb5kdc[32274](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099098, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.20.171.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.171.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.171.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.126.keytab.
Entry for principal kudu/127.20.171.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.126.keytab.
I20260807 10:38:18.471324 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786098956060137-21165-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786098956060137-21165-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786098956060137-21165-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.171.126:35877
--webserver_interface=127.20.171.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.126.keytab
--principal=kudu/127.20.171.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.171.84:34297
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.171.126:35877
--ranger_config_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786098956060137-21165-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.20.171.84:46615/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786098956060137-21165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786098956060137-21165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786098956060137-21165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:38:18.987607 32724 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:38:18.987967 32724 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:38:18.988116 32724 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:38:18.997450 32724 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 10:38:18.997604 32724 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:38:18.997704 32724 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:38:18.997826 32724 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 10:38:18.997891 32724 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 10:38:19.010916 32724 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.171.84:34297
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786098956060137-21165-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786098956060137-21165-0/minicluster-data/master-0/wal
--ranger_kms_url=127.20.171.84:46615/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.20.171.126:35877
--ranger_config_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786098956060137-21165-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.126.keytab
--principal=kudu/127.20.171.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.171.126:35877
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.171.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786098956060137-21165-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:38:19.012203 32724 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:38:19.013543 32724 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:38:19.026556 32729 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:38:19.026722 32732 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:38:19.026860 32730 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:38:19.028160 32724 server_base.cc:1034] running on GCE node
I20260807 10:38:19.028962 32724 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:38:19.030594 32724 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:38:19.031909 32724 hybrid_clock.cc:648] HybridClock initialized: now 1786099099031785 us; error 38 us; skew 500 ppm
I20260807 10:38:19.032471 32724 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:38:19 dist-test-slave-0b58 krb5kdc[32274](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099099, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:38:19.041873 32724 init.cc:377] Logged in from keytab as kudu/127.20.171.126@KRBTEST.COM (short username kudu)
I20260807 10:38:19.043586 32724 webserver.cc:460] Webserver started at http://127.20.171.126:39969/ using document root <none> and password file <none>
I20260807 10:38:19.044235 32724 fs_manager.cc:359] Metadata directory not provided
I20260807 10:38:19.044435 32724 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:38:19.044703 32724 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 07 10:38:19 dist-test-slave-0b58 krb5kdc[32274](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099099, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.126@KRBTEST.COM for HTTP/127.20.171.84@KRBTEST.COM
I20260807 10:38:19.104995 32724 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786098956060137-21165-0/minicluster-data/master-0/data/instance:
uuid: "5ba9c7b0139b498c8a21186940b0c6d9"
format_stamp: "Formatted at 2026-08-07 10:38:19 on dist-test-slave-0b58"
server_key: "80f5abe62b34c032e7c48a180629203b"
server_key_iv: "80bec5fc296b2ef5c9899802bdc58446"
server_key_version: "kuduclusterkey@0"
I20260807 10:38:19.105916 32724 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786098956060137-21165-0/minicluster-data/master-0/wal/instance:
uuid: "5ba9c7b0139b498c8a21186940b0c6d9"
format_stamp: "Formatted at 2026-08-07 10:38:19 on dist-test-slave-0b58"
server_key: "80f5abe62b34c032e7c48a180629203b"
server_key_iv: "80bec5fc296b2ef5c9899802bdc58446"
server_key_version: "kuduclusterkey@0"
I20260807 10:38:19.112838 32724 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.002s
I20260807 10:38:19.130323 32739 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:38:19.131785 32724 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 10:38:19.132052 32724 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786098956060137-21165-0/minicluster-data/master-0/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786098956060137-21165-0/minicluster-data/master-0/wal
uuid: "5ba9c7b0139b498c8a21186940b0c6d9"
format_stamp: "Formatted at 2026-08-07 10:38:19 on dist-test-slave-0b58"
server_key: "80f5abe62b34c032e7c48a180629203b"
server_key_iv: "80bec5fc296b2ef5c9899802bdc58446"
server_key_version: "kuduclusterkey@0"
I20260807 10:38:19.132529 32724 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786098956060137-21165-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786098956060137-21165-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786098956060137-21165-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:38:19.151490 32724 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:38:19.155983 32724 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:38:19.156586 32724 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:38:19.195815 32724 rpc_server.cc:307] RPC server started. Bound to: 127.20.171.126:35877
I20260807 10:38:19.195832 323 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.171.126:35877 every 8 connection(s)
I20260807 10:38:19.197628 32724 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
I20260807 10:38:19.202236 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 32724
I20260807 10:38:19.202469 21165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786098956060137-21165-0/minicluster-data/master-0/wal/instance
I20260807 10:38:19.202720 324 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:38:19.203413 21165 external_mini_cluster.cc:1428] Setting key aadf81cc011eea18cdeea0322c030a11
Aug 07 10:38:19 dist-test-slave-0b58 krb5kdc[32274](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099098, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.171.126@KRBTEST.COM
I20260807 10:38:19.218310 324 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5ba9c7b0139b498c8a21186940b0c6d9: Bootstrap starting.
I20260807 10:38:19.223049 324 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5ba9c7b0139b498c8a21186940b0c6d9: Neither blocks nor log segments found. Creating new log.
I20260807 10:38:19.224604 324 log.cc:824] T 00000000000000000000000000000000 P 5ba9c7b0139b498c8a21186940b0c6d9: Log is configured to *not* fsync() on all Append() calls
I20260807 10:38:19.227674 327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:38:19.205877 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54456 (local address 127.20.171.126:35877)
0807 10:38:19.207269 (+ 1392us) server_negotiation.cc:206] Beginning negotiation
0807 10:38:19.207281 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 10:38:19.207344 (+ 63us) server_negotiation.cc:407] Connection header received
0807 10:38:19.209324 (+ 1980us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:38:19.209344 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:38:19.209712 (+ 368us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:38:19.210081 (+ 369us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:38:19.211422 (+ 1341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:38:19.212796 (+ 1374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:38:19.214209 (+ 1413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:38:19.214919 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:38:19.215118 (+ 199us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:38:19.219149 (+ 4031us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:38:19.219158 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:38:19.219170 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:38:19.219211 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:38:19.223523 (+ 4312us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:38:19.224169 (+ 646us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:38:19.224176 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:38:19.224182 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:38:19.224446 (+ 264us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:38:19.224874 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:38:19.224879 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:38:19.224882 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:38:19.225392 (+ 510us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:38:19.225704 (+ 312us) server_negotiation.cc:1035] Waiting for connection context
0807 10:38:19.226240 (+ 536us) server_negotiation.cc:299] Negotiation successful
0807 10:38:19.226595 (+ 355us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1113,"thread_start_us":822,"threads_started":1}
I20260807 10:38:19.228811 324 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5ba9c7b0139b498c8a21186940b0c6d9: No bootstrap required, opened a new log
I20260807 10:38:19.239138 324 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5ba9c7b0139b498c8a21186940b0c6d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ba9c7b0139b498c8a21186940b0c6d9" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 35877 } }
I20260807 10:38:19.239531 324 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5ba9c7b0139b498c8a21186940b0c6d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:38:19.239652 324 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5ba9c7b0139b498c8a21186940b0c6d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ba9c7b0139b498c8a21186940b0c6d9, State: Initialized, Role: FOLLOWER
I20260807 10:38:19.240211 324 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5ba9c7b0139b498c8a21186940b0c6d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ba9c7b0139b498c8a21186940b0c6d9" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 35877 } }
I20260807 10:38:19.240720 324 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5ba9c7b0139b498c8a21186940b0c6d9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 10:38:19.240942 324 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5ba9c7b0139b498c8a21186940b0c6d9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 10:38:19.241093 324 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5ba9c7b0139b498c8a21186940b0c6d9 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:38:19.244035 324 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5ba9c7b0139b498c8a21186940b0c6d9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ba9c7b0139b498c8a21186940b0c6d9" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 35877 } }
I20260807 10:38:19.244555 324 leader_election.cc:302] T 00000000000000000000000000000000 P 5ba9c7b0139b498c8a21186940b0c6d9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5ba9c7b0139b498c8a21186940b0c6d9; no voters:
I20260807 10:38:19.245352 324 leader_election.cc:288] T 00000000000000000000000000000000 P 5ba9c7b0139b498c8a21186940b0c6d9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 10:38:19.245455 329 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5ba9c7b0139b498c8a21186940b0c6d9 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:38:19.246905 329 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5ba9c7b0139b498c8a21186940b0c6d9 [term 1 LEADER]: Becoming Leader. State: Replica: 5ba9c7b0139b498c8a21186940b0c6d9, State: Running, Role: LEADER
I20260807 10:38:19.247640 329 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5ba9c7b0139b498c8a21186940b0c6d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ba9c7b0139b498c8a21186940b0c6d9" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 35877 } }
I20260807 10:38:19.248023 324 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5ba9c7b0139b498c8a21186940b0c6d9 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 10:38:19.252200 330 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5ba9c7b0139b498c8a21186940b0c6d9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5ba9c7b0139b498c8a21186940b0c6d9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ba9c7b0139b498c8a21186940b0c6d9" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 35877 } } }
I20260807 10:38:19.252323 331 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5ba9c7b0139b498c8a21186940b0c6d9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5ba9c7b0139b498c8a21186940b0c6d9. Latest consensus state: current_term: 1 leader_uuid: "5ba9c7b0139b498c8a21186940b0c6d9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ba9c7b0139b498c8a21186940b0c6d9" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 35877 } } }
I20260807 10:38:19.253094 330 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5ba9c7b0139b498c8a21186940b0c6d9 [sys.catalog]: This master's current role is: LEADER
I20260807 10:38:19.253055 331 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5ba9c7b0139b498c8a21186940b0c6d9 [sys.catalog]: This master's current role is: LEADER
I20260807 10:38:19.256022 336 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 10:38:19.262037 336 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 10:38:19.271775 324 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786098956060137-21165-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260807 10:38:19.278832 336 catalog_manager.cc:1347] Generated new cluster ID: c34a8ae97efe4758a3a818e27449fabe
I20260807 10:38:19.279032 336 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 10:38:19.306448 336 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 10:38:19.309185 336 catalog_manager.cc:1504] Loading token signing keys...
I20260807 10:38:19.325518 336 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5ba9c7b0139b498c8a21186940b0c6d9: Generated new TSK 0
I20260807 10:38:19.326960 336 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.171.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.171.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.171.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.65.keytab.
Entry for principal kudu/127.20.171.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.65.keytab.
I20260807 10:38:20.236145 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786098956060137-21165-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786098956060137-21165-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786098956060137-21165-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786098956060137-21165-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.20.171.84:46615/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.171.65:0
--local_ip_for_outbound_sockets=127.20.171.65
--webserver_interface=127.20.171.65
--webserver_port=0
--tserver_master_addrs=127.20.171.126:35877
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.65.keytab
--principal=kudu/127.20.171.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.171.84:34297
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786098956060137-21165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786098956060137-21165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786098956060137-21165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 10:38:20 dist-test-slave-0b58 krb5kdc[32274](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786099100, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260807 10:38:20.789997 370 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:38:20.790565 370 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:38:20.790913 370 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:38:20.807513 370 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:38:20.807765 370 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:38:20.808106 370 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.171.65
I20260807 10:38:20.829746 370 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.171.84:34297
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786098956060137-21165-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786098956060137-21165-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.20.171.84:46615/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.65.keytab
--principal=kudu/127.20.171.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.171.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786098956060137-21165-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.171.65
--webserver_port=0
--tserver_master_addrs=127.20.171.126:35877
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.171.65
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786098956060137-21165-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:38:20.831792 370 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:38:20.834151 370 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:38:20.857687 380 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:38:20.858505 381 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:38:20.867498 383 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:38:20.868055 370 server_base.cc:1034] running on GCE node
I20260807 10:38:20.868922 370 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:38:20.870448 370 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:38:20.871769 370 hybrid_clock.cc:648] HybridClock initialized: now 1786099100871688 us; error 66 us; skew 500 ppm
I20260807 10:38:20.872390 370 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:38:20 dist-test-slave-0b58 krb5kdc[32274](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099100, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:38:20.876977 370 init.cc:377] Logged in from keytab as kudu/127.20.171.65@KRBTEST.COM (short username kudu)
I20260807 10:38:20.879401 370 webserver.cc:460] Webserver started at http://127.20.171.65:35061/ using document root <none> and password file <none>
I20260807 10:38:20.880203 370 fs_manager.cc:359] Metadata directory not provided
I20260807 10:38:20.880460 370 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:38:20.880934 370 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 07 10:38:20 dist-test-slave-0b58 krb5kdc[32274](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099100, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.65@KRBTEST.COM for HTTP/127.20.171.84@KRBTEST.COM
I20260807 10:38:20.903836 370 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786098956060137-21165-0/minicluster-data/ts-0/data/instance:
uuid: "3738bd2ea12248ffa3187b28f7ab20fc"
format_stamp: "Formatted at 2026-08-07 10:38:20 on dist-test-slave-0b58"
server_key: "50ba3ecc7fbb327c7585dea89e65d71d"
server_key_iv: "b8cfd1f091eb564e240ab886e417be76"
server_key_version: "kuduclusterkey@0"
I20260807 10:38:20.905413 370 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786098956060137-21165-0/minicluster-data/ts-0/wal/instance:
uuid: "3738bd2ea12248ffa3187b28f7ab20fc"
format_stamp: "Formatted at 2026-08-07 10:38:20 on dist-test-slave-0b58"
server_key: "50ba3ecc7fbb327c7585dea89e65d71d"
server_key_iv: "b8cfd1f091eb564e240ab886e417be76"
server_key_version: "kuduclusterkey@0"
I20260807 10:38:20.915598 370 fs_manager.cc:691] Time spent creating directory manager: real 0.009s user 0.009s sys 0.001s
I20260807 10:38:20.947512 390 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:38:20.949673 370 fs_manager.cc:725] Time spent opening block manager: real 0.016s user 0.010s sys 0.005s
I20260807 10:38:20.949971 370 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786098956060137-21165-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786098956060137-21165-0/minicluster-data/ts-0/wal
uuid: "3738bd2ea12248ffa3187b28f7ab20fc"
format_stamp: "Formatted at 2026-08-07 10:38:20 on dist-test-slave-0b58"
server_key: "50ba3ecc7fbb327c7585dea89e65d71d"
server_key_iv: "b8cfd1f091eb564e240ab886e417be76"
server_key_version: "kuduclusterkey@0"
I20260807 10:38:20.950412 370 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786098956060137-21165-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786098956060137-21165-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786098956060137-21165-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:38:21.006728 370 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:38:21.015223 370 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:38:21.016062 370 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:38:21.018177 370 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:38:21.021587 370 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:38:21.021834 370 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.001s
I20260807 10:38:21.022239 370 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:38:21.022468 370 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 07 10:38:21 dist-test-slave-0b58 krb5kdc[32274](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099100, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.126@KRBTEST.COM for HTTP/127.20.171.84@KRBTEST.COM
I20260807 10:38:21.300788 370 rpc_server.cc:307] RPC server started. Bound to: 127.20.171.65:45277
I20260807 10:38:21.303282 370 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786098956060137-21165-0/minicluster-data/ts-0/data/info.pb
I20260807 10:38:21.305699 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 370
I20260807 10:38:21.305936 21165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786098956060137-21165-0/minicluster-data/ts-0/wal/instance
I20260807 10:38:21.307061 21165 external_mini_cluster.cc:1428] Setting key 7a9014e6559118565faff482b44ffd37
I20260807 10:38:21.309933 504 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.171.65:45277 every 8 connection(s)
Aug 07 10:38:21 dist-test-slave-0b58 krb5kdc[32274](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099100, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.65@KRBTEST.COM for kudu/127.20.171.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.20.171.66@KRBTEST.COM; defaulting to no policy
I20260807 10:38:21.380954 508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:38:21.321780 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.65:47397 (local address 127.20.171.126:35877)
0807 10:38:21.336763 (+ 14983us) server_negotiation.cc:206] Beginning negotiation
0807 10:38:21.336769 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:38:21.342354 (+ 5585us) server_negotiation.cc:407] Connection header received
0807 10:38:21.342422 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:38:21.342427 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:38:21.342504 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:38:21.342600 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:38:21.356624 (+ 14024us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:38:21.357916 (+ 1292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:38:21.361284 (+ 3368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:38:21.362179 (+ 895us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:38:21.362283 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:38:21.370149 (+ 7866us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:38:21.370157 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:38:21.370164 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:38:21.370222 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:38:21.375769 (+ 5547us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:38:21.377119 (+ 1350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:38:21.377127 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:38:21.377133 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:38:21.377414 (+ 281us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:38:21.378281 (+ 867us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:38:21.378286 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:38:21.378289 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:38:21.378848 (+ 559us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:38:21.379129 (+ 281us) server_negotiation.cc:1035] Waiting for connection context
0807 10:38:21.380087 (+ 958us) server_negotiation.cc:299] Negotiation successful
0807 10:38:21.380344 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14810,"thread_start_us":18517,"threads_started":1}
I20260807 10:38:21.382336 507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:38:21.320854 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:35877 (local address 127.20.171.65:47397)
0807 10:38:21.338005 (+ 17151us) negotiation.cc:107] Waiting for socket to connect
0807 10:38:21.338065 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0807 10:38:21.341991 (+ 3926us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:38:21.354064 (+ 12073us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:38:21.354077 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:38:21.355015 (+ 938us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:38:21.356362 (+ 1347us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:38:21.356391 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:38:21.358287 (+ 1896us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:38:21.358292 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:38:21.361090 (+ 2798us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:38:21.361134 (+ 44us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:38:21.362827 (+ 1693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:38:21.362835 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:38:21.363192 (+ 357us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:38:21.366666 (+ 3474us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:38:21.366700 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:38:21.369870 (+ 3170us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:38:21.375979 (+ 6109us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:38:21.375989 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:38:21.376025 (+ 36us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:38:21.376962 (+ 937us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:38:21.377604 (+ 642us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:38:21.377609 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:38:21.377615 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:38:21.378061 (+ 446us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:38:21.379276 (+ 1215us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:38:21.379286 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:38:21.379663 (+ 377us) client_negotiation.cc:769] Sending connection context
0807 10:38:21.379988 (+ 325us) client_negotiation.cc:240] Negotiation successful
0807 10:38:21.380700 (+ 712us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":16767,"thread_start_us":18045,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.171.66@KRBTEST.COM" created.
I20260807 10:38:21.384629 505 heartbeater.cc:347] Connected to a master server at 127.20.171.126:35877
I20260807 10:38:21.385251 505 heartbeater.cc:464] Registering TS with master...
I20260807 10:38:21.386976 505 heartbeater.cc:511] Master 127.20.171.126:35877 requested a full tablet report, sending...
I20260807 10:38:21.391844 32757 ts_manager.cc:194] Registered new tserver with Master: 3738bd2ea12248ffa3187b28f7ab20fc (127.20.171.65:45277)
I20260807 10:38:21.395769 32757 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.171.65@KRBTEST.COM'} at 127.20.171.65:47397
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.171.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.66.keytab.
Entry for principal kudu/127.20.171.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.66.keytab.
W20260807 10:38:21.436965 21165 mini_kdc.cc:262] Time spent creating service keytab for kudu/127.20.171.66: real 0.126s user 0.000s sys 0.027s
I20260807 10:38:21.438148 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786098956060137-21165-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786098956060137-21165-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786098956060137-21165-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786098956060137-21165-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.20.171.84:46615/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.171.66:0
--local_ip_for_outbound_sockets=127.20.171.66
--webserver_interface=127.20.171.66
--webserver_port=0
--tserver_master_addrs=127.20.171.126:35877
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.66.keytab
--principal=kudu/127.20.171.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.171.84:34297
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786098956060137-21165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786098956060137-21165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786098956060137-21165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 10:38:21 dist-test-slave-0b58 krb5kdc[32274](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099100, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.126@KRBTEST.COM for HTTP/127.20.171.84@KRBTEST.COM
W20260807 10:38:22.209157 511 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:38:22.209609 511 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:38:22.209911 511 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:38:22.219673 511 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:38:22.219861 511 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:38:22.220036 511 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.171.66
I20260807 10:38:22.236558 511 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.171.84:34297
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786098956060137-21165-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786098956060137-21165-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.20.171.84:46615/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.66.keytab
--principal=kudu/127.20.171.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.171.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786098956060137-21165-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.171.66
--webserver_port=0
--tserver_master_addrs=127.20.171.126:35877
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.171.66
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786098956060137-21165-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:38:22.238125 511 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:38:22.239499 511 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:38:22.258811 527 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:38:22.258939 526 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:38:22.259805 529 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:38:22.260919 511 server_base.cc:1034] running on GCE node
I20260807 10:38:22.261726 511 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:38:22.262962 511 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:38:22.264233 511 hybrid_clock.cc:648] HybridClock initialized: now 1786099102264136 us; error 56 us; skew 500 ppm
I20260807 10:38:22.264688 511 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:38:22 dist-test-slave-0b58 krb5kdc[32274](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099102, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:38:22.269835 511 init.cc:377] Logged in from keytab as kudu/127.20.171.66@KRBTEST.COM (short username kudu)
I20260807 10:38:22.272512 511 webserver.cc:460] Webserver started at http://127.20.171.66:38781/ using document root <none> and password file <none>
I20260807 10:38:22.273293 511 fs_manager.cc:359] Metadata directory not provided
I20260807 10:38:22.273491 511 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:38:22.273892 511 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 07 10:38:22 dist-test-slave-0b58 krb5kdc[32274](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099102, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.66@KRBTEST.COM for HTTP/127.20.171.84@KRBTEST.COM
I20260807 10:38:22.293262 511 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786098956060137-21165-0/minicluster-data/ts-1/data/instance:
uuid: "3e72b185732f4af684020304b4f8703d"
format_stamp: "Formatted at 2026-08-07 10:38:22 on dist-test-slave-0b58"
server_key: "1dad7340687eec5c276af78d4f3ccca9"
server_key_iv: "ed9bba64bd293d8eaa752e6a5f2ca03e"
server_key_version: "kuduclusterkey@0"
I20260807 10:38:22.294464 511 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786098956060137-21165-0/minicluster-data/ts-1/wal/instance:
uuid: "3e72b185732f4af684020304b4f8703d"
format_stamp: "Formatted at 2026-08-07 10:38:22 on dist-test-slave-0b58"
server_key: "1dad7340687eec5c276af78d4f3ccca9"
server_key_iv: "ed9bba64bd293d8eaa752e6a5f2ca03e"
server_key_version: "kuduclusterkey@0"
I20260807 10:38:22.303628 511 fs_manager.cc:691] Time spent creating directory manager: real 0.009s user 0.007s sys 0.003s
I20260807 10:38:22.321645 536 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:38:22.323279 511 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.003s
I20260807 10:38:22.323535 511 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786098956060137-21165-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786098956060137-21165-0/minicluster-data/ts-1/wal
uuid: "3e72b185732f4af684020304b4f8703d"
format_stamp: "Formatted at 2026-08-07 10:38:22 on dist-test-slave-0b58"
server_key: "1dad7340687eec5c276af78d4f3ccca9"
server_key_iv: "ed9bba64bd293d8eaa752e6a5f2ca03e"
server_key_version: "kuduclusterkey@0"
I20260807 10:38:22.323843 511 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786098956060137-21165-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786098956060137-21165-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786098956060137-21165-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:38:22.345927 511 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:38:22.351670 511 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:38:22.352156 511 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:38:22.353945 511 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:38:22.356732 511 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:38:22.356997 511 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:38:22.357300 511 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:38:22.357471 511 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:38:22.400271 505 heartbeater.cc:503] Master 127.20.171.126:35877 was elected leader, sending a full tablet report...
I20260807 10:38:22.460285 511 rpc_server.cc:307] RPC server started. Bound to: 127.20.171.66:40863
I20260807 10:38:22.460254 650 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.171.66:40863 every 8 connection(s)
I20260807 10:38:22.461984 511 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786098956060137-21165-0/minicluster-data/ts-1/data/info.pb
I20260807 10:38:22.469732 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 511
I20260807 10:38:22.469947 21165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786098956060137-21165-0/minicluster-data/ts-1/wal/instance
I20260807 10:38:22.470504 21165 external_mini_cluster.cc:1428] Setting key 3787596a4254c6760d40dda76516e683
Aug 07 10:38:22 dist-test-slave-0b58 krb5kdc[32274](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099102, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.66@KRBTEST.COM for kudu/127.20.171.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.20.171.67@KRBTEST.COM; defaulting to no policy
I20260807 10:38:22.511180 653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:38:22.465862 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.66:40521 (local address 127.20.171.126:35877)
0807 10:38:22.478794 (+ 12932us) server_negotiation.cc:206] Beginning negotiation
0807 10:38:22.478802 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 10:38:22.482826 (+ 4024us) server_negotiation.cc:407] Connection header received
0807 10:38:22.486591 (+ 3765us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:38:22.486599 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:38:22.486689 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:38:22.486808 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:38:22.490118 (+ 3310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:38:22.491593 (+ 1475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:38:22.494995 (+ 3402us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:38:22.495863 (+ 868us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:38:22.496003 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:38:22.501595 (+ 5592us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:38:22.501602 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:38:22.501606 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:38:22.501654 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:38:22.506240 (+ 4586us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:38:22.507496 (+ 1256us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:38:22.507502 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:38:22.507506 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:38:22.507757 (+ 251us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:38:22.508506 (+ 749us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:38:22.508511 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:38:22.508514 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:38:22.509030 (+ 516us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:38:22.509220 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0807 10:38:22.510272 (+ 1052us) server_negotiation.cc:299] Negotiation successful
0807 10:38:22.510496 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12730,"thread_start_us":22420,"threads_started":1}
I20260807 10:38:22.512048 654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:38:22.466510 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:35877 (local address 127.20.171.66:40521)
0807 10:38:22.482647 (+ 16137us) negotiation.cc:107] Waiting for socket to connect
0807 10:38:22.482719 (+ 72us) client_negotiation.cc:174] Beginning negotiation
0807 10:38:22.486222 (+ 3503us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:38:22.487731 (+ 1509us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:38:22.487742 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:38:22.488706 (+ 964us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:38:22.489887 (+ 1181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:38:22.489913 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:38:22.491771 (+ 1858us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:38:22.491777 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:38:22.494789 (+ 3012us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:38:22.494844 (+ 55us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:38:22.496324 (+ 1480us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:38:22.496334 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:38:22.496718 (+ 384us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:38:22.497659 (+ 941us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:38:22.497694 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:38:22.501299 (+ 3605us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:38:22.506399 (+ 5100us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:38:22.506412 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:38:22.506431 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:38:22.507337 (+ 906us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:38:22.507906 (+ 569us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:38:22.507914 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:38:22.507919 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:38:22.508370 (+ 451us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:38:22.509220 (+ 850us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:38:22.509231 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:38:22.509745 (+ 514us) client_negotiation.cc:769] Sending connection context
0807 10:38:22.510079 (+ 334us) client_negotiation.cc:240] Negotiation successful
0807 10:38:22.510554 (+ 475us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":15729,"thread_start_us":20018,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.171.67@KRBTEST.COM" created.
I20260807 10:38:22.513885 651 heartbeater.cc:347] Connected to a master server at 127.20.171.126:35877
I20260807 10:38:22.514222 651 heartbeater.cc:464] Registering TS with master...
I20260807 10:38:22.515092 651 heartbeater.cc:511] Master 127.20.171.126:35877 requested a full tablet report, sending...
I20260807 10:38:22.517020 32757 ts_manager.cc:194] Registered new tserver with Master: 3e72b185732f4af684020304b4f8703d (127.20.171.66:40863)
I20260807 10:38:22.518332 32757 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.171.66@KRBTEST.COM'} at 127.20.171.66:40521
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.171.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.67.keytab.
Entry for principal kudu/127.20.171.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.67.keytab.
I20260807 10:38:22.555702 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786098956060137-21165-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786098956060137-21165-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786098956060137-21165-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786098956060137-21165-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.20.171.84:46615/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.171.67:0
--local_ip_for_outbound_sockets=127.20.171.67
--webserver_interface=127.20.171.67
--webserver_port=0
--tserver_master_addrs=127.20.171.126:35877
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.67.keytab
--principal=kudu/127.20.171.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.171.84:34297
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786098956060137-21165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786098956060137-21165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786098956060137-21165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:38:23.214902 657 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:38:23.215269 657 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:38:23.215462 657 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:38:23.224952 657 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:38:23.225164 657 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:38:23.225368 657 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.171.67
I20260807 10:38:23.238090 657 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.171.84:34297
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786098956060137-21165-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786098956060137-21165-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.20.171.84:46615/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.67.keytab
--principal=kudu/127.20.171.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.171.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786098956060137-21165-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.171.67
--webserver_port=0
--tserver_master_addrs=127.20.171.126:35877
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.171.67
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786098956060137-21165-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:38:23.239390 657 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:38:23.240813 657 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:38:23.260485 662 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:38:23.260577 665 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:38:23.260648 663 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:38:23.263041 657 server_base.cc:1034] running on GCE node
I20260807 10:38:23.264178 657 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:38:23.265324 657 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:38:23.266582 657 hybrid_clock.cc:648] HybridClock initialized: now 1786099103266490 us; error 33 us; skew 500 ppm
I20260807 10:38:23.266927 657 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:38:23 dist-test-slave-0b58 krb5kdc[32274](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099103, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:38:23.271513 657 init.cc:377] Logged in from keytab as kudu/127.20.171.67@KRBTEST.COM (short username kudu)
I20260807 10:38:23.273739 657 webserver.cc:460] Webserver started at http://127.20.171.67:33011/ using document root <none> and password file <none>
I20260807 10:38:23.274536 657 fs_manager.cc:359] Metadata directory not provided
I20260807 10:38:23.274753 657 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:38:23.275103 657 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 07 10:38:23 dist-test-slave-0b58 krb5kdc[32274](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099103, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.67@KRBTEST.COM for HTTP/127.20.171.84@KRBTEST.COM
I20260807 10:38:23.291241 657 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786098956060137-21165-0/minicluster-data/ts-2/data/instance:
uuid: "9d38fff4e5814b54a567af725431eb34"
format_stamp: "Formatted at 2026-08-07 10:38:23 on dist-test-slave-0b58"
server_key: "ef1dc59a0efe10fea4401bbf3e7a1b19"
server_key_iv: "319f1228d895bac6938a428a83d5c71c"
server_key_version: "kuduclusterkey@0"
I20260807 10:38:23.292474 657 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786098956060137-21165-0/minicluster-data/ts-2/wal/instance:
uuid: "9d38fff4e5814b54a567af725431eb34"
format_stamp: "Formatted at 2026-08-07 10:38:23 on dist-test-slave-0b58"
server_key: "ef1dc59a0efe10fea4401bbf3e7a1b19"
server_key_iv: "319f1228d895bac6938a428a83d5c71c"
server_key_version: "kuduclusterkey@0"
I20260807 10:38:23.299721 657 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.005s sys 0.001s
I20260807 10:38:23.316738 672 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:38:23.318374 657 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260807 10:38:23.318627 657 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786098956060137-21165-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786098956060137-21165-0/minicluster-data/ts-2/wal
uuid: "9d38fff4e5814b54a567af725431eb34"
format_stamp: "Formatted at 2026-08-07 10:38:23 on dist-test-slave-0b58"
server_key: "ef1dc59a0efe10fea4401bbf3e7a1b19"
server_key_iv: "319f1228d895bac6938a428a83d5c71c"
server_key_version: "kuduclusterkey@0"
I20260807 10:38:23.318897 657 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786098956060137-21165-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786098956060137-21165-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786098956060137-21165-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:38:23.346823 657 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:38:23.352002 657 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:38:23.352567 657 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:38:23.354164 657 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:38:23.356518 657 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:38:23.356676 657 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:38:23.356918 657 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:38:23.357102 657 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:38:23.445196 657 rpc_server.cc:307] RPC server started. Bound to: 127.20.171.67:43085
I20260807 10:38:23.445199 786 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.171.67:43085 every 8 connection(s)
I20260807 10:38:23.446843 657 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786098956060137-21165-0/minicluster-data/ts-2/data/info.pb
I20260807 10:38:23.456704 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 657
I20260807 10:38:23.456902 21165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786098956060137-21165-0/minicluster-data/ts-2/wal/instance
I20260807 10:38:23.457446 21165 external_mini_cluster.cc:1428] Setting key c537efb024d43ad48e6a319514503133
Aug 07 10:38:23 dist-test-slave-0b58 krb5kdc[32274](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099103, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.67@KRBTEST.COM for kudu/127.20.171.126@KRBTEST.COM
I20260807 10:38:23.478983 789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:38:23.450835 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.67:49169 (local address 127.20.171.126:35877)
0807 10:38:23.451841 (+ 1006us) server_negotiation.cc:206] Beginning negotiation
0807 10:38:23.451849 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 10:38:23.453750 (+ 1901us) server_negotiation.cc:407] Connection header received
0807 10:38:23.456756 (+ 3006us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:38:23.456761 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:38:23.456924 (+ 163us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:38:23.457060 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:38:23.460164 (+ 3104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:38:23.461633 (+ 1469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:38:23.464955 (+ 3322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:38:23.465803 (+ 848us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:38:23.465905 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:38:23.470646 (+ 4741us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:38:23.470651 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:38:23.470654 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:38:23.470682 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:38:23.475201 (+ 4519us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:38:23.476042 (+ 841us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:38:23.476047 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:38:23.476049 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:38:23.476222 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:38:23.476826 (+ 604us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:38:23.476831 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:38:23.476834 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:38:23.477216 (+ 382us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:38:23.477415 (+ 199us) server_negotiation.cc:1035] Waiting for connection context
0807 10:38:23.478142 (+ 727us) server_negotiation.cc:299] Negotiation successful
0807 10:38:23.478412 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":877,"thread_start_us":575,"threads_started":1}
I20260807 10:38:23.480063 790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:38:23.452000 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:35877 (local address 127.20.171.67:49169)
0807 10:38:23.453568 (+ 1568us) negotiation.cc:107] Waiting for socket to connect
0807 10:38:23.453620 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0807 10:38:23.456445 (+ 2825us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:38:23.457398 (+ 953us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:38:23.457409 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:38:23.458524 (+ 1115us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:38:23.459934 (+ 1410us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:38:23.459998 (+ 64us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:38:23.461850 (+ 1852us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:38:23.461856 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:38:23.464821 (+ 2965us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:38:23.464837 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:38:23.466086 (+ 1249us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:38:23.466095 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:38:23.466653 (+ 558us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:38:23.467595 (+ 942us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:38:23.467617 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:38:23.470410 (+ 2793us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:38:23.475341 (+ 4931us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:38:23.475350 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:38:23.475364 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:38:23.475904 (+ 540us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:38:23.476380 (+ 476us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:38:23.476386 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:38:23.476390 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:38:23.476697 (+ 307us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:38:23.477370 (+ 673us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:38:23.477377 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:38:23.477769 (+ 392us) client_negotiation.cc:769] Sending connection context
0807 10:38:23.478046 (+ 277us) client_negotiation.cc:240] Negotiation successful
0807 10:38:23.478698 (+ 652us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1259,"thread_start_us":889,"threads_started":1}
I20260807 10:38:23.481493 787 heartbeater.cc:347] Connected to a master server at 127.20.171.126:35877
I20260807 10:38:23.481871 787 heartbeater.cc:464] Registering TS with master...
I20260807 10:38:23.482892 787 heartbeater.cc:511] Master 127.20.171.126:35877 requested a full tablet report, sending...
I20260807 10:38:23.484669 32757 ts_manager.cc:194] Registered new tserver with Master: 9d38fff4e5814b54a567af725431eb34 (127.20.171.67:43085)
I20260807 10:38:23.485944 32757 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.171.67@KRBTEST.COM'} at 127.20.171.67:49169
I20260807 10:38:23.486425 21165 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 10:38:23.511693 789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:38:23.493359 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39168 (local address 127.20.171.126:35877)
0807 10:38:23.493548 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0807 10:38:23.493554 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:38:23.494609 (+ 1055us) server_negotiation.cc:407] Connection header received
0807 10:38:23.494810 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:38:23.494814 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:38:23.494914 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:38:23.495016 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:38:23.497353 (+ 2337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:38:23.498283 (+ 930us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:38:23.500240 (+ 1957us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:38:23.500965 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:38:23.501162 (+ 197us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:38:23.504527 (+ 3365us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:38:23.504532 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:38:23.504535 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:38:23.504563 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:38:23.508260 (+ 3697us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:38:23.509069 (+ 809us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:38:23.509075 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:38:23.509078 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:38:23.509264 (+ 186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:38:23.509747 (+ 483us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:38:23.509752 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:38:23.509754 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:38:23.510109 (+ 355us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:38:23.510458 (+ 349us) server_negotiation.cc:1035] Waiting for connection context
0807 10:38:23.510861 (+ 403us) server_negotiation.cc:299] Negotiation successful
0807 10:38:23.511169 (+ 308us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260807 10:38:23.521728 651 heartbeater.cc:503] Master 127.20.171.126:35877 was elected leader, sending a full tablet report...
I20260807 10:38:23.516580 32757 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39168:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 10:38:23.528312 32757 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 10:38:23.567853 801 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:38:23.546462 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38822 (local address 127.20.171.65:45277)
0807 10:38:23.552187 (+ 5725us) server_negotiation.cc:206] Beginning negotiation
0807 10:38:23.552199 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 10:38:23.553043 (+ 844us) server_negotiation.cc:407] Connection header received
0807 10:38:23.553154 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:38:23.553163 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:38:23.553523 (+ 360us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:38:23.554107 (+ 584us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:38:23.556791 (+ 2684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:38:23.558767 (+ 1976us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:38:23.563615 (+ 4848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:38:23.565181 (+ 1566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:38:23.565336 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:38:23.565726 (+ 390us) server_negotiation.cc:1035] Waiting for connection context
0807 10:38:23.567063 (+ 1337us) server_negotiation.cc:299] Negotiation successful
0807 10:38:23.567299 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5436,"thread_start_us":5157,"threads_started":1}
I20260807 10:38:23.568778 800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:38:23.546324 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.65:45277 (local address 127.0.0.1:38822)
0807 10:38:23.552483 (+ 6159us) negotiation.cc:107] Waiting for socket to connect
0807 10:38:23.552530 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0807 10:38:23.552810 (+ 280us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:38:23.553814 (+ 1004us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:38:23.553822 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:38:23.554022 (+ 200us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:38:23.556496 (+ 2474us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:38:23.556515 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:38:23.558927 (+ 2412us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:38:23.558934 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:38:23.563387 (+ 4453us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:38:23.563399 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:38:23.565498 (+ 2099us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:38:23.565505 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:38:23.565781 (+ 276us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:38:23.565842 (+ 61us) client_negotiation.cc:769] Sending connection context
0807 10:38:23.566021 (+ 179us) client_negotiation.cc:240] Negotiation successful
0807 10:38:23.566379 (+ 358us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5729,"mutex_wait_us":6,"thread_start_us":6817,"threads_started":1}
I20260807 10:38:23.569789 804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:38:23.548310 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44034 (local address 127.20.171.66:40863)
0807 10:38:23.551103 (+ 2793us) server_negotiation.cc:206] Beginning negotiation
0807 10:38:23.551113 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 10:38:23.553398 (+ 2285us) server_negotiation.cc:407] Connection header received
0807 10:38:23.553533 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:38:23.553545 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:38:23.554012 (+ 467us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:38:23.554720 (+ 708us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:38:23.557882 (+ 3162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:38:23.560597 (+ 2715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:38:23.565255 (+ 4658us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:38:23.567283 (+ 2028us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:38:23.567401 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:38:23.567634 (+ 233us) server_negotiation.cc:1035] Waiting for connection context
0807 10:38:23.568856 (+ 1222us) server_negotiation.cc:299] Negotiation successful
0807 10:38:23.569103 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2539,"thread_start_us":2264,"threads_started":1}
I20260807 10:38:23.569808 802 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:38:23.546930 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.66:40863 (local address 127.0.0.1:44034)
0807 10:38:23.552803 (+ 5873us) negotiation.cc:107] Waiting for socket to connect
0807 10:38:23.552829 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0807 10:38:23.553019 (+ 190us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:38:23.554361 (+ 1342us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:38:23.554370 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:38:23.554411 (+ 41us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:38:23.556764 (+ 2353us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:38:23.556778 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:38:23.560837 (+ 4059us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:38:23.560842 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:38:23.565048 (+ 4206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:38:23.565062 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:38:23.568473 (+ 3411us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:38:23.568481 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:38:23.568659 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:38:23.568684 (+ 25us) client_negotiation.cc:769] Sending connection context
0807 10:38:23.568797 (+ 113us) client_negotiation.cc:240] Negotiation successful
0807 10:38:23.568952 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5670,"mutex_wait_us":21,"thread_start_us":5012,"threads_started":1}
I20260807 10:38:23.573971 439 tablet_service.cc:1467] Processing CreateTablet for tablet aad95cf7774e45e48d707b37f666e622 (DEFAULT_TABLE table=test-table [id=a8e93e6ed6aa49678020503a1084a864]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:38:23.574638 584 tablet_service.cc:1467] Processing CreateTablet for tablet aad95cf7774e45e48d707b37f666e622 (DEFAULT_TABLE table=test-table [id=a8e93e6ed6aa49678020503a1084a864]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:38:23.576027 439 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aad95cf7774e45e48d707b37f666e622. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:38:23.576426 805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:38:23.547535 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.67:43085 (local address 127.0.0.1:46948)
0807 10:38:23.556420 (+ 8885us) negotiation.cc:107] Waiting for socket to connect
0807 10:38:23.556496 (+ 76us) client_negotiation.cc:174] Beginning negotiation
0807 10:38:23.556732 (+ 236us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:38:23.560924 (+ 4192us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:38:23.560929 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:38:23.560960 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:38:23.562644 (+ 1684us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:38:23.562660 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:38:23.565822 (+ 3162us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:38:23.565827 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:38:23.572135 (+ 6308us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:38:23.572150 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:38:23.575144 (+ 2994us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:38:23.575162 (+ 18us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:38:23.575475 (+ 313us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:38:23.575508 (+ 33us) client_negotiation.cc:769] Sending connection context
0807 10:38:23.575593 (+ 85us) client_negotiation.cc:240] Negotiation successful
0807 10:38:23.575725 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8458,"thread_start_us":8010,"threads_started":1}
I20260807 10:38:23.576690 584 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aad95cf7774e45e48d707b37f666e622. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:38:23.576843 803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:38:23.546648 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46948 (local address 127.20.171.67:43085)
0807 10:38:23.549952 (+ 3304us) server_negotiation.cc:206] Beginning negotiation
0807 10:38:23.549966 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0807 10:38:23.556596 (+ 6630us) server_negotiation.cc:407] Connection header received
0807 10:38:23.557027 (+ 431us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:38:23.557037 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:38:23.557312 (+ 275us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:38:23.557523 (+ 211us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:38:23.562991 (+ 5468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:38:23.565428 (+ 2437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:38:23.572474 (+ 7046us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:38:23.574742 (+ 2268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:38:23.574888 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:38:23.575245 (+ 357us) server_negotiation.cc:1035] Waiting for connection context
0807 10:38:23.575699 (+ 454us) server_negotiation.cc:299] Negotiation successful
0807 10:38:23.575896 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2361,"thread_start_us":2055,"threads_started":1}
I20260807 10:38:23.581820 720 tablet_service.cc:1467] Processing CreateTablet for tablet aad95cf7774e45e48d707b37f666e622 (DEFAULT_TABLE table=test-table [id=a8e93e6ed6aa49678020503a1084a864]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:38:23.584121 720 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aad95cf7774e45e48d707b37f666e622. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:38:23.594013 806 tablet_bootstrap.cc:492] T aad95cf7774e45e48d707b37f666e622 P 3e72b185732f4af684020304b4f8703d: Bootstrap starting.
I20260807 10:38:23.599082 807 tablet_bootstrap.cc:492] T aad95cf7774e45e48d707b37f666e622 P 3738bd2ea12248ffa3187b28f7ab20fc: Bootstrap starting.
I20260807 10:38:23.602138 806 tablet_bootstrap.cc:654] T aad95cf7774e45e48d707b37f666e622 P 3e72b185732f4af684020304b4f8703d: Neither blocks nor log segments found. Creating new log.
I20260807 10:38:23.603758 807 tablet_bootstrap.cc:654] T aad95cf7774e45e48d707b37f666e622 P 3738bd2ea12248ffa3187b28f7ab20fc: Neither blocks nor log segments found. Creating new log.
I20260807 10:38:23.604548 806 log.cc:824] T aad95cf7774e45e48d707b37f666e622 P 3e72b185732f4af684020304b4f8703d: Log is configured to *not* fsync() on all Append() calls
I20260807 10:38:23.606065 807 log.cc:824] T aad95cf7774e45e48d707b37f666e622 P 3738bd2ea12248ffa3187b28f7ab20fc: Log is configured to *not* fsync() on all Append() calls
I20260807 10:38:23.609632 808 tablet_bootstrap.cc:492] T aad95cf7774e45e48d707b37f666e622 P 9d38fff4e5814b54a567af725431eb34: Bootstrap starting.
I20260807 10:38:23.610265 806 tablet_bootstrap.cc:492] T aad95cf7774e45e48d707b37f666e622 P 3e72b185732f4af684020304b4f8703d: No bootstrap required, opened a new log
I20260807 10:38:23.610590 806 ts_tablet_manager.cc:1397] T aad95cf7774e45e48d707b37f666e622 P 3e72b185732f4af684020304b4f8703d: Time spent bootstrapping tablet: real 0.017s user 0.006s sys 0.006s
I20260807 10:38:23.611274 807 tablet_bootstrap.cc:492] T aad95cf7774e45e48d707b37f666e622 P 3738bd2ea12248ffa3187b28f7ab20fc: No bootstrap required, opened a new log
I20260807 10:38:23.611620 807 ts_tablet_manager.cc:1397] T aad95cf7774e45e48d707b37f666e622 P 3738bd2ea12248ffa3187b28f7ab20fc: Time spent bootstrapping tablet: real 0.013s user 0.004s sys 0.005s
I20260807 10:38:23.616519 808 tablet_bootstrap.cc:654] T aad95cf7774e45e48d707b37f666e622 P 9d38fff4e5814b54a567af725431eb34: Neither blocks nor log segments found. Creating new log.
I20260807 10:38:23.619146 808 log.cc:824] T aad95cf7774e45e48d707b37f666e622 P 9d38fff4e5814b54a567af725431eb34: Log is configured to *not* fsync() on all Append() calls
I20260807 10:38:23.623551 806 raft_consensus.cc:348] T aad95cf7774e45e48d707b37f666e622 P 3e72b185732f4af684020304b4f8703d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d38fff4e5814b54a567af725431eb34" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 43085 } } peers { permanent_uuid: "3738bd2ea12248ffa3187b28f7ab20fc" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 45277 } } peers { permanent_uuid: "3e72b185732f4af684020304b4f8703d" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 40863 } }
I20260807 10:38:23.624188 806 raft_consensus.cc:374] T aad95cf7774e45e48d707b37f666e622 P 3e72b185732f4af684020304b4f8703d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:38:23.624329 806 raft_consensus.cc:729] T aad95cf7774e45e48d707b37f666e622 P 3e72b185732f4af684020304b4f8703d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e72b185732f4af684020304b4f8703d, State: Initialized, Role: FOLLOWER
I20260807 10:38:23.624547 808 tablet_bootstrap.cc:492] T aad95cf7774e45e48d707b37f666e622 P 9d38fff4e5814b54a567af725431eb34: No bootstrap required, opened a new log
I20260807 10:38:23.625036 808 ts_tablet_manager.cc:1397] T aad95cf7774e45e48d707b37f666e622 P 9d38fff4e5814b54a567af725431eb34: Time spent bootstrapping tablet: real 0.016s user 0.007s sys 0.006s
I20260807 10:38:23.625087 806 consensus_queue.cc:260] T aad95cf7774e45e48d707b37f666e622 P 3e72b185732f4af684020304b4f8703d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d38fff4e5814b54a567af725431eb34" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 43085 } } peers { permanent_uuid: "3738bd2ea12248ffa3187b28f7ab20fc" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 45277 } } peers { permanent_uuid: "3e72b185732f4af684020304b4f8703d" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 40863 } }
I20260807 10:38:23.627975 806 ts_tablet_manager.cc:1428] T aad95cf7774e45e48d707b37f666e622 P 3e72b185732f4af684020304b4f8703d: Time spent starting tablet: real 0.017s user 0.009s sys 0.009s
I20260807 10:38:23.628618 807 raft_consensus.cc:348] T aad95cf7774e45e48d707b37f666e622 P 3738bd2ea12248ffa3187b28f7ab20fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d38fff4e5814b54a567af725431eb34" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 43085 } } peers { permanent_uuid: "3738bd2ea12248ffa3187b28f7ab20fc" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 45277 } } peers { permanent_uuid: "3e72b185732f4af684020304b4f8703d" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 40863 } }
I20260807 10:38:23.629417 807 raft_consensus.cc:374] T aad95cf7774e45e48d707b37f666e622 P 3738bd2ea12248ffa3187b28f7ab20fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:38:23.629612 807 raft_consensus.cc:729] T aad95cf7774e45e48d707b37f666e622 P 3738bd2ea12248ffa3187b28f7ab20fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3738bd2ea12248ffa3187b28f7ab20fc, State: Initialized, Role: FOLLOWER
I20260807 10:38:23.630570 807 consensus_queue.cc:260] T aad95cf7774e45e48d707b37f666e622 P 3738bd2ea12248ffa3187b28f7ab20fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d38fff4e5814b54a567af725431eb34" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 43085 } } peers { permanent_uuid: "3738bd2ea12248ffa3187b28f7ab20fc" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 45277 } } peers { permanent_uuid: "3e72b185732f4af684020304b4f8703d" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 40863 } }
I20260807 10:38:23.633284 807 ts_tablet_manager.cc:1428] T aad95cf7774e45e48d707b37f666e622 P 3738bd2ea12248ffa3187b28f7ab20fc: Time spent starting tablet: real 0.022s user 0.014s sys 0.009s
I20260807 10:38:23.639240 808 raft_consensus.cc:348] T aad95cf7774e45e48d707b37f666e622 P 9d38fff4e5814b54a567af725431eb34 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d38fff4e5814b54a567af725431eb34" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 43085 } } peers { permanent_uuid: "3738bd2ea12248ffa3187b28f7ab20fc" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 45277 } } peers { permanent_uuid: "3e72b185732f4af684020304b4f8703d" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 40863 } }
I20260807 10:38:23.639695 808 raft_consensus.cc:374] T aad95cf7774e45e48d707b37f666e622 P 9d38fff4e5814b54a567af725431eb34 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:38:23.639868 808 raft_consensus.cc:729] T aad95cf7774e45e48d707b37f666e622 P 9d38fff4e5814b54a567af725431eb34 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d38fff4e5814b54a567af725431eb34, State: Initialized, Role: FOLLOWER
I20260807 10:38:23.640551 808 consensus_queue.cc:260] T aad95cf7774e45e48d707b37f666e622 P 9d38fff4e5814b54a567af725431eb34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d38fff4e5814b54a567af725431eb34" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 43085 } } peers { permanent_uuid: "3738bd2ea12248ffa3187b28f7ab20fc" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 45277 } } peers { permanent_uuid: "3e72b185732f4af684020304b4f8703d" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 40863 } }
I20260807 10:38:23.642211 787 heartbeater.cc:503] Master 127.20.171.126:35877 was elected leader, sending a full tablet report...
I20260807 10:38:23.642846 808 ts_tablet_manager.cc:1428] T aad95cf7774e45e48d707b37f666e622 P 9d38fff4e5814b54a567af725431eb34: Time spent starting tablet: real 0.018s user 0.016s sys 0.001s
I20260807 10:38:23.648541 812 raft_consensus.cc:482] T aad95cf7774e45e48d707b37f666e622 P 3e72b185732f4af684020304b4f8703d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 10:38:23.648969 812 raft_consensus.cc:504] T aad95cf7774e45e48d707b37f666e622 P 3e72b185732f4af684020304b4f8703d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d38fff4e5814b54a567af725431eb34" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 43085 } } peers { permanent_uuid: "3738bd2ea12248ffa3187b28f7ab20fc" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 45277 } } peers { permanent_uuid: "3e72b185732f4af684020304b4f8703d" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 40863 } }
I20260807 10:38:23.651217 812 leader_election.cc:288] T aad95cf7774e45e48d707b37f666e622 P 3e72b185732f4af684020304b4f8703d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9d38fff4e5814b54a567af725431eb34 (127.20.171.67:43085), 3738bd2ea12248ffa3187b28f7ab20fc (127.20.171.65:45277)
I20260807 10:38:23.662951 801 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:38:23.651981 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.66:35147 (local address 127.20.171.65:45277)
0807 10:38:23.652331 (+ 350us) server_negotiation.cc:206] Beginning negotiation
0807 10:38:23.652338 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:38:23.654504 (+ 2166us) server_negotiation.cc:407] Connection header received
0807 10:38:23.654768 (+ 264us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:38:23.654774 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:38:23.654845 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:38:23.654943 (+ 98us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:38:23.656229 (+ 1286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:38:23.657477 (+ 1248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:38:23.660558 (+ 3081us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:38:23.661654 (+ 1096us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:38:23.661931 (+ 277us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:38:23.662050 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0807 10:38:23.662427 (+ 377us) server_negotiation.cc:299] Negotiation successful
0807 10:38:23.662554 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92}
I20260807 10:38:23.663341 815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:38:23.651723 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.65:45277 (local address 127.20.171.66:35147)
0807 10:38:23.654384 (+ 2661us) negotiation.cc:107] Waiting for socket to connect
0807 10:38:23.654401 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 10:38:23.654621 (+ 220us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:38:23.654963 (+ 342us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:38:23.654968 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:38:23.654994 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:38:23.656062 (+ 1068us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:38:23.656075 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:38:23.657608 (+ 1533us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:38:23.657616 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:38:23.660375 (+ 2759us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:38:23.660393 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:38:23.662046 (+ 1653us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:38:23.662053 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:38:23.662245 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:38:23.662270 (+ 25us) client_negotiation.cc:769] Sending connection context
0807 10:38:23.662393 (+ 123us) client_negotiation.cc:240] Negotiation successful
0807 10:38:23.662521 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2482,"mutex_wait_us":20,"thread_start_us":2070,"threads_started":1}
I20260807 10:38:23.663764 803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:38:23.651665 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.66:55817 (local address 127.20.171.67:43085)
0807 10:38:23.651962 (+ 297us) server_negotiation.cc:206] Beginning negotiation
0807 10:38:23.651969 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:38:23.654862 (+ 2893us) server_negotiation.cc:407] Connection header received
0807 10:38:23.655083 (+ 221us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:38:23.655088 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:38:23.655154 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:38:23.655249 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:38:23.656613 (+ 1364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:38:23.657829 (+ 1216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:38:23.661000 (+ 3171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:38:23.662164 (+ 1164us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:38:23.662456 (+ 292us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:38:23.662572 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0807 10:38:23.663002 (+ 430us) server_negotiation.cc:299] Negotiation successful
0807 10:38:23.663396 (+ 394us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260807 10:38:23.664130 816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:38:23.653057 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.67:43085 (local address 127.20.171.66:55817)
0807 10:38:23.654758 (+ 1701us) negotiation.cc:107] Waiting for socket to connect
0807 10:38:23.654773 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 10:38:23.654951 (+ 178us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:38:23.655269 (+ 318us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:38:23.655274 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:38:23.655310 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:38:23.656438 (+ 1128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:38:23.656451 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:38:23.657965 (+ 1514us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:38:23.657971 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:38:23.660816 (+ 2845us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:38:23.660829 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:38:23.662597 (+ 1768us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:38:23.662605 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:38:23.662839 (+ 234us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:38:23.662863 (+ 24us) client_negotiation.cc:769] Sending connection context
0807 10:38:23.662965 (+ 102us) client_negotiation.cc:240] Negotiation successful
0807 10:38:23.663079 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1539,"mutex_wait_us":3,"thread_start_us":1236,"threads_started":1}
I20260807 10:38:23.665205 459 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aad95cf7774e45e48d707b37f666e622" candidate_uuid: "3e72b185732f4af684020304b4f8703d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3738bd2ea12248ffa3187b28f7ab20fc" is_pre_election: true
I20260807 10:38:23.665745 741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aad95cf7774e45e48d707b37f666e622" candidate_uuid: "3e72b185732f4af684020304b4f8703d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d38fff4e5814b54a567af725431eb34" is_pre_election: true
I20260807 10:38:23.666033 459 raft_consensus.cc:2454] T aad95cf7774e45e48d707b37f666e622 P 3738bd2ea12248ffa3187b28f7ab20fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e72b185732f4af684020304b4f8703d in term 0.
I20260807 10:38:23.666524 741 raft_consensus.cc:2454] T aad95cf7774e45e48d707b37f666e622 P 9d38fff4e5814b54a567af725431eb34 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e72b185732f4af684020304b4f8703d in term 0.
I20260807 10:38:23.667086 537 leader_election.cc:302] T aad95cf7774e45e48d707b37f666e622 P 3e72b185732f4af684020304b4f8703d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3738bd2ea12248ffa3187b28f7ab20fc, 3e72b185732f4af684020304b4f8703d; no voters:
I20260807 10:38:23.667662 812 raft_consensus.cc:2781] T aad95cf7774e45e48d707b37f666e622 P 3e72b185732f4af684020304b4f8703d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 10:38:23.667969 812 raft_consensus.cc:482] T aad95cf7774e45e48d707b37f666e622 P 3e72b185732f4af684020304b4f8703d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 10:38:23.668138 812 raft_consensus.cc:3037] T aad95cf7774e45e48d707b37f666e622 P 3e72b185732f4af684020304b4f8703d [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:38:23.671541 812 raft_consensus.cc:504] T aad95cf7774e45e48d707b37f666e622 P 3e72b185732f4af684020304b4f8703d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d38fff4e5814b54a567af725431eb34" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 43085 } } peers { permanent_uuid: "3738bd2ea12248ffa3187b28f7ab20fc" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 45277 } } peers { permanent_uuid: "3e72b185732f4af684020304b4f8703d" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 40863 } }
I20260807 10:38:23.672245 812 leader_election.cc:288] T aad95cf7774e45e48d707b37f666e622 P 3e72b185732f4af684020304b4f8703d [CANDIDATE]: Term 1 election: Requested vote from peers 9d38fff4e5814b54a567af725431eb34 (127.20.171.67:43085), 3738bd2ea12248ffa3187b28f7ab20fc (127.20.171.65:45277)
I20260807 10:38:23.672760 741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aad95cf7774e45e48d707b37f666e622" candidate_uuid: "3e72b185732f4af684020304b4f8703d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d38fff4e5814b54a567af725431eb34"
I20260807 10:38:23.672760 459 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aad95cf7774e45e48d707b37f666e622" candidate_uuid: "3e72b185732f4af684020304b4f8703d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3738bd2ea12248ffa3187b28f7ab20fc"
I20260807 10:38:23.673017 741 raft_consensus.cc:3037] T aad95cf7774e45e48d707b37f666e622 P 9d38fff4e5814b54a567af725431eb34 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:38:23.673013 459 raft_consensus.cc:3037] T aad95cf7774e45e48d707b37f666e622 P 3738bd2ea12248ffa3187b28f7ab20fc [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:38:23.676820 741 raft_consensus.cc:2454] T aad95cf7774e45e48d707b37f666e622 P 9d38fff4e5814b54a567af725431eb34 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e72b185732f4af684020304b4f8703d in term 1.
I20260807 10:38:23.676858 459 raft_consensus.cc:2454] T aad95cf7774e45e48d707b37f666e622 P 3738bd2ea12248ffa3187b28f7ab20fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e72b185732f4af684020304b4f8703d in term 1.
I20260807 10:38:23.677399 538 leader_election.cc:302] T aad95cf7774e45e48d707b37f666e622 P 3e72b185732f4af684020304b4f8703d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 3738bd2ea12248ffa3187b28f7ab20fc, 3e72b185732f4af684020304b4f8703d, 9d38fff4e5814b54a567af725431eb34; no voters:
I20260807 10:38:23.677927 812 raft_consensus.cc:2781] T aad95cf7774e45e48d707b37f666e622 P 3e72b185732f4af684020304b4f8703d [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:38:23.678838 812 raft_consensus.cc:686] T aad95cf7774e45e48d707b37f666e622 P 3e72b185732f4af684020304b4f8703d [term 1 LEADER]: Becoming Leader. State: Replica: 3e72b185732f4af684020304b4f8703d, State: Running, Role: LEADER
I20260807 10:38:23.679513 812 consensus_queue.cc:237] T aad95cf7774e45e48d707b37f666e622 P 3e72b185732f4af684020304b4f8703d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d38fff4e5814b54a567af725431eb34" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 43085 } } peers { permanent_uuid: "3738bd2ea12248ffa3187b28f7ab20fc" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 45277 } } peers { permanent_uuid: "3e72b185732f4af684020304b4f8703d" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 40863 } }
I20260807 10:38:23.685760 32757 catalog_manager.cc:5495] T aad95cf7774e45e48d707b37f666e622 P 3e72b185732f4af684020304b4f8703d reported cstate change: term changed from 0 to 1, leader changed from <none> to 3e72b185732f4af684020304b4f8703d (127.20.171.66). New cstate: current_term: 1 leader_uuid: "3e72b185732f4af684020304b4f8703d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d38fff4e5814b54a567af725431eb34" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 43085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3738bd2ea12248ffa3187b28f7ab20fc" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 45277 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e72b185732f4af684020304b4f8703d" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 40863 } health_report { overall_health: HEALTHY } } }
W20260807 10:38:23.700829 788 tablet.cc:2369] T aad95cf7774e45e48d707b37f666e622 P 9d38fff4e5814b54a567af725431eb34: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 10:38:23.715907 652 tablet.cc:2369] T aad95cf7774e45e48d707b37f666e622 P 3e72b185732f4af684020304b4f8703d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 10:38:23.720567 804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:38:23.712585 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44040 (local address 127.20.171.66:40863)
0807 10:38:23.712856 (+ 271us) server_negotiation.cc:206] Beginning negotiation
0807 10:38:23.712864 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 10:38:23.712937 (+ 73us) server_negotiation.cc:407] Connection header received
0807 10:38:23.713202 (+ 265us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:38:23.713206 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:38:23.713325 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:38:23.713478 (+ 153us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 10:38:23.714007 (+ 529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:38:23.715120 (+ 1113us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:38:23.717876 (+ 2756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:38:23.718480 (+ 604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:38:23.718619 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:38:23.719311 (+ 692us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 10:38:23.719828 (+ 517us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 10:38:23.719978 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0807 10:38:23.720088 (+ 110us) server_negotiation.cc:299] Negotiation successful
0807 10:38:23.720175 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260807 10:38:23.731822 459 raft_consensus.cc:1261] T aad95cf7774e45e48d707b37f666e622 P 3738bd2ea12248ffa3187b28f7ab20fc [term 1 FOLLOWER]: Refusing update from remote peer 3e72b185732f4af684020304b4f8703d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 10:38:23.731822 741 raft_consensus.cc:1261] T aad95cf7774e45e48d707b37f666e622 P 9d38fff4e5814b54a567af725431eb34 [term 1 FOLLOWER]: Refusing update from remote peer 3e72b185732f4af684020304b4f8703d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 10:38:23.733057 817 consensus_queue.cc:1035] T aad95cf7774e45e48d707b37f666e622 P 3e72b185732f4af684020304b4f8703d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d38fff4e5814b54a567af725431eb34" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 43085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 10:38:23.733644 812 consensus_queue.cc:1035] T aad95cf7774e45e48d707b37f666e622 P 3e72b185732f4af684020304b4f8703d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3738bd2ea12248ffa3187b28f7ab20fc" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 45277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 10:38:23.772073 32757 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39168:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 10:38:23.772504 32757 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39168:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 10:38:23.777217 32757 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5ba9c7b0139b498c8a21186940b0c6d9: Sending DeleteTablet for 3 replicas of tablet aad95cf7774e45e48d707b37f666e622
I20260807 10:38:23.778474 720 tablet_service.cc:1514] Processing DeleteTablet for tablet aad95cf7774e45e48d707b37f666e622 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:38:23 UTC) from {username='kudu', principal='kudu/127.20.171.126@KRBTEST.COM'} at 127.0.0.1:46948
I20260807 10:38:23.778647 439 tablet_service.cc:1514] Processing DeleteTablet for tablet aad95cf7774e45e48d707b37f666e622 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:38:23 UTC) from {username='kudu', principal='kudu/127.20.171.126@KRBTEST.COM'} at 127.0.0.1:38822
I20260807 10:38:23.779006 584 tablet_service.cc:1514] Processing DeleteTablet for tablet aad95cf7774e45e48d707b37f666e622 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:38:23 UTC) from {username='kudu', principal='kudu/127.20.171.126@KRBTEST.COM'} at 127.0.0.1:44034
I20260807 10:38:23.781675 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 370
I20260807 10:38:23.794335 833 tablet_replica.cc:330] T aad95cf7774e45e48d707b37f666e622 P 3e72b185732f4af684020304b4f8703d: stopping tablet replica
I20260807 10:38:23.794853 833 raft_consensus.cc:2229] T aad95cf7774e45e48d707b37f666e622 P 3e72b185732f4af684020304b4f8703d [term 1 LEADER]: Raft consensus shutting down.
I20260807 10:38:23.795560 833 raft_consensus.cc:2258] T aad95cf7774e45e48d707b37f666e622 P 3e72b185732f4af684020304b4f8703d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:38:23.797904 833 ts_tablet_manager.cc:1905] T aad95cf7774e45e48d707b37f666e622 P 3e72b185732f4af684020304b4f8703d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 10:38:23.806852 833 ts_tablet_manager.cc:1918] T aad95cf7774e45e48d707b37f666e622 P 3e72b185732f4af684020304b4f8703d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 10:38:23.807122 833 log.cc:1196] T aad95cf7774e45e48d707b37f666e622 P 3e72b185732f4af684020304b4f8703d: Deleting WAL directory at /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786098956060137-21165-0/minicluster-data/ts-1/wal/wals/aad95cf7774e45e48d707b37f666e622
I20260807 10:38:23.807950 833 ts_tablet_manager.cc:1939] T aad95cf7774e45e48d707b37f666e622 P 3e72b185732f4af684020304b4f8703d: Deleting consensus metadata
I20260807 10:38:23.809268 832 tablet_replica.cc:330] T aad95cf7774e45e48d707b37f666e622 P 3738bd2ea12248ffa3187b28f7ab20fc: stopping tablet replica
I20260807 10:38:23.809754 832 raft_consensus.cc:2229] T aad95cf7774e45e48d707b37f666e622 P 3738bd2ea12248ffa3187b28f7ab20fc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 10:38:23.810225 32742 catalog_manager.cc:4841] TS 3e72b185732f4af684020304b4f8703d (127.20.171.66:40863): tablet aad95cf7774e45e48d707b37f666e622 (table test-table [id=a8e93e6ed6aa49678020503a1084a864]) successfully deleted
I20260807 10:38:23.810364 832 raft_consensus.cc:2258] T aad95cf7774e45e48d707b37f666e622 P 3738bd2ea12248ffa3187b28f7ab20fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:38:23.813413 831 tablet_replica.cc:330] T aad95cf7774e45e48d707b37f666e622 P 9d38fff4e5814b54a567af725431eb34: stopping tablet replica
I20260807 10:38:23.813973 831 raft_consensus.cc:2229] T aad95cf7774e45e48d707b37f666e622 P 9d38fff4e5814b54a567af725431eb34 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 10:38:23.814602 832 ts_tablet_manager.cc:1905] T aad95cf7774e45e48d707b37f666e622 P 3738bd2ea12248ffa3187b28f7ab20fc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 10:38:23.814841 831 raft_consensus.cc:2258] T aad95cf7774e45e48d707b37f666e622 P 9d38fff4e5814b54a567af725431eb34 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:38:23.817339 831 ts_tablet_manager.cc:1905] T aad95cf7774e45e48d707b37f666e622 P 9d38fff4e5814b54a567af725431eb34: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 10:38:23.822714 832 ts_tablet_manager.cc:1918] T aad95cf7774e45e48d707b37f666e622 P 3738bd2ea12248ffa3187b28f7ab20fc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 10:38:23.822924 832 log.cc:1196] T aad95cf7774e45e48d707b37f666e622 P 3738bd2ea12248ffa3187b28f7ab20fc: Deleting WAL directory at /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786098956060137-21165-0/minicluster-data/ts-0/wal/wals/aad95cf7774e45e48d707b37f666e622
I20260807 10:38:23.823781 832 ts_tablet_manager.cc:1939] T aad95cf7774e45e48d707b37f666e622 P 3738bd2ea12248ffa3187b28f7ab20fc: Deleting consensus metadata
I20260807 10:38:23.825848 32740 catalog_manager.cc:4841] TS 3738bd2ea12248ffa3187b28f7ab20fc (127.20.171.65:45277): tablet aad95cf7774e45e48d707b37f666e622 (table test-table [id=a8e93e6ed6aa49678020503a1084a864]) successfully deleted
I20260807 10:38:23.827332 831 ts_tablet_manager.cc:1918] T aad95cf7774e45e48d707b37f666e622 P 9d38fff4e5814b54a567af725431eb34: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 10:38:23.827600 831 log.cc:1196] T aad95cf7774e45e48d707b37f666e622 P 9d38fff4e5814b54a567af725431eb34: Deleting WAL directory at /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786098956060137-21165-0/minicluster-data/ts-2/wal/wals/aad95cf7774e45e48d707b37f666e622
I20260807 10:38:23.828359 831 ts_tablet_manager.cc:1939] T aad95cf7774e45e48d707b37f666e622 P 9d38fff4e5814b54a567af725431eb34: Deleting consensus metadata
Aug 07 10:38:23 dist-test-slave-0b58 krb5kdc[32274](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099098, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.171.65@KRBTEST.COM
I20260807 10:38:23.830835 32741 catalog_manager.cc:4841] TS 9d38fff4e5814b54a567af725431eb34 (127.20.171.67:43085): tablet aad95cf7774e45e48d707b37f666e622 (table test-table [id=a8e93e6ed6aa49678020503a1084a864]) successfully deleted
I20260807 10:38:23.839748 801 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:38:23.783155 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38836 (local address 127.20.171.65:45277)
0807 10:38:23.783328 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0807 10:38:23.783334 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:38:23.805942 (+ 22608us) server_negotiation.cc:407] Connection header received
0807 10:38:23.806448 (+ 506us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:38:23.806457 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:38:23.806567 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:38:23.806652 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:38:23.810786 (+ 4134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:38:23.811570 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:38:23.813998 (+ 2428us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:38:23.815023 (+ 1025us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:38:23.815151 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:38:23.832527 (+ 17376us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:38:23.832551 (+ 24us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:38:23.832583 (+ 32us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:38:23.832678 (+ 95us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:38:23.836519 (+ 3841us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:38:23.837248 (+ 729us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:38:23.837255 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:38:23.837257 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:38:23.837433 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:38:23.837909 (+ 476us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:38:23.837914 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:38:23.837918 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:38:23.838452 (+ 534us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:38:23.838802 (+ 350us) server_negotiation.cc:1035] Waiting for connection context
0807 10:38:23.839027 (+ 225us) server_negotiation.cc:299] Negotiation successful
0807 10:38:23.839258 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260807 10:38:23.840456 500 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:38:23.932619 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 370
I20260807 10:38:23.953351 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 511
Aug 07 10:38:23 dist-test-slave-0b58 krb5kdc[32274](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099098, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.171.66@KRBTEST.COM
I20260807 10:38:23.971431 804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:38:23.954199 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44044 (local address 127.20.171.66:40863)
0807 10:38:23.954411 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0807 10:38:23.954416 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:38:23.954534 (+ 118us) server_negotiation.cc:407] Connection header received
0807 10:38:23.954713 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:38:23.954717 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:38:23.954800 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:38:23.954934 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:38:23.956696 (+ 1762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:38:23.957513 (+ 817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:38:23.959473 (+ 1960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:38:23.959887 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:38:23.959970 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:38:23.965185 (+ 5215us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:38:23.965199 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:38:23.965214 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:38:23.965245 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:38:23.968690 (+ 3445us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:38:23.969356 (+ 666us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:38:23.969365 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:38:23.969374 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:38:23.969529 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:38:23.969878 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:38:23.969883 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:38:23.969887 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:38:23.970205 (+ 318us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:38:23.970501 (+ 296us) server_negotiation.cc:1035] Waiting for connection context
0807 10:38:23.970816 (+ 315us) server_negotiation.cc:299] Negotiation successful
0807 10:38:23.971045 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260807 10:38:23.972083 646 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:38:24.083519 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 511
I20260807 10:38:24.104067 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 657
Aug 07 10:38:24 dist-test-slave-0b58 krb5kdc[32274](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099098, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.171.67@KRBTEST.COM
I20260807 10:38:24.121421 803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:38:24.104845 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46950 (local address 127.20.171.67:43085)
0807 10:38:24.105031 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0807 10:38:24.105036 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:38:24.105053 (+ 17us) server_negotiation.cc:407] Connection header received
0807 10:38:24.105205 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:38:24.105209 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:38:24.105269 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:38:24.105358 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:38:24.106610 (+ 1252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:38:24.107346 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:38:24.108765 (+ 1419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:38:24.109259 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:38:24.109350 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:38:24.116378 (+ 7028us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:38:24.116392 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:38:24.116407 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:38:24.116438 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:38:24.119047 (+ 2609us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:38:24.119648 (+ 601us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:38:24.119653 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:38:24.119655 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:38:24.119767 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:38:24.120044 (+ 277us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:38:24.120047 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:38:24.120048 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:38:24.120438 (+ 390us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:38:24.120632 (+ 194us) server_negotiation.cc:1035] Waiting for connection context
0807 10:38:24.120872 (+ 240us) server_negotiation.cc:299] Negotiation successful
0807 10:38:24.121028 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260807 10:38:24.122138 782 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:38:24.207734 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 657
I20260807 10:38:24.228709 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 32724
I20260807 10:38:24.230099 319 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:38:24.341138 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 32724
I20260807 10:38:24.367547 21165 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260807 10:38:24.713088 21165 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260807 10:38:24.713380 21165 mini_ranger.cc:66] Stopping Ranger...
I20260807 10:38:25.057772 21165 mini_ranger.cc:68] Stopped Ranger
2026-08-07 10:38:25.058 UTC [32305] LOG: received smart shutdown request
2026-08-07 10:38:25.061 UTC [32305] LOG: background worker "logical replication launcher" (PID 32314) exited with exit code 1
2026-08-07 10:38:25.062 UTC [32309] LOG: shutting down
2026-08-07 10:38:25.222 UTC [32305] LOG: database system is shut down
2026-08-07T10:38:25Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (50115 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 10:38:25 dist-test-slave-0b58 krb5kdc[847](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 10:38:25 dist-test-slave-0b58 krb5kdc[847](info): set up 2 sockets
Aug 07 10:38:25 dist-test-slave-0b58 krb5kdc[847](info): commencing operation
krb5kdc: starting...
W20260807 10:38:26.448361 21165 mini_kdc.cc:121] Time spent starting KDC: real 1.053s user 0.004s sys 0.037s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/krb5kdc/test-user.keytab.
Aug 07 10:38:26 dist-test-slave-0b58 krb5kdc[847](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099106, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T10:38:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T10:38:26Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.20.171.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.20.171.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.20.171.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/krb5kdc/rangeradmin_127.20.171.84@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.20.171.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/krb5kdc/rangeradmin_127.20.171.84@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.20.171.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.20.171.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.20.171.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/krb5kdc/rangerlookup_127.20.171.84@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.20.171.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/krb5kdc/rangerlookup_127.20.171.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.20.171.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.20.171.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.20.171.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/krb5kdc/HTTP_127.20.171.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.20.171.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/krb5kdc/HTTP_127.20.171.84@KRBTEST.COM.keytab.
I20260807 10:38:26.846642 21165 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskXRtsKb/build/asan/bin/postgres/pg_ctl -D /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/minicluster-data/postgres -l logfile start
2026-08-07 10:38:29.236 UTC [879] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-07 10:38:29.236 UTC [879] LOG: listening on IPv4 address "127.20.171.84", port 55035
2026-08-07 10:38:29.240 UTC [879] LOG: listening on Unix socket "/tmp/.s.PGSQL.55035"
2026-08-07 10:38:29.263 UTC [881] LOG: database system was shut down at 2026-08-07 10:38:27 UTC
2026-08-07 10:38:29.267 UTC [879] LOG: database system is ready to accept connections
I20260807 10:38:30.253289 21165 mini_postgres.cc:96] Postgres bound to 55035
2026-08-07 10:38:30.278 UTC [890] FATAL: database "slave" does not exist
127.20.171.84:55035 - accepting connections
I20260807 10:38:30.278873 21165 mini_ranger.cc:161] Starting Ranger...
I20260807 10:38:30.309333 21165 mini_ranger.cc:84] Created miniranger Postgres user
I20260807 10:38:30.758356 21165 mini_ranger.cc:87] Created ranger Postgres database
I20260807 10:38:30.758490 21165 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/minicluster-data/ranger-admin
2026-08-07 10:38:31,047 [I] DB FLAVOR :POSTGRES
2026-08-07 10:38:31,047 [I] --------- Verifying Ranger DB connection ---------
2026-08-07 10:38:31,048 [I] Checking connection..
2026-08-07 10:38:31,048 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXRtsKb/build/asan/bin/postgresql.jar:/tmp/dist-test-taskXRtsKb/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.171.84:55035/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-07 10:38:31,302 [I] Checking connection passed.
2026-08-07 10:38:31,303 [I] --------- Verifying version history table ---------
2026-08-07 10:38:31,303 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXRtsKb/build/asan/bin/postgresql.jar:/tmp/dist-test-taskXRtsKb/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.171.84:55035/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-07 10:38:31,538 [I] Table x_db_version_h does not exist in database ranger
2026-08-07 10:38:31,538 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXRtsKb/build/asan/bin/postgresql.jar:/tmp/dist-test-taskXRtsKb/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.171.84:55035/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-07 10:38:31,776 [I] Table x_db_version_h does not exist in database ranger
2026-08-07 10:38:31,777 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-07 10:38:31,777 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXRtsKb/build/asan/bin/postgresql.jar:/tmp/dist-test-taskXRtsKb/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.171.84:55035/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskXRtsKb/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-07 10:38:32.020 UTC [954] WARNING: there is no transaction in progress
2026-08-07 10:38:32,027 [I] create_dbversion_catalog.sql file imported successfully
2026-08-07 10:38:32,028 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXRtsKb/build/asan/bin/postgresql.jar:/tmp/dist-test-taskXRtsKb/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.171.84:55035/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-07 10:38:32,263 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-07 10:38:32,263 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-07 10:38:32,264 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXRtsKb/build/asan/bin/postgresql.jar:/tmp/dist-test-taskXRtsKb/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.171.84:55035/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-07 10:38:32,495 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXRtsKb/build/asan/bin/postgresql.jar:/tmp/dist-test-taskXRtsKb/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.171.84:55035/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-07 10:38:32,717 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXRtsKb/build/asan/bin/postgresql.jar:/tmp/dist-test-taskXRtsKb/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.171.84:55035/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-0b58.c.gcp-upstream.internal','N') ;"
2026-08-07 10:38:32,939 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXRtsKb/build/asan/bin/postgresql.jar:/tmp/dist-test-taskXRtsKb/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.171.84:55035/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-07 10:38:33,189 [I] Table x_portal_user does not exist in database ranger
2026-08-07 10:38:33,189 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXRtsKb/build/asan/bin/postgresql.jar:/tmp/dist-test-taskXRtsKb/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.171.84:55035/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-07 10:38:33,436 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-07 10:38:33,436 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXRtsKb/build/asan/bin/postgresql.jar:/tmp/dist-test-taskXRtsKb/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.171.84:55035/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-07 10:38:33,688 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXRtsKb/build/asan/bin/postgresql.jar:/tmp/dist-test-taskXRtsKb/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.171.84:55035/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-07 10:38:33,928 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-07 10:38:33,929 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXRtsKb/build/asan/bin/postgresql.jar:/tmp/dist-test-taskXRtsKb/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.171.84:55035/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskXRtsKb/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-07 10:38:34.830 UTC [1065] WARNING: there is no transaction in progress
2026-08-07 10:38:34.845 UTC [1065] WARNING: there is no transaction in progress
2026-08-07 10:38:34.861 UTC [1065] WARNING: there is no transaction in progress
2026-08-07 10:38:34.876 UTC [1065] WARNING: there is no transaction in progress
2026-08-07 10:38:34.894 UTC [1065] WARNING: there is no transaction in progress
2026-08-07 10:38:34.911 UTC [1065] WARNING: there is no transaction in progress
2026-08-07 10:38:34.969 UTC [1065] WARNING: there is no transaction in progress
2026-08-07 10:38:34.976 UTC [1065] WARNING: there is no transaction in progress
2026-08-07 10:38:34.989 UTC [1065] WARNING: there is no transaction in progress
2026-08-07 10:38:34.999 UTC [1065] WARNING: there is no transaction in progress
2026-08-07 10:38:35.008 UTC [1065] WARNING: there is no transaction in progress
2026-08-07 10:38:35.022 UTC [1065] WARNING: there is no transaction in progress
2026-08-07 10:38:35.031 UTC [1065] WARNING: there is no transaction in progress
2026-08-07 10:38:35.037 UTC [1065] WARNING: there is no transaction in progress
2026-08-07 10:38:35.043 UTC [1065] WARNING: there is no transaction in progress
2026-08-07 10:38:35.049 UTC [1065] WARNING: there is no transaction in progress
2026-08-07 10:38:35,633 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-07 10:38:35,633 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXRtsKb/build/asan/bin/postgresql.jar:/tmp/dist-test-taskXRtsKb/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.171.84:55035/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-07 10:38:35,860 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-07 10:38:35,860 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXRtsKb/build/asan/bin/postgresql.jar:/tmp/dist-test-taskXRtsKb/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.171.84:55035/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-07 10:38:36,100 [I] Table x_portal_user already exists in database 'ranger'
2026-08-07 10:38:36,100 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXRtsKb/build/asan/bin/postgresql.jar:/tmp/dist-test-taskXRtsKb/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.171.84:55035/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-07 10:38:36,349 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-07 10:38:36,349 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXRtsKb/build/asan/bin/postgresql.jar:/tmp/dist-test-taskXRtsKb/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.171.84:55035/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-07 10:38:36,575 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXRtsKb/build/asan/bin/postgresql.jar:/tmp/dist-test-taskXRtsKb/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.171.84:55035/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-07 10:38:36,789 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXRtsKb/build/asan/bin/postgresql.jar:/tmp/dist-test-taskXRtsKb/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.171.84:55035/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-0b58.c.gcp-upstream.internal';"
2026-08-07 10:38:37,027 [I] CORE_DB_SCHEMA import status has been updated
2026-08-07 10:38:37,027 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXRtsKb/build/asan/bin/postgresql.jar:/tmp/dist-test-taskXRtsKb/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.171.84:55035/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-07 10:38:37,246 [I] DB_PATCHES have already been applied
I20260807 10:38:37.252396 21165 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/minicluster-data/ranger-admin:/tmp/dist-test-taskXRtsKb/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskXRtsKb/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskXRtsKb/build/asan/bin/postgresql.jar:/tmp/dist-test-taskXRtsKb/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260807 10:38:37.252480 21165 mini_ranger.cc:193] Using host: 127.20.171.84
I20260807 10:38:37.275115 21165 mini_ranger.cc:227] Ranger admin URL: http://127.20.171.84:50497
Aug 07, 2026 10:38:37 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 07, 2026 10:38:37 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 07, 2026 10:38:37 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/minicluster-data/ranger-admin/ews/webapp
Aug 07, 2026 10:38:37 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 07, 2026 10:38:37 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 07, 2026 10:38:38 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/minicluster-data/ranger-admin/ews/webapp].
Aug 07, 2026 10:38:38 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260807 10:38:38.362957 21165 mini_ranger.cc:160] Time spent starting Ranger: real 8.084s user 0.005s sys 0.056s
Aug 07, 2026 10:38:58 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 07, 2026 10:38:58 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.UserREST
Aug 07, 2026 10:38:58 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 07, 2026 10:38:58 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 07, 2026 10:38:58 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 07, 2026 10:38:58 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 07, 2026 10:38:58 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 07, 2026 10:38:58 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 07, 2026 10:38:58 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 07, 2026 10:38:58 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 07, 2026 10:38:58 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 07, 2026 10:38:58 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 07, 2026 10:38:58 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 07, 2026 10:38:58 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 07, 2026 10:38:58 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 07, 2026 10:38:58 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 07, 2026 10:38:58 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 07, 2026 10:38:58 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260807 10:38:59.528095 21165 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.20.171.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.20.171.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.20.171.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/krb5kdc/rangerkms_127.20.171.84@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.20.171.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/krb5kdc/rangerkms_127.20.171.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.20.171.84@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.20.171.84@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.20.171.84@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/krb5kdc/HTTP_127.20.171.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.20.171.84@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/krb5kdc/HTTP_127.20.171.84@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 07 10:38:59 dist-test-slave-0b58 krb5kdc[847](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099139, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260807 10:38:59.727144 21165 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260807 10:38:59.753145 21165 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260807 10:39:00.595598 21165 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260807 10:39:00.595747 21165 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/minicluster-data/ranger-kms
I20260807 10:39:00.595793 21165 mini_ranger_kms.cc:227] Using postgres at 127.20.171.84:55035
2026-08-07 10:39:00,956 [I] DB FLAVOR :POSTGRES
2026-08-07 10:39:00,957 [I] --------- Verifying Ranger DB connection ---------
2026-08-07 10:39:00,957 [I] Checking connection
2026-08-07 10:39:00,957 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXRtsKb/build/asan/bin/postgresql.jar:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.171.84:55035/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-07 10:39:01,198 [I] connection success
2026-08-07 10:39:01,199 [I] --------- Verifying Ranger DB tables ---------
2026-08-07 10:39:01,199 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-07 10:39:01,199 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXRtsKb/build/asan/bin/postgresql.jar:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.171.84:55035/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-07 10:39:01,423 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-07 10:39:01,424 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-07 10:39:01,424 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-07 10:39:01,424 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskXRtsKb/build/asan/bin/postgresql.jar:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.171.84:55035/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-07 10:39:01,668 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260807 10:39:02.107503 21165 mini_ranger_kms.cc:310] Created kms service
I20260807 10:39:02.323736 21165 mini_ranger_kms.cc:326] Created kudu user
I20260807 10:39:02.369580 21165 mini_ranger_kms.cc:343] Created rangerkms user
Aug 07 10:39:02 dist-test-slave-0b58 krb5kdc[847](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099139, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.20.171.84@KRBTEST.COM
I20260807 10:39:02.788718 21165 mini_ranger_kms.cc:384] Added ranger policy
I20260807 10:39:02.789112 21165 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/minicluster-data/ranger-kms:/tmp/dist-test-taskXRtsKb/build/asan/bin/postgresql.jar:/tmp/dist-test-taskXRtsKb/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskXRtsKb/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260807 10:39:02.789162 21165 mini_ranger_kms.cc:240] Using host: 127.20.171.84
I20260807 10:39:02.812054 21165 mini_ranger_kms.cc:276] Ranger KMS PID: 1249
I20260807 10:39:02.812192 21165 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.20.171.84:36831
Aug 07, 2026 10:39:03 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 07, 2026 10:39:03 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 07, 2026 10:39:03 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 07, 2026 10:39:03 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 07, 2026 10:39:04 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/minicluster-data/ranger-kms/ews/webapp].
Aug 07, 2026 10:39:04 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 07 10:39:04 dist-test-slave-0b58 krb5kdc[847](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786099144, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.20.171.84@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:39:05.079669 21165 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.353s user 0.080s sys 0.315s
I20260807 10:39:05.079897 21165 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260807 10:39:05.080041 21165 mini_ranger_kms.cc:401] 127.20.171.84:36831/kms/v1/keys
Aug 07 10:39:05 dist-test-slave-0b58 krb5kdc[847](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099144, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.20.171.84@KRBTEST.COM for HTTP/127.20.171.84@KRBTEST.COM
Aug 07 10:39:05 dist-test-slave-0b58 krb5kdc[847](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099144, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.20.171.84@KRBTEST.COM for HTTP/127.20.171.84@KRBTEST.COM
Aug 07 10:39:07 dist-test-slave-0b58 krb5kdc[847](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099147, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.20.171.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.171.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.171.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.126.keytab.
Entry for principal kudu/127.20.171.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.126.keytab.
I20260807 10:39:08.032611 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.171.126:37057
--webserver_interface=127.20.171.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.126.keytab
--principal=kudu/127.20.171.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.171.84:35559
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.171.126:37057
--ranger_config_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.20.171.84:36831/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:39:08.358865 1300 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:39:08.359174 1300 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:39:08.359325 1300 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:39:08.366158 1300 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 10:39:08.366308 1300 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:39:08.366410 1300 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:39:08.366513 1300 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 10:39:08.366592 1300 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 10:39:08.376009 1300 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.171.84:35559
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/minicluster-data/master-0/wal
--ranger_kms_url=127.20.171.84:36831/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.20.171.126:37057
--ranger_config_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.126.keytab
--principal=kudu/127.20.171.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.171.126:37057
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.171.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:39:08.377246 1300 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:39:08.378470 1300 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:39:08.391315 1305 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:39:08.391288 1306 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:39:08.392325 1308 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:39:08.393038 1300 server_base.cc:1034] running on GCE node
I20260807 10:39:08.393923 1300 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:39:08.395509 1300 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:39:08.396747 1300 hybrid_clock.cc:648] HybridClock initialized: now 1786099148396680 us; error 50 us; skew 500 ppm
I20260807 10:39:08.397131 1300 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:39:08 dist-test-slave-0b58 krb5kdc[847](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099148, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:39:08.405791 1300 init.cc:377] Logged in from keytab as kudu/127.20.171.126@KRBTEST.COM (short username kudu)
I20260807 10:39:08.407335 1300 webserver.cc:460] Webserver started at http://127.20.171.126:41861/ using document root <none> and password file <none>
I20260807 10:39:08.407963 1300 fs_manager.cc:359] Metadata directory not provided
I20260807 10:39:08.408097 1300 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:39:08.408461 1300 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 07 10:39:08 dist-test-slave-0b58 krb5kdc[847](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099148, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.126@KRBTEST.COM for HTTP/127.20.171.84@KRBTEST.COM
I20260807 10:39:08.465632 1300 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/minicluster-data/master-0/data/instance:
uuid: "7cec2f01818242f78f60d7f3be0b7ba2"
format_stamp: "Formatted at 2026-08-07 10:39:08 on dist-test-slave-0b58"
server_key: "0e9bbdea2aa4d07bed41332743e35520"
server_key_iv: "a80559a71c9f5c987c2db6cd01cc8461"
server_key_version: "kuduclusterkey@0"
I20260807 10:39:08.466768 1300 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/minicluster-data/master-0/wal/instance:
uuid: "7cec2f01818242f78f60d7f3be0b7ba2"
format_stamp: "Formatted at 2026-08-07 10:39:08 on dist-test-slave-0b58"
server_key: "0e9bbdea2aa4d07bed41332743e35520"
server_key_iv: "a80559a71c9f5c987c2db6cd01cc8461"
server_key_version: "kuduclusterkey@0"
I20260807 10:39:08.473613 1300 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.001s
I20260807 10:39:08.492159 1315 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:39:08.493779 1300 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260807 10:39:08.493944 1300 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/minicluster-data/master-0/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/minicluster-data/master-0/wal
uuid: "7cec2f01818242f78f60d7f3be0b7ba2"
format_stamp: "Formatted at 2026-08-07 10:39:08 on dist-test-slave-0b58"
server_key: "0e9bbdea2aa4d07bed41332743e35520"
server_key_iv: "a80559a71c9f5c987c2db6cd01cc8461"
server_key_version: "kuduclusterkey@0"
I20260807 10:39:08.494163 1300 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:39:08.515479 1300 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:39:08.519951 1300 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:39:08.520289 1300 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:39:08.539055 1367 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.171.126:37057 every 8 connection(s)
I20260807 10:39:08.539072 1300 rpc_server.cc:307] RPC server started. Bound to: 127.20.171.126:37057
I20260807 10:39:08.540753 1300 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
I20260807 10:39:08.544034 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 1300
I20260807 10:39:08.544292 21165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/minicluster-data/master-0/wal/instance
I20260807 10:39:08.544481 1368 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:39:08.545127 21165 external_mini_cluster.cc:1428] Setting key 24b197c0008efa51c76b190d69c97f0a
I20260807 10:39:08.562058 1368 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7cec2f01818242f78f60d7f3be0b7ba2: Bootstrap starting.
I20260807 10:39:08.565210 1368 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7cec2f01818242f78f60d7f3be0b7ba2: Neither blocks nor log segments found. Creating new log.
I20260807 10:39:08.566581 1368 log.cc:824] T 00000000000000000000000000000000 P 7cec2f01818242f78f60d7f3be0b7ba2: Log is configured to *not* fsync() on all Append() calls
I20260807 10:39:08.569726 1368 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7cec2f01818242f78f60d7f3be0b7ba2: No bootstrap required, opened a new log
Aug 07 10:39:08 dist-test-slave-0b58 krb5kdc[847](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099147, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.171.126@KRBTEST.COM
I20260807 10:39:08.577932 1368 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7cec2f01818242f78f60d7f3be0b7ba2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7cec2f01818242f78f60d7f3be0b7ba2" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 37057 } }
I20260807 10:39:08.578322 1368 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7cec2f01818242f78f60d7f3be0b7ba2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:39:08.578449 1368 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7cec2f01818242f78f60d7f3be0b7ba2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7cec2f01818242f78f60d7f3be0b7ba2, State: Initialized, Role: FOLLOWER
I20260807 10:39:08.579066 1368 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7cec2f01818242f78f60d7f3be0b7ba2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7cec2f01818242f78f60d7f3be0b7ba2" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 37057 } }
I20260807 10:39:08.579305 1368 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7cec2f01818242f78f60d7f3be0b7ba2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 10:39:08.579460 1368 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7cec2f01818242f78f60d7f3be0b7ba2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 10:39:08.579645 1368 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7cec2f01818242f78f60d7f3be0b7ba2 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:39:08.582275 1368 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7cec2f01818242f78f60d7f3be0b7ba2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7cec2f01818242f78f60d7f3be0b7ba2" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 37057 } }
I20260807 10:39:08.582757 1368 leader_election.cc:302] T 00000000000000000000000000000000 P 7cec2f01818242f78f60d7f3be0b7ba2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7cec2f01818242f78f60d7f3be0b7ba2; no voters:
I20260807 10:39:08.585067 1371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:08.547196 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44530 (local address 127.20.171.126:37057)
0807 10:39:08.562167 (+ 14971us) server_negotiation.cc:206] Beginning negotiation
0807 10:39:08.562251 (+ 84us) server_negotiation.cc:399] Waiting for connection header
0807 10:39:08.562301 (+ 50us) server_negotiation.cc:407] Connection header received
0807 10:39:08.564611 (+ 2310us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:39:08.564637 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:39:08.565112 (+ 475us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:39:08.565547 (+ 435us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:39:08.567353 (+ 1806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:08.569079 (+ 1726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:08.570868 (+ 1789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:08.571861 (+ 993us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:08.572030 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:39:08.576880 (+ 4850us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:39:08.576889 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:39:08.576913 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:39:08.576969 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:39:08.580692 (+ 3723us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:39:08.581430 (+ 738us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:39:08.581437 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:39:08.581444 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:39:08.581622 (+ 178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:39:08.582010 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:39:08.582014 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:39:08.582017 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:39:08.582636 (+ 619us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:39:08.582920 (+ 284us) server_negotiation.cc:1035] Waiting for connection context
0807 10:39:08.583382 (+ 462us) server_negotiation.cc:299] Negotiation successful
0807 10:39:08.583745 (+ 363us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14705,"thread_start_us":14463,"threads_started":1}
I20260807 10:39:08.592535 1368 leader_election.cc:288] T 00000000000000000000000000000000 P 7cec2f01818242f78f60d7f3be0b7ba2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 10:39:08.592620 1373 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7cec2f01818242f78f60d7f3be0b7ba2 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:39:08.593815 1373 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7cec2f01818242f78f60d7f3be0b7ba2 [term 1 LEADER]: Becoming Leader. State: Replica: 7cec2f01818242f78f60d7f3be0b7ba2, State: Running, Role: LEADER
I20260807 10:39:08.594398 1373 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7cec2f01818242f78f60d7f3be0b7ba2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7cec2f01818242f78f60d7f3be0b7ba2" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 37057 } }
I20260807 10:39:08.594619 1368 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7cec2f01818242f78f60d7f3be0b7ba2 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 10:39:08.597800 1375 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7cec2f01818242f78f60d7f3be0b7ba2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7cec2f01818242f78f60d7f3be0b7ba2. Latest consensus state: current_term: 1 leader_uuid: "7cec2f01818242f78f60d7f3be0b7ba2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7cec2f01818242f78f60d7f3be0b7ba2" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 37057 } } }
I20260807 10:39:08.598161 1375 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7cec2f01818242f78f60d7f3be0b7ba2 [sys.catalog]: This master's current role is: LEADER
I20260807 10:39:08.598703 1374 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7cec2f01818242f78f60d7f3be0b7ba2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7cec2f01818242f78f60d7f3be0b7ba2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7cec2f01818242f78f60d7f3be0b7ba2" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 37057 } } }
I20260807 10:39:08.598966 1374 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7cec2f01818242f78f60d7f3be0b7ba2 [sys.catalog]: This master's current role is: LEADER
I20260807 10:39:08.602080 1382 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 10:39:08.607764 1382 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 10:39:08.608523 1368 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260807 10:39:08.629885 1382 catalog_manager.cc:1347] Generated new cluster ID: 4da10dddfc114160a0ee84bf696d4323
I20260807 10:39:08.630119 1382 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 10:39:08.653359 1382 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 10:39:08.655865 1382 catalog_manager.cc:1504] Loading token signing keys...
I20260807 10:39:08.668229 1382 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7cec2f01818242f78f60d7f3be0b7ba2: Generated new TSK 0
I20260807 10:39:08.669344 1382 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.171.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.171.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.171.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.65.keytab.
Entry for principal kudu/127.20.171.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.65.keytab.
I20260807 10:39:09.411586 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.20.171.84:36831/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.171.65:0
--local_ip_for_outbound_sockets=127.20.171.65
--webserver_interface=127.20.171.65
--webserver_port=0
--tserver_master_addrs=127.20.171.126:37057
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.65.keytab
--principal=kudu/127.20.171.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.171.84:35559
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 10:39:09 dist-test-slave-0b58 krb5kdc[847](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786099149, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260807 10:39:09.842011 1415 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:39:09.842491 1415 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:39:09.842724 1415 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:39:09.853830 1415 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:39:09.853960 1415 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:39:09.854194 1415 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.171.65
I20260807 10:39:09.865091 1415 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.171.84:35559
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.20.171.84:36831/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.65.keytab
--principal=kudu/127.20.171.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.171.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.171.65
--webserver_port=0
--tserver_master_addrs=127.20.171.126:37057
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.171.65
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:39:09.866405 1415 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:39:09.867729 1415 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:39:09.893244 1425 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:39:09.894476 1426 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:39:09.902362 1428 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:39:09.902848 1415 server_base.cc:1034] running on GCE node
I20260807 10:39:09.903681 1415 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:39:09.904982 1415 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:39:09.906319 1415 hybrid_clock.cc:648] HybridClock initialized: now 1786099149906213 us; error 107 us; skew 500 ppm
I20260807 10:39:09.906761 1415 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:39:09 dist-test-slave-0b58 krb5kdc[847](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099149, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:39:09.910929 1415 init.cc:377] Logged in from keytab as kudu/127.20.171.65@KRBTEST.COM (short username kudu)
I20260807 10:39:09.916610 1415 webserver.cc:460] Webserver started at http://127.20.171.65:43221/ using document root <none> and password file <none>
I20260807 10:39:09.917474 1415 fs_manager.cc:359] Metadata directory not provided
I20260807 10:39:09.917682 1415 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:39:09.918049 1415 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 07 10:39:09 dist-test-slave-0b58 krb5kdc[847](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099149, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.65@KRBTEST.COM for HTTP/127.20.171.84@KRBTEST.COM
I20260807 10:39:09.941190 1415 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/minicluster-data/ts-0/data/instance:
uuid: "1115cad94eac44eab3e2c85a51374d15"
format_stamp: "Formatted at 2026-08-07 10:39:09 on dist-test-slave-0b58"
server_key: "429c5b8b145d5bfe773518aa39c7606c"
server_key_iv: "46bc91fc070f2892f928d8bcd1a7fbdd"
server_key_version: "kuduclusterkey@0"
I20260807 10:39:09.942592 1415 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/minicluster-data/ts-0/wal/instance:
uuid: "1115cad94eac44eab3e2c85a51374d15"
format_stamp: "Formatted at 2026-08-07 10:39:09 on dist-test-slave-0b58"
server_key: "429c5b8b145d5bfe773518aa39c7606c"
server_key_iv: "46bc91fc070f2892f928d8bcd1a7fbdd"
server_key_version: "kuduclusterkey@0"
I20260807 10:39:09.952085 1415 fs_manager.cc:691] Time spent creating directory manager: real 0.009s user 0.001s sys 0.004s
I20260807 10:39:09.979041 1435 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:39:09.980928 1415 fs_manager.cc:725] Time spent opening block manager: real 0.010s user 0.009s sys 0.000s
I20260807 10:39:09.981211 1415 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/minicluster-data/ts-0/wal
uuid: "1115cad94eac44eab3e2c85a51374d15"
format_stamp: "Formatted at 2026-08-07 10:39:09 on dist-test-slave-0b58"
server_key: "429c5b8b145d5bfe773518aa39c7606c"
server_key_iv: "46bc91fc070f2892f928d8bcd1a7fbdd"
server_key_version: "kuduclusterkey@0"
I20260807 10:39:09.981564 1415 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:39:10.030633 1415 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:39:10.042237 1415 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:39:10.042629 1415 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:39:10.047060 1415 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:39:10.048941 1415 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:39:10.049042 1415 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:39:10.049191 1415 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:39:10.049268 1415 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 07 10:39:10 dist-test-slave-0b58 krb5kdc[847](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099149, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.126@KRBTEST.COM for HTTP/127.20.171.84@KRBTEST.COM
I20260807 10:39:10.233737 1550 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.171.65:34011 every 8 connection(s)
I20260807 10:39:10.233697 1415 rpc_server.cc:307] RPC server started. Bound to: 127.20.171.65:34011
I20260807 10:39:10.237095 1415 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/minicluster-data/ts-0/data/info.pb
I20260807 10:39:10.238766 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 1415
I20260807 10:39:10.239020 21165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/minicluster-data/ts-0/wal/instance
I20260807 10:39:10.240023 21165 external_mini_cluster.cc:1428] Setting key 68b671a13e7771d45d1f328013ed4a46
Aug 07 10:39:10 dist-test-slave-0b58 krb5kdc[847](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099149, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.65@KRBTEST.COM for kudu/127.20.171.126@KRBTEST.COM
I20260807 10:39:10.304219 1554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:10.261357 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.65:38759 (local address 127.20.171.126:37057)
0807 10:39:10.280847 (+ 19490us) server_negotiation.cc:206] Beginning negotiation
0807 10:39:10.280852 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:39:10.280872 (+ 20us) server_negotiation.cc:407] Connection header received
0807 10:39:10.280933 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:39:10.280938 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:39:10.281028 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:39:10.281147 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:39:10.287247 (+ 6100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:10.288496 (+ 1249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:10.290836 (+ 2340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:10.291417 (+ 581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:10.291509 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:39:10.296577 (+ 5068us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:39:10.296585 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:39:10.296591 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:39:10.296633 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:39:10.300249 (+ 3616us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:39:10.301247 (+ 998us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:39:10.301255 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:39:10.301260 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:39:10.301402 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:39:10.301938 (+ 536us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:39:10.301945 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:39:10.301949 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:39:10.302313 (+ 364us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:39:10.302430 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0807 10:39:10.303486 (+ 1056us) server_negotiation.cc:299] Negotiation successful
0807 10:39:10.303749 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19348,"thread_start_us":19907,"threads_started":1}
I20260807 10:39:10.306659 1555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:10.261937 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:37057 (local address 127.20.171.65:38759)
0807 10:39:10.274589 (+ 12652us) negotiation.cc:107] Waiting for socket to connect
0807 10:39:10.274641 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0807 10:39:10.277185 (+ 2544us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:39:10.285351 (+ 8166us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:39:10.285390 (+ 39us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:39:10.286154 (+ 764us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:39:10.287020 (+ 866us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:39:10.287050 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:39:10.288718 (+ 1668us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:39:10.288723 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:39:10.290656 (+ 1933us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:39:10.290671 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:39:10.291864 (+ 1193us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:39:10.291872 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:39:10.292149 (+ 277us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:39:10.292991 (+ 842us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:39:10.293024 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:39:10.296329 (+ 3305us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:39:10.300462 (+ 4133us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:39:10.300472 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:39:10.300490 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:39:10.301119 (+ 629us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:39:10.301536 (+ 417us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:39:10.301541 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:39:10.301546 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:39:10.301820 (+ 274us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:39:10.302534 (+ 714us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:39:10.302543 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:39:10.303029 (+ 486us) client_negotiation.cc:769] Sending connection context
0807 10:39:10.304553 (+ 1524us) client_negotiation.cc:240] Negotiation successful
0807 10:39:10.305170 (+ 617us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12326,"thread_start_us":13796,"threads_started":1}
WARNING: no policy specified for kudu/127.20.171.66@KRBTEST.COM; defaulting to no policy
I20260807 10:39:10.308772 1551 heartbeater.cc:347] Connected to a master server at 127.20.171.126:37057
I20260807 10:39:10.309080 1551 heartbeater.cc:464] Registering TS with master...
I20260807 10:39:10.309852 1551 heartbeater.cc:511] Master 127.20.171.126:37057 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.171.66@KRBTEST.COM" created.
I20260807 10:39:10.312037 1332 ts_manager.cc:194] Registered new tserver with Master: 1115cad94eac44eab3e2c85a51374d15 (127.20.171.65:34011)
I20260807 10:39:10.313436 1332 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.171.65@KRBTEST.COM'} at 127.20.171.65:38759
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.171.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.66.keytab.
Entry for principal kudu/127.20.171.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.66.keytab.
W20260807 10:39:10.346725 21165 mini_kdc.cc:262] Time spent creating service keytab for kudu/127.20.171.66: real 0.103s user 0.000s sys 0.028s
I20260807 10:39:10.347461 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.20.171.84:36831/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.171.66:0
--local_ip_for_outbound_sockets=127.20.171.66
--webserver_interface=127.20.171.66
--webserver_port=0
--tserver_master_addrs=127.20.171.126:37057
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.66.keytab
--principal=kudu/127.20.171.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.171.84:35559
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 10:39:10 dist-test-slave-0b58 krb5kdc[847](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099149, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.126@KRBTEST.COM for HTTP/127.20.171.84@KRBTEST.COM
W20260807 10:39:10.781350 1557 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:39:10.781605 1557 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:39:10.781747 1557 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:39:10.789023 1557 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:39:10.789142 1557 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:39:10.789371 1557 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.171.66
I20260807 10:39:10.798784 1557 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.171.84:35559
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.20.171.84:36831/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.66.keytab
--principal=kudu/127.20.171.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.171.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.171.66
--webserver_port=0
--tserver_master_addrs=127.20.171.126:37057
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.171.66
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:39:10.800033 1557 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:39:10.801349 1557 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:39:10.814643 1574 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:39:10.814625 1572 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:39:10.815485 1571 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:39:10.821703 1557 server_base.cc:1034] running on GCE node
I20260807 10:39:10.822453 1557 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:39:10.823645 1557 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:39:10.824875 1557 hybrid_clock.cc:648] HybridClock initialized: now 1786099150824806 us; error 54 us; skew 500 ppm
I20260807 10:39:10.825260 1557 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:39:10 dist-test-slave-0b58 krb5kdc[847](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099150, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:39:10.829145 1557 init.cc:377] Logged in from keytab as kudu/127.20.171.66@KRBTEST.COM (short username kudu)
I20260807 10:39:10.830766 1557 webserver.cc:460] Webserver started at http://127.20.171.66:33655/ using document root <none> and password file <none>
I20260807 10:39:10.831424 1557 fs_manager.cc:359] Metadata directory not provided
I20260807 10:39:10.831555 1557 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:39:10.831869 1557 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 07 10:39:10 dist-test-slave-0b58 krb5kdc[847](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099150, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.66@KRBTEST.COM for HTTP/127.20.171.84@KRBTEST.COM
I20260807 10:39:10.849042 1557 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/minicluster-data/ts-1/data/instance:
uuid: "668ecc2f8ef447489e78c0b2382d7d56"
format_stamp: "Formatted at 2026-08-07 10:39:10 on dist-test-slave-0b58"
server_key: "a5b87983d211ec557d23f603b4b6b3da"
server_key_iv: "497eb302bc93744365a03bb7c5251e38"
server_key_version: "kuduclusterkey@0"
I20260807 10:39:10.850086 1557 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/minicluster-data/ts-1/wal/instance:
uuid: "668ecc2f8ef447489e78c0b2382d7d56"
format_stamp: "Formatted at 2026-08-07 10:39:10 on dist-test-slave-0b58"
server_key: "a5b87983d211ec557d23f603b4b6b3da"
server_key_iv: "497eb302bc93744365a03bb7c5251e38"
server_key_version: "kuduclusterkey@0"
I20260807 10:39:10.857338 1557 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.002s sys 0.005s
I20260807 10:39:10.874292 1582 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:39:10.876050 1557 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.001s
I20260807 10:39:10.876225 1557 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/minicluster-data/ts-1/wal
uuid: "668ecc2f8ef447489e78c0b2382d7d56"
format_stamp: "Formatted at 2026-08-07 10:39:10 on dist-test-slave-0b58"
server_key: "a5b87983d211ec557d23f603b4b6b3da"
server_key_iv: "497eb302bc93744365a03bb7c5251e38"
server_key_version: "kuduclusterkey@0"
I20260807 10:39:10.876521 1557 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:39:10.894548 1557 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:39:10.899703 1557 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:39:10.900027 1557 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:39:10.901193 1557 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:39:10.902872 1557 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:39:10.902956 1557 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:39:10.903060 1557 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:39:10.903155 1557 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.001s sys 0.000s
I20260807 10:39:10.943516 1557 rpc_server.cc:307] RPC server started. Bound to: 127.20.171.66:44849
I20260807 10:39:10.943565 1696 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.171.66:44849 every 8 connection(s)
I20260807 10:39:10.944916 1557 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/minicluster-data/ts-1/data/info.pb
I20260807 10:39:10.952587 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 1557
I20260807 10:39:10.952780 21165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/minicluster-data/ts-1/wal/instance
I20260807 10:39:10.953481 21165 external_mini_cluster.cc:1428] Setting key 8f9253a9f83bc67f5709dc299e9c99f0
Aug 07 10:39:10 dist-test-slave-0b58 krb5kdc[847](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099150, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.66@KRBTEST.COM for kudu/127.20.171.126@KRBTEST.COM
I20260807 10:39:10.983294 1700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:10.948474 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:37057 (local address 127.20.171.66:52035)
0807 10:39:10.957635 (+ 9161us) negotiation.cc:107] Waiting for socket to connect
0807 10:39:10.957676 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0807 10:39:10.959404 (+ 1728us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:39:10.966771 (+ 7367us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:39:10.966784 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:39:10.967407 (+ 623us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:39:10.967945 (+ 538us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:39:10.967961 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:39:10.969341 (+ 1380us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:39:10.969346 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:39:10.970563 (+ 1217us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:39:10.970582 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:39:10.971525 (+ 943us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:39:10.971532 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:39:10.971808 (+ 276us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:39:10.972569 (+ 761us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:39:10.972597 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:39:10.975291 (+ 2694us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:39:10.979145 (+ 3854us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:39:10.979153 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:39:10.979168 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:39:10.979698 (+ 530us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:39:10.980090 (+ 392us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:39:10.980095 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:39:10.980098 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:39:10.980331 (+ 233us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:39:10.980996 (+ 665us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:39:10.981003 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:39:10.981361 (+ 358us) client_negotiation.cc:769] Sending connection context
0807 10:39:10.981629 (+ 268us) client_negotiation.cc:240] Negotiation successful
0807 10:39:10.982103 (+ 474us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8903,"thread_start_us":8709,"threads_started":1}
I20260807 10:39:10.984625 1699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:10.947764 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.66:52035 (local address 127.20.171.126:37057)
0807 10:39:10.966183 (+ 18419us) server_negotiation.cc:206] Beginning negotiation
0807 10:39:10.966190 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:39:10.966211 (+ 21us) server_negotiation.cc:407] Connection header received
0807 10:39:10.966272 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:39:10.966277 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:39:10.966360 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:39:10.966489 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:39:10.968122 (+ 1633us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:10.969208 (+ 1086us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:10.970710 (+ 1502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:10.971271 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:10.971394 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:39:10.975537 (+ 4143us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:39:10.975543 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:39:10.975548 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:39:10.975587 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:39:10.979007 (+ 3420us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:39:10.979836 (+ 829us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:39:10.979841 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:39:10.979844 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:39:10.979975 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:39:10.980453 (+ 478us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:39:10.980458 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:39:10.980461 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:39:10.980806 (+ 345us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:39:10.980922 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0807 10:39:10.984075 (+ 3153us) server_negotiation.cc:299] Negotiation successful
0807 10:39:10.984302 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18269,"thread_start_us":18841,"threads_started":1}
I20260807 10:39:10.985924 1697 heartbeater.cc:347] Connected to a master server at 127.20.171.126:37057
I20260807 10:39:10.986246 1697 heartbeater.cc:464] Registering TS with master...
I20260807 10:39:10.987061 1697 heartbeater.cc:511] Master 127.20.171.126:37057 requested a full tablet report, sending...
I20260807 10:39:10.988737 1332 ts_manager.cc:194] Registered new tserver with Master: 668ecc2f8ef447489e78c0b2382d7d56 (127.20.171.66:44849)
I20260807 10:39:10.989895 1332 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.171.66@KRBTEST.COM'} at 127.20.171.66:52035
WARNING: no policy specified for kudu/127.20.171.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.171.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.171.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.67.keytab.
Entry for principal kudu/127.20.171.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.67.keytab.
I20260807 10:39:11.047756 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.20.171.84:36831/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.171.67:0
--local_ip_for_outbound_sockets=127.20.171.67
--webserver_interface=127.20.171.67
--webserver_port=0
--tserver_master_addrs=127.20.171.126:37057
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.67.keytab
--principal=kudu/127.20.171.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.171.84:35559
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 10:39:11.318787 1551 heartbeater.cc:503] Master 127.20.171.126:37057 was elected leader, sending a full tablet report...
W20260807 10:39:11.435606 1703 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:39:11.435838 1703 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:39:11.436002 1703 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:39:11.442142 1703 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:39:11.442227 1703 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:39:11.442407 1703 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.171.67
I20260807 10:39:11.451012 1703 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.171.84:35559
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.20.171.84:36831/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.67.keytab
--principal=kudu/127.20.171.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.171.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.171.67
--webserver_port=0
--tserver_master_addrs=127.20.171.126:37057
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.171.67
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:39:11.452152 1703 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:39:11.453372 1703 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:39:11.465169 1708 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:39:11.465194 1709 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:39:11.465337 1711 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:39:11.466125 1703 server_base.cc:1034] running on GCE node
I20260807 10:39:11.466710 1703 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:39:11.467597 1703 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:39:11.468798 1703 hybrid_clock.cc:648] HybridClock initialized: now 1786099151468760 us; error 60 us; skew 500 ppm
I20260807 10:39:11.469089 1703 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:39:11 dist-test-slave-0b58 krb5kdc[847](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099151, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:39:11.471869 1703 init.cc:377] Logged in from keytab as kudu/127.20.171.67@KRBTEST.COM (short username kudu)
I20260807 10:39:11.473153 1703 webserver.cc:460] Webserver started at http://127.20.171.67:35751/ using document root <none> and password file <none>
I20260807 10:39:11.473824 1703 fs_manager.cc:359] Metadata directory not provided
I20260807 10:39:11.473961 1703 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:39:11.474253 1703 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 07 10:39:11 dist-test-slave-0b58 krb5kdc[847](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099151, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.67@KRBTEST.COM for HTTP/127.20.171.84@KRBTEST.COM
I20260807 10:39:11.489401 1703 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/minicluster-data/ts-2/data/instance:
uuid: "f131797edc024f49a109bd544b6a1a6a"
format_stamp: "Formatted at 2026-08-07 10:39:11 on dist-test-slave-0b58"
server_key: "202b01111f11f12dc71d6c79a28d5049"
server_key_iv: "6f88b4eea0f619fced3c369e743fe812"
server_key_version: "kuduclusterkey@0"
I20260807 10:39:11.490278 1703 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/minicluster-data/ts-2/wal/instance:
uuid: "f131797edc024f49a109bd544b6a1a6a"
format_stamp: "Formatted at 2026-08-07 10:39:11 on dist-test-slave-0b58"
server_key: "202b01111f11f12dc71d6c79a28d5049"
server_key_iv: "6f88b4eea0f619fced3c369e743fe812"
server_key_version: "kuduclusterkey@0"
I20260807 10:39:11.495476 1703 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260807 10:39:11.512217 1718 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:39:11.513648 1703 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260807 10:39:11.513841 1703 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/minicluster-data/ts-2/wal
uuid: "f131797edc024f49a109bd544b6a1a6a"
format_stamp: "Formatted at 2026-08-07 10:39:11 on dist-test-slave-0b58"
server_key: "202b01111f11f12dc71d6c79a28d5049"
server_key_iv: "6f88b4eea0f619fced3c369e743fe812"
server_key_version: "kuduclusterkey@0"
I20260807 10:39:11.514057 1703 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:39:11.529861 1703 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:39:11.533499 1703 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:39:11.533795 1703 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:39:11.534732 1703 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:39:11.536067 1703 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:39:11.536175 1703 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:39:11.536339 1703 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:39:11.536429 1703 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:39:11.567847 1703 rpc_server.cc:307] RPC server started. Bound to: 127.20.171.67:33961
I20260807 10:39:11.567881 1833 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.171.67:33961 every 8 connection(s)
I20260807 10:39:11.569012 1703 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/minicluster-data/ts-2/data/info.pb
I20260807 10:39:11.576615 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 1703
I20260807 10:39:11.576776 21165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/minicluster-data/ts-2/wal/instance
I20260807 10:39:11.577214 21165 external_mini_cluster.cc:1428] Setting key 0a012b3b353bdb07ed37465388a77a63
Aug 07 10:39:11 dist-test-slave-0b58 krb5kdc[847](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099151, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.67@KRBTEST.COM for kudu/127.20.171.126@KRBTEST.COM
I20260807 10:39:11.586567 1836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:11.571221 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.67:56699 (local address 127.20.171.126:37057)
0807 10:39:11.571671 (+ 450us) server_negotiation.cc:206] Beginning negotiation
0807 10:39:11.571677 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:39:11.572609 (+ 932us) server_negotiation.cc:407] Connection header received
0807 10:39:11.574130 (+ 1521us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:39:11.574134 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:39:11.574209 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:39:11.574298 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:39:11.575460 (+ 1162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:11.576172 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:11.577716 (+ 1544us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:11.578259 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:11.578402 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:39:11.581658 (+ 3256us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:39:11.581663 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:39:11.581667 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:39:11.581702 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:39:11.583934 (+ 2232us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:39:11.584624 (+ 690us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:39:11.584628 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:39:11.584630 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:39:11.584763 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:39:11.585071 (+ 308us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:39:11.585074 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:39:11.585076 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:39:11.585370 (+ 294us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:39:11.585491 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0807 10:39:11.586168 (+ 677us) server_negotiation.cc:299] Negotiation successful
0807 10:39:11.586323 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":324,"thread_start_us":216,"threads_started":1}
I20260807 10:39:11.587484 1837 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:11.571769 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:37057 (local address 127.20.171.67:56699)
0807 10:39:11.572473 (+ 704us) negotiation.cc:107] Waiting for socket to connect
0807 10:39:11.572512 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0807 10:39:11.573905 (+ 1393us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:39:11.574463 (+ 558us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:39:11.574469 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:39:11.574822 (+ 353us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:39:11.575324 (+ 502us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:39:11.575340 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:39:11.576343 (+ 1003us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:39:11.576347 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:39:11.577535 (+ 1188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:39:11.577553 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:39:11.578579 (+ 1026us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:39:11.578585 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:39:11.578769 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:39:11.579391 (+ 622us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:39:11.579414 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:39:11.581461 (+ 2047us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:39:11.584047 (+ 2586us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:39:11.584053 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:39:11.584062 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:39:11.584507 (+ 445us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:39:11.584847 (+ 340us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:39:11.584850 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:39:11.584852 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:39:11.584988 (+ 136us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:39:11.585471 (+ 483us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:39:11.585476 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:39:11.585735 (+ 259us) client_negotiation.cc:769] Sending connection context
0807 10:39:11.585953 (+ 218us) client_negotiation.cc:240] Negotiation successful
0807 10:39:11.586379 (+ 426us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":506,"thread_start_us":267,"threads_started":1}
I20260807 10:39:11.588752 1834 heartbeater.cc:347] Connected to a master server at 127.20.171.126:37057
I20260807 10:39:11.589061 1834 heartbeater.cc:464] Registering TS with master...
I20260807 10:39:11.589686 1834 heartbeater.cc:511] Master 127.20.171.126:37057 requested a full tablet report, sending...
I20260807 10:39:11.591017 1332 ts_manager.cc:194] Registered new tserver with Master: f131797edc024f49a109bd544b6a1a6a (127.20.171.67:33961)
I20260807 10:39:11.592100 1332 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.171.67@KRBTEST.COM'} at 127.20.171.67:56699
I20260807 10:39:11.592522 21165 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 10:39:11.594136 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 1415
Aug 07 10:39:11 dist-test-slave-0b58 krb5kdc[847](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099147, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.171.65@KRBTEST.COM
I20260807 10:39:11.610297 1839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:11.595139 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38412 (local address 127.20.171.65:34011)
0807 10:39:11.595861 (+ 722us) server_negotiation.cc:206] Beginning negotiation
0807 10:39:11.595869 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 10:39:11.595897 (+ 28us) server_negotiation.cc:407] Connection header received
0807 10:39:11.595949 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:39:11.595972 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:39:11.596162 (+ 190us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:39:11.596353 (+ 191us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:39:11.597829 (+ 1476us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:11.598773 (+ 944us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:11.600339 (+ 1566us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:11.600810 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:11.600927 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:39:11.605114 (+ 4187us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:39:11.605130 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:39:11.605166 (+ 36us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:39:11.605199 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:39:11.607807 (+ 2608us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:39:11.608551 (+ 744us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:39:11.608557 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:39:11.608560 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:39:11.608723 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:39:11.609036 (+ 313us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:39:11.609039 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:39:11.609041 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:39:11.609331 (+ 290us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:39:11.609547 (+ 216us) server_negotiation.cc:1035] Waiting for connection context
0807 10:39:11.609710 (+ 163us) server_negotiation.cc:299] Negotiation successful
0807 10:39:11.609952 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":517,"thread_start_us":334,"threads_started":1}
I20260807 10:39:11.611375 1546 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:39:11.687453 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 1415
I20260807 10:39:11.706566 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 1557
Aug 07 10:39:11 dist-test-slave-0b58 krb5kdc[847](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099147, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.171.66@KRBTEST.COM
I20260807 10:39:11.722942 1841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:11.707561 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60652 (local address 127.20.171.66:44849)
0807 10:39:11.708117 (+ 556us) server_negotiation.cc:206] Beginning negotiation
0807 10:39:11.708123 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:39:11.708150 (+ 27us) server_negotiation.cc:407] Connection header received
0807 10:39:11.708211 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:39:11.708217 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:39:11.708488 (+ 271us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:39:11.708666 (+ 178us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:39:11.709907 (+ 1241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:11.710815 (+ 908us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:11.712207 (+ 1392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:11.712784 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:11.712923 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:39:11.717185 (+ 4262us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:39:11.717196 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:39:11.717209 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:39:11.717283 (+ 74us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:39:11.720037 (+ 2754us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:39:11.720805 (+ 768us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:39:11.720812 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:39:11.720815 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:39:11.720944 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:39:11.721374 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:39:11.721379 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:39:11.721382 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:39:11.721719 (+ 337us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:39:11.722006 (+ 287us) server_negotiation.cc:1035] Waiting for connection context
0807 10:39:11.722315 (+ 309us) server_negotiation.cc:299] Negotiation successful
0807 10:39:11.722573 (+ 258us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":397,"thread_start_us":285,"threads_started":1}
I20260807 10:39:11.724171 1692 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:39:11.800967 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 1557
I20260807 10:39:11.819448 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 1703
Aug 07 10:39:11 dist-test-slave-0b58 krb5kdc[847](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099147, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.171.67@KRBTEST.COM
I20260807 10:39:11.834743 1843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:11.820297 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54348 (local address 127.20.171.67:33961)
0807 10:39:11.820923 (+ 626us) server_negotiation.cc:206] Beginning negotiation
0807 10:39:11.820929 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:39:11.820957 (+ 28us) server_negotiation.cc:407] Connection header received
0807 10:39:11.821012 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:39:11.821017 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:39:11.821222 (+ 205us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:39:11.821404 (+ 182us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:39:11.822614 (+ 1210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:11.823677 (+ 1063us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:11.824926 (+ 1249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:11.825481 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:11.825579 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:39:11.829749 (+ 4170us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:39:11.829761 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:39:11.829775 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:39:11.829806 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:39:11.832387 (+ 2581us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:39:11.833003 (+ 616us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:39:11.833010 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:39:11.833012 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:39:11.833159 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:39:11.833457 (+ 298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:39:11.833460 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:39:11.833461 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:39:11.833759 (+ 298us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:39:11.834000 (+ 241us) server_negotiation.cc:1035] Waiting for connection context
0807 10:39:11.834214 (+ 214us) server_negotiation.cc:299] Negotiation successful
0807 10:39:11.834411 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":469,"thread_start_us":306,"threads_started":1}
I20260807 10:39:11.835959 1829 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:39:11.912384 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 1703
I20260807 10:39:11.929330 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 1300
I20260807 10:39:11.930524 1363 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:39:12.032404 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 1300
I20260807 10:39:12.058236 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.171.126:37057
--webserver_interface=127.20.171.126
--webserver_port=41861
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.126.keytab
--principal=kudu/127.20.171.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.171.84:35559
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.171.126:37057
--ranger_config_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.20.171.84:36831/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.20.171.84:36831/kms with env {KRB5CCNAME=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:39:12.371418 1846 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:39:12.371675 1846 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:39:12.371840 1846 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:39:12.378419 1846 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 10:39:12.378540 1846 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:39:12.378629 1846 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:39:12.378721 1846 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 10:39:12.378800 1846 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 10:39:12.388025 1846 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.171.84:35559
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.20.171.84:36831/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.20.171.126:37057
--ranger_config_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.126.keytab
--principal=kudu/127.20.171.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.171.126:37057
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.171.126
--webserver_port=41861
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:39:12.389207 1846 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:39:12.390400 1846 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:39:12.401508 1854 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:39:12.401480 1852 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:39:12.402009 1851 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:39:12.402427 1846 server_base.cc:1034] running on GCE node
I20260807 10:39:12.403085 1846 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:39:12.404300 1846 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:39:12.405530 1846 hybrid_clock.cc:648] HybridClock initialized: now 1786099152405480 us; error 34 us; skew 500 ppm
I20260807 10:39:12.405860 1846 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:39:12 dist-test-slave-0b58 krb5kdc[847](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099152, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:39:12.408881 1846 init.cc:377] Logged in from keytab as kudu/127.20.171.126@KRBTEST.COM (short username kudu)
I20260807 10:39:12.410166 1846 webserver.cc:460] Webserver started at http://127.20.171.126:41861/ using document root <none> and password file <none>
I20260807 10:39:12.410753 1846 fs_manager.cc:359] Metadata directory not provided
I20260807 10:39:12.410892 1846 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 07 10:39:12 dist-test-slave-0b58 krb5kdc[847](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099152, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.126@KRBTEST.COM for HTTP/127.20.171.84@KRBTEST.COM
I20260807 10:39:12.495982 1846 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.002s sys 0.001s
I20260807 10:39:12.499058 1862 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:39:12.500350 1846 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 10:39:12.500522 1846 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/minicluster-data/master-0/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/minicluster-data/master-0/wal
uuid: "7cec2f01818242f78f60d7f3be0b7ba2"
format_stamp: "Formatted at 2026-08-07 10:39:08 on dist-test-slave-0b58"
server_key: "0e9bbdea2aa4d07bed41332743e35520"
server_key_iv: "a80559a71c9f5c987c2db6cd01cc8461"
server_key_version: "kuduclusterkey@0"
I20260807 10:39:12.501430 1846 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:39:12.513876 1846 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:39:12.517205 1846 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:39:12.517459 1846 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:39:12.535105 1846 rpc_server.cc:307] RPC server started. Bound to: 127.20.171.126:37057
I20260807 10:39:12.535185 1914 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.171.126:37057 every 8 connection(s)
I20260807 10:39:12.536571 1846 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
I20260807 10:39:12.537045 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 1846
I20260807 10:39:12.538116 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.20.171.84:36831/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.171.65:34011
--local_ip_for_outbound_sockets=127.20.171.65
--tserver_master_addrs=127.20.171.126:37057
--webserver_port=43221
--webserver_interface=127.20.171.65
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.65.keytab
--principal=kudu/127.20.171.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.171.84:35559
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.20.171.84:36831/kms with env {KRB5CCNAME=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 10:39:12.543066 1915 sys_catalog.cc:263] Verifying existing consensus state
I20260807 10:39:12.546095 1915 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7cec2f01818242f78f60d7f3be0b7ba2: Bootstrap starting.
I20260807 10:39:12.569135 1915 log.cc:824] T 00000000000000000000000000000000 P 7cec2f01818242f78f60d7f3be0b7ba2: Log is configured to *not* fsync() on all Append() calls
I20260807 10:39:12.579559 1915 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7cec2f01818242f78f60d7f3be0b7ba2: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 10:39:12.580230 1915 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7cec2f01818242f78f60d7f3be0b7ba2: Bootstrap complete.
I20260807 10:39:12.592926 1915 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7cec2f01818242f78f60d7f3be0b7ba2 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7cec2f01818242f78f60d7f3be0b7ba2" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 37057 } }
I20260807 10:39:12.593938 1915 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7cec2f01818242f78f60d7f3be0b7ba2 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7cec2f01818242f78f60d7f3be0b7ba2, State: Initialized, Role: FOLLOWER
I20260807 10:39:12.594566 1915 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7cec2f01818242f78f60d7f3be0b7ba2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7cec2f01818242f78f60d7f3be0b7ba2" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 37057 } }
I20260807 10:39:12.594816 1915 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7cec2f01818242f78f60d7f3be0b7ba2 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 10:39:12.594944 1915 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7cec2f01818242f78f60d7f3be0b7ba2 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 10:39:12.595103 1915 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7cec2f01818242f78f60d7f3be0b7ba2 [term 1 FOLLOWER]: Advancing to term 2
I20260807 10:39:12.600472 1915 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7cec2f01818242f78f60d7f3be0b7ba2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7cec2f01818242f78f60d7f3be0b7ba2" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 37057 } }
I20260807 10:39:12.601065 1915 leader_election.cc:302] T 00000000000000000000000000000000 P 7cec2f01818242f78f60d7f3be0b7ba2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7cec2f01818242f78f60d7f3be0b7ba2; no voters:
I20260807 10:39:12.601655 1915 leader_election.cc:288] T 00000000000000000000000000000000 P 7cec2f01818242f78f60d7f3be0b7ba2 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260807 10:39:12.601814 1919 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7cec2f01818242f78f60d7f3be0b7ba2 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 10:39:12.603017 1919 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7cec2f01818242f78f60d7f3be0b7ba2 [term 2 LEADER]: Becoming Leader. State: Replica: 7cec2f01818242f78f60d7f3be0b7ba2, State: Running, Role: LEADER
I20260807 10:39:12.603544 1915 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7cec2f01818242f78f60d7f3be0b7ba2 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 10:39:12.603502 1919 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7cec2f01818242f78f60d7f3be0b7ba2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7cec2f01818242f78f60d7f3be0b7ba2" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 37057 } }
I20260807 10:39:12.606096 1921 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7cec2f01818242f78f60d7f3be0b7ba2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7cec2f01818242f78f60d7f3be0b7ba2. Latest consensus state: current_term: 2 leader_uuid: "7cec2f01818242f78f60d7f3be0b7ba2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7cec2f01818242f78f60d7f3be0b7ba2" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 37057 } } }
I20260807 10:39:12.606467 1921 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7cec2f01818242f78f60d7f3be0b7ba2 [sys.catalog]: This master's current role is: LEADER
I20260807 10:39:12.607004 1920 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7cec2f01818242f78f60d7f3be0b7ba2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "7cec2f01818242f78f60d7f3be0b7ba2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7cec2f01818242f78f60d7f3be0b7ba2" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 37057 } } }
I20260807 10:39:12.607292 1920 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7cec2f01818242f78f60d7f3be0b7ba2 [sys.catalog]: This master's current role is: LEADER
I20260807 10:39:12.620460 1926 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 10:39:12.625555 1926 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 10:39:12.626377 1915 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260807 10:39:12.627152 1926 catalog_manager.cc:1259] Loaded cluster ID: 4da10dddfc114160a0ee84bf696d4323
I20260807 10:39:12.627326 1926 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 10:39:12.639299 1926 catalog_manager.cc:1504] Loading token signing keys...
I20260807 10:39:12.641675 1926 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 7cec2f01818242f78f60d7f3be0b7ba2: Loaded TSK: 0
I20260807 10:39:12.643317 1926 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260807 10:39:12.989910 1917 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:39:12.990300 1917 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:39:12.990509 1917 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:39:13.001504 1917 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:39:13.001675 1917 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:39:13.001905 1917 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.171.65
I20260807 10:39:13.016826 1917 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.171.84:35559
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.20.171.84:36831/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.65.keytab
--principal=kudu/127.20.171.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.171.65:34011
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.171.65
--webserver_port=43221
--tserver_master_addrs=127.20.171.126:37057
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.171.65
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:39:13.018571 1917 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:39:13.020321 1917 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:39:13.074326 1952 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:39:13.074877 1956 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:39:13.074930 1917 server_base.cc:1034] running on GCE node
W20260807 10:39:13.076853 1953 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:39:13.077760 1917 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:39:13.088575 1917 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:39:13.092052 1917 hybrid_clock.cc:648] HybridClock initialized: now 1786099153091923 us; error 117 us; skew 500 ppm
I20260807 10:39:13.092592 1917 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:39:13 dist-test-slave-0b58 krb5kdc[847](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099153, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:39:13.097108 1917 init.cc:377] Logged in from keytab as kudu/127.20.171.65@KRBTEST.COM (short username kudu)
I20260807 10:39:13.102128 1917 webserver.cc:460] Webserver started at http://127.20.171.65:43221/ using document root <none> and password file <none>
I20260807 10:39:13.103088 1917 fs_manager.cc:359] Metadata directory not provided
I20260807 10:39:13.103260 1917 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 07 10:39:13 dist-test-slave-0b58 krb5kdc[847](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099153, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.65@KRBTEST.COM for HTTP/127.20.171.84@KRBTEST.COM
I20260807 10:39:13.155575 1917 fs_manager.cc:709] Time spent opening directory manager: real 0.013s user 0.002s sys 0.005s
I20260807 10:39:13.159970 1964 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:39:13.161839 1917 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.000s sys 0.003s
I20260807 10:39:13.162065 1917 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/minicluster-data/ts-0/wal
uuid: "1115cad94eac44eab3e2c85a51374d15"
format_stamp: "Formatted at 2026-08-07 10:39:09 on dist-test-slave-0b58"
server_key: "429c5b8b145d5bfe773518aa39c7606c"
server_key_iv: "46bc91fc070f2892f928d8bcd1a7fbdd"
server_key_version: "kuduclusterkey@0"
I20260807 10:39:13.163486 1917 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:39:13.205262 1917 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:39:13.210047 1917 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:39:13.210337 1917 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:39:13.211410 1917 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:39:13.212937 1917 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:39:13.213064 1917 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:39:13.213184 1917 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:39:13.213268 1917 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:39:13.266033 1917 rpc_server.cc:307] RPC server started. Bound to: 127.20.171.65:34011
I20260807 10:39:13.266086 2080 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.171.65:34011 every 8 connection(s)
I20260807 10:39:13.267608 1917 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/minicluster-data/ts-0/data/info.pb
I20260807 10:39:13.275030 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 1917
I20260807 10:39:13.275867 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.20.171.84:36831/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.171.66:44849
--local_ip_for_outbound_sockets=127.20.171.66
--tserver_master_addrs=127.20.171.126:37057
--webserver_port=33655
--webserver_interface=127.20.171.66
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.66.keytab
--principal=kudu/127.20.171.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.171.84:35559
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.20.171.84:36831/kms with env {KRB5CCNAME=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 10:39:13 dist-test-slave-0b58 krb5kdc[847](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099153, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.65@KRBTEST.COM for kudu/127.20.171.126@KRBTEST.COM
I20260807 10:39:13.327076 2085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:13.289288 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:37057 (local address 127.20.171.65:60973)
0807 10:39:13.299515 (+ 10227us) negotiation.cc:107] Waiting for socket to connect
0807 10:39:13.299568 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0807 10:39:13.301976 (+ 2408us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:39:13.304549 (+ 2573us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:39:13.304560 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:39:13.305190 (+ 630us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:39:13.305983 (+ 793us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:39:13.306009 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:39:13.308326 (+ 2317us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:39:13.308331 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:39:13.310326 (+ 1995us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:39:13.310351 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:39:13.312075 (+ 1724us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:39:13.312082 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:39:13.312380 (+ 298us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:39:13.313185 (+ 805us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:39:13.313215 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:39:13.317797 (+ 4582us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:39:13.322048 (+ 4251us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:39:13.322057 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:39:13.322069 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:39:13.322611 (+ 542us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:39:13.323157 (+ 546us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:39:13.323162 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:39:13.323165 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:39:13.323388 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:39:13.324434 (+ 1046us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:39:13.324441 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:39:13.324792 (+ 351us) client_negotiation.cc:769] Sending connection context
0807 10:39:13.325096 (+ 304us) client_negotiation.cc:240] Negotiation successful
0807 10:39:13.325659 (+ 563us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9896,"thread_start_us":12836,"threads_started":1}
I20260807 10:39:13.327103 2083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:13.277794 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.65:60973 (local address 127.20.171.126:37057)
0807 10:39:13.299267 (+ 21473us) server_negotiation.cc:206] Beginning negotiation
0807 10:39:13.299290 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0807 10:39:13.299739 (+ 449us) server_negotiation.cc:407] Connection header received
0807 10:39:13.303093 (+ 3354us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:39:13.303111 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:39:13.303574 (+ 463us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:39:13.303944 (+ 370us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:39:13.306292 (+ 2348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:13.308109 (+ 1817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:13.310535 (+ 2426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:13.311530 (+ 995us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:13.311693 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:39:13.318087 (+ 6394us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:39:13.318098 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:39:13.318117 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:39:13.318179 (+ 62us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:39:13.321890 (+ 3711us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:39:13.322796 (+ 906us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:39:13.322804 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:39:13.322811 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:39:13.323003 (+ 192us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:39:13.323531 (+ 528us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:39:13.323537 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:39:13.323542 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:39:13.324122 (+ 580us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:39:13.324361 (+ 239us) server_negotiation.cc:1035] Waiting for connection context
0807 10:39:13.325414 (+ 1053us) server_negotiation.cc:299] Negotiation successful
0807 10:39:13.325880 (+ 466us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21142,"thread_start_us":22318,"threads_started":1}
I20260807 10:39:13.330869 2081 heartbeater.cc:347] Connected to a master server at 127.20.171.126:37057
I20260807 10:39:13.331175 2081 heartbeater.cc:464] Registering TS with master...
I20260807 10:39:13.331970 2081 heartbeater.cc:511] Master 127.20.171.126:37057 requested a full tablet report, sending...
W20260807 10:39:13.335172 2081 heartbeater.cc:644] Failed to heartbeat to 127.20.171.126:37057 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260807 10:39:13.335408 2081 heartbeater.cc:464] Registering TS with master...
I20260807 10:39:13.335677 2081 heartbeater.cc:511] Master 127.20.171.126:37057 requested a full tablet report, sending...
I20260807 10:39:13.336997 2081 heartbeater.cc:464] Registering TS with master...
I20260807 10:39:13.337247 2081 heartbeater.cc:511] Master 127.20.171.126:37057 requested a full tablet report, sending...
W20260807 10:39:13.338315 2081 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260807 10:39:13.707665 2084 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:39:13.708129 2084 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:39:13.708364 2084 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:39:13.719823 2084 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:39:13.719995 2084 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:39:13.720220 2084 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.171.66
I20260807 10:39:13.733033 2084 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.171.84:35559
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.20.171.84:36831/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.66.keytab
--principal=kudu/127.20.171.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.171.66:44849
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.171.66
--webserver_port=33655
--tserver_master_addrs=127.20.171.126:37057
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.171.66
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:39:13.734529 2084 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:39:13.735872 2084 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:39:13.759174 2103 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:39:13.760007 2102 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:39:13.769804 2105 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:39:13.770147 2084 server_base.cc:1034] running on GCE node
I20260807 10:39:13.770955 2084 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:39:13.772475 2084 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:39:13.773787 2084 hybrid_clock.cc:648] HybridClock initialized: now 1786099153773705 us; error 67 us; skew 500 ppm
I20260807 10:39:13.774271 2084 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:39:13 dist-test-slave-0b58 krb5kdc[847](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099153, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:39:13.783878 2084 init.cc:377] Logged in from keytab as kudu/127.20.171.66@KRBTEST.COM (short username kudu)
I20260807 10:39:13.785959 2084 webserver.cc:460] Webserver started at http://127.20.171.66:33655/ using document root <none> and password file <none>
I20260807 10:39:13.786907 2084 fs_manager.cc:359] Metadata directory not provided
I20260807 10:39:13.787070 2084 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 07 10:39:13 dist-test-slave-0b58 krb5kdc[847](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786099153, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Aug 07 10:39:13 dist-test-slave-0b58 krb5kdc[847](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099153, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.66@KRBTEST.COM for HTTP/127.20.171.84@KRBTEST.COM
I20260807 10:39:13.822993 2084 fs_manager.cc:709] Time spent opening directory manager: real 0.011s user 0.001s sys 0.008s
I20260807 10:39:13.826149 2113 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:39:13.827718 2084 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 10:39:13.827950 2084 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/minicluster-data/ts-1/wal
uuid: "668ecc2f8ef447489e78c0b2382d7d56"
format_stamp: "Formatted at 2026-08-07 10:39:10 on dist-test-slave-0b58"
server_key: "a5b87983d211ec557d23f603b4b6b3da"
server_key_iv: "497eb302bc93744365a03bb7c5251e38"
server_key_version: "kuduclusterkey@0"
I20260807 10:39:13.829094 2084 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:39:13.853524 2084 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:39:13.858831 2084 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:39:13.859119 2084 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:39:13.860371 2084 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:39:13.862118 2084 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:39:13.862246 2084 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:39:13.862349 2084 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:39:13.862424 2084 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:39:13.921270 2084 rpc_server.cc:307] RPC server started. Bound to: 127.20.171.66:44849
I20260807 10:39:13.921334 2230 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.171.66:44849 every 8 connection(s)
I20260807 10:39:13.923280 2084 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/minicluster-data/ts-1/data/info.pb
I20260807 10:39:13.928447 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 2084
I20260807 10:39:13.929466 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.20.171.84:36831/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.171.67:33961
--local_ip_for_outbound_sockets=127.20.171.67
--tserver_master_addrs=127.20.171.126:37057
--webserver_port=35751
--webserver_interface=127.20.171.67
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.67.keytab
--principal=kudu/127.20.171.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.171.84:35559
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.20.171.84:36831/kms with env {KRB5CCNAME=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 10:39:13 dist-test-slave-0b58 krb5kdc[847](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099153, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.66@KRBTEST.COM for kudu/127.20.171.126@KRBTEST.COM
I20260807 10:39:13.966126 2235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:13.926448 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:37057 (local address 127.20.171.66:33689)
0807 10:39:13.942100 (+ 15652us) negotiation.cc:107] Waiting for socket to connect
0807 10:39:13.942162 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0807 10:39:13.946042 (+ 3880us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:39:13.947195 (+ 1153us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:39:13.947207 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:39:13.947890 (+ 683us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:39:13.948750 (+ 860us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:39:13.948777 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:39:13.950281 (+ 1504us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:39:13.950288 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:39:13.952241 (+ 1953us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:39:13.952289 (+ 48us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:39:13.953559 (+ 1270us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:39:13.953567 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:39:13.953855 (+ 288us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:39:13.954648 (+ 793us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:39:13.954678 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:39:13.957447 (+ 2769us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:39:13.961439 (+ 3992us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:39:13.961446 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:39:13.961461 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:39:13.961999 (+ 538us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:39:13.962490 (+ 491us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:39:13.962494 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:39:13.962497 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:39:13.962741 (+ 244us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:39:13.963471 (+ 730us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:39:13.963482 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:39:13.963893 (+ 411us) client_negotiation.cc:769] Sending connection context
0807 10:39:13.964192 (+ 299us) client_negotiation.cc:240] Negotiation successful
0807 10:39:13.964723 (+ 531us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":15357,"thread_start_us":15163,"threads_started":1}
I20260807 10:39:13.967100 2233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:13.925949 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.66:33689 (local address 127.20.171.126:37057)
0807 10:39:13.941441 (+ 15492us) server_negotiation.cc:206] Beginning negotiation
0807 10:39:13.941447 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:39:13.943579 (+ 2132us) server_negotiation.cc:407] Connection header received
0807 10:39:13.946416 (+ 2837us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:39:13.946422 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:39:13.946515 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:39:13.946606 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:39:13.948950 (+ 2344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:13.950105 (+ 1155us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:13.952445 (+ 2340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:13.953079 (+ 634us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:13.953211 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:39:13.957683 (+ 4472us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:39:13.957689 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:39:13.957697 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:39:13.957737 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:39:13.961273 (+ 3536us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:39:13.962171 (+ 898us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:39:13.962175 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:39:13.962178 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:39:13.962344 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:39:13.962881 (+ 537us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:39:13.962885 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:39:13.962888 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:39:13.963253 (+ 365us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:39:13.963396 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0807 10:39:13.966517 (+ 3121us) server_negotiation.cc:299] Negotiation successful
0807 10:39:13.966756 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15350,"thread_start_us":15485,"threads_started":1}
I20260807 10:39:13.969539 2231 heartbeater.cc:347] Connected to a master server at 127.20.171.126:37057
I20260807 10:39:13.969859 2231 heartbeater.cc:464] Registering TS with master...
I20260807 10:39:13.970620 2231 heartbeater.cc:511] Master 127.20.171.126:37057 requested a full tablet report, sending...
I20260807 10:39:13.972747 1879 ts_manager.cc:194] Registered new tserver with Master: 668ecc2f8ef447489e78c0b2382d7d56 (127.20.171.66:44849)
I20260807 10:39:13.974913 1879 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.171.66@KRBTEST.COM'} at 127.20.171.66:33689
Aug 07 10:39:14 dist-test-slave-0b58 krb5kdc[847](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099153, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.126@KRBTEST.COM for HTTP/127.20.171.84@KRBTEST.COM
I20260807 10:39:14.338493 2081 heartbeater.cc:464] Registering TS with master...
I20260807 10:39:14.338968 2081 heartbeater.cc:511] Master 127.20.171.126:37057 requested a full tablet report, sending...
I20260807 10:39:14.340346 1879 ts_manager.cc:194] Registered new tserver with Master: 1115cad94eac44eab3e2c85a51374d15 (127.20.171.65:34011)
I20260807 10:39:14.341482 1879 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.171.65@KRBTEST.COM'} at 127.20.171.65:60973
W20260807 10:39:14.347038 2236 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:39:14.347370 2236 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:39:14.347533 2236 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:39:14.358494 2236 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:39:14.358625 2236 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:39:14.358803 2236 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.171.67
I20260807 10:39:14.369477 2236 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.171.84:35559
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.20.171.84:36831/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.67.keytab
--principal=kudu/127.20.171.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.171.67:33961
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.171.67
--webserver_port=35751
--tserver_master_addrs=127.20.171.126:37057
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.171.67
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:39:14.370750 2236 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:39:14.371994 2236 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:39:14.388808 2241 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:39:14.388818 2242 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:39:14.409116 2245 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:39:14.409346 2236 server_base.cc:1034] running on GCE node
I20260807 10:39:14.410208 2236 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:39:14.411464 2236 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:39:14.412739 2236 hybrid_clock.cc:648] HybridClock initialized: now 1786099154412668 us; error 53 us; skew 500 ppm
I20260807 10:39:14.413144 2236 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:39:14 dist-test-slave-0b58 krb5kdc[847](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099154, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:39:14.417304 2236 init.cc:377] Logged in from keytab as kudu/127.20.171.67@KRBTEST.COM (short username kudu)
I20260807 10:39:14.419232 2236 webserver.cc:460] Webserver started at http://127.20.171.67:35751/ using document root <none> and password file <none>
I20260807 10:39:14.420118 2236 fs_manager.cc:359] Metadata directory not provided
I20260807 10:39:14.420306 2236 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 07 10:39:14 dist-test-slave-0b58 krb5kdc[847](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099154, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.67@KRBTEST.COM for HTTP/127.20.171.84@KRBTEST.COM
I20260807 10:39:14.454277 2236 fs_manager.cc:709] Time spent opening directory manager: real 0.011s user 0.000s sys 0.010s
I20260807 10:39:14.457949 2252 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:39:14.459847 2236 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.001s
I20260807 10:39:14.460062 2236 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/minicluster-data/ts-2/wal
uuid: "f131797edc024f49a109bd544b6a1a6a"
format_stamp: "Formatted at 2026-08-07 10:39:11 on dist-test-slave-0b58"
server_key: "202b01111f11f12dc71d6c79a28d5049"
server_key_iv: "6f88b4eea0f619fced3c369e743fe812"
server_key_version: "kuduclusterkey@0"
I20260807 10:39:14.461421 2236 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:39:14.484817 2236 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:39:14.489041 2236 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:39:14.489394 2236 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:39:14.490517 2236 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:39:14.492002 2236 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:39:14.492120 2236 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:39:14.492250 2236 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:39:14.492359 2236 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.001s sys 0.000s
I20260807 10:39:14.581794 2236 rpc_server.cc:307] RPC server started. Bound to: 127.20.171.67:33961
I20260807 10:39:14.582041 2368 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.171.67:33961 every 8 connection(s)
I20260807 10:39:14.583765 2236 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/minicluster-data/ts-2/data/info.pb
Aug 07 10:39:14 dist-test-slave-0b58 krb5kdc[847](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099153, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.126@KRBTEST.COM for HTTP/127.20.171.84@KRBTEST.COM
I20260807 10:39:14.591998 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 2236
Aug 07 10:39:14 dist-test-slave-0b58 krb5kdc[847](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099154, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.67@KRBTEST.COM for kudu/127.20.171.126@KRBTEST.COM
I20260807 10:39:14.654955 2372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:14.588843 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.67:58533 (local address 127.20.171.126:37057)
0807 10:39:14.590330 (+ 1487us) server_negotiation.cc:206] Beginning negotiation
0807 10:39:14.590336 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:39:14.590358 (+ 22us) server_negotiation.cc:407] Connection header received
0807 10:39:14.621320 (+ 30962us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:39:14.621330 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:39:14.621477 (+ 147us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:39:14.621605 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:39:14.624407 (+ 2802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:14.626925 (+ 2518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:14.641138 (+ 14213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:14.641840 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:14.641943 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:39:14.647768 (+ 5825us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:39:14.647774 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:39:14.647779 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:39:14.647827 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:39:14.651395 (+ 3568us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:39:14.652339 (+ 944us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:39:14.652343 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:39:14.652347 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:39:14.652506 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:39:14.653018 (+ 512us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:39:14.653023 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:39:14.653026 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:39:14.653370 (+ 344us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:39:14.653507 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0807 10:39:14.654341 (+ 834us) server_negotiation.cc:299] Negotiation successful
0807 10:39:14.654578 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1375,"thread_start_us":4648,"threads_started":1}
I20260807 10:39:14.656368 2371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:14.587365 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:37057 (local address 127.20.171.67:58533)
0807 10:39:14.588773 (+ 1408us) negotiation.cc:107] Waiting for socket to connect
0807 10:39:14.588824 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0807 10:39:14.620731 (+ 31907us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:39:14.622200 (+ 1469us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:39:14.622217 (+ 17us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:39:14.623073 (+ 856us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:39:14.624116 (+ 1043us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:39:14.624147 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:39:14.627228 (+ 3081us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:39:14.627237 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:39:14.640447 (+ 13210us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:39:14.640473 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:39:14.642329 (+ 1856us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:39:14.642336 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:39:14.642631 (+ 295us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:39:14.644939 (+ 2308us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:39:14.644972 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:39:14.647513 (+ 2541us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:39:14.651555 (+ 4042us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:39:14.651563 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:39:14.651580 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:39:14.652180 (+ 600us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:39:14.652639 (+ 459us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:39:14.652643 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:39:14.652646 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:39:14.652872 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:39:14.653515 (+ 643us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:39:14.653523 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:39:14.653937 (+ 414us) client_negotiation.cc:769] Sending connection context
0807 10:39:14.654226 (+ 289us) client_negotiation.cc:240] Negotiation successful
0807 10:39:14.654794 (+ 568us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1109,"thread_start_us":6072,"threads_started":1}
I20260807 10:39:14.659226 2369 heartbeater.cc:347] Connected to a master server at 127.20.171.126:37057
I20260807 10:39:14.659548 2369 heartbeater.cc:464] Registering TS with master...
I20260807 10:39:14.660470 2369 heartbeater.cc:511] Master 127.20.171.126:37057 requested a full tablet report, sending...
I20260807 10:39:14.662106 1879 ts_manager.cc:194] Registered new tserver with Master: f131797edc024f49a109bd544b6a1a6a (127.20.171.67:33961)
I20260807 10:39:14.663211 1879 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.171.67@KRBTEST.COM'} at 127.20.171.67:58533
I20260807 10:39:14.677007 2375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:14.593307 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44138 (local address 127.20.171.126:37057)
0807 10:39:14.617507 (+ 24200us) server_negotiation.cc:206] Beginning negotiation
0807 10:39:14.617516 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 10:39:14.639213 (+ 21697us) server_negotiation.cc:407] Connection header received
0807 10:39:14.640631 (+ 1418us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:39:14.640637 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:39:14.640747 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:39:14.640855 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:39:14.642832 (+ 1977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:14.643995 (+ 1163us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:14.658251 (+ 14256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:14.658893 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:14.659017 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:39:14.670123 (+ 11106us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:39:14.670130 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:39:14.670135 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:39:14.670178 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:39:14.673569 (+ 3391us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:39:14.674463 (+ 894us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:39:14.674469 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:39:14.674473 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:39:14.674631 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:39:14.675106 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:39:14.675112 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:39:14.675115 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:39:14.675442 (+ 327us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:39:14.675730 (+ 288us) server_negotiation.cc:1035] Waiting for connection context
0807 10:39:14.676348 (+ 618us) server_negotiation.cc:299] Negotiation successful
0807 10:39:14.676585 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24002,"thread_start_us":23834,"threads_started":1}
I20260807 10:39:14.682288 21165 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 10:39:14.753552 2375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:14.727077 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44148 (local address 127.20.171.126:37057)
0807 10:39:14.727300 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0807 10:39:14.727309 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 10:39:14.739020 (+ 11711us) server_negotiation.cc:407] Connection header received
0807 10:39:14.739264 (+ 244us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:39:14.739271 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:39:14.739366 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:39:14.739471 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:39:14.741383 (+ 1912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:14.742131 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:14.743681 (+ 1550us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:14.744150 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:14.744312 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:39:14.747484 (+ 3172us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:39:14.747488 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:39:14.747491 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:39:14.747522 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:39:14.750346 (+ 2824us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:39:14.751176 (+ 830us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:39:14.751181 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:39:14.751185 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:39:14.751358 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:39:14.751834 (+ 476us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:39:14.751840 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:39:14.751843 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:39:14.752153 (+ 310us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:39:14.752404 (+ 251us) server_negotiation.cc:1035] Waiting for connection context
0807 10:39:14.752987 (+ 583us) server_negotiation.cc:299] Negotiation successful
0807 10:39:14.753223 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260807 10:39:14.760334 1879 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44148:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 10:39:14.770058 1879 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 10:39:14.823292 2385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:14.798093 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.65:34011 (local address 127.0.0.1:38424)
0807 10:39:14.808656 (+ 10563us) negotiation.cc:107] Waiting for socket to connect
0807 10:39:14.808701 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0807 10:39:14.808905 (+ 204us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:39:14.810445 (+ 1540us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:39:14.810453 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:39:14.810483 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:39:14.811015 (+ 532us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:39:14.811028 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:39:14.813628 (+ 2600us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:39:14.813637 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:39:14.817959 (+ 4322us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:39:14.817982 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:39:14.821937 (+ 3955us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:39:14.821946 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:39:14.822220 (+ 274us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:39:14.822317 (+ 97us) client_negotiation.cc:769] Sending connection context
0807 10:39:14.822490 (+ 173us) client_negotiation.cc:240] Negotiation successful
0807 10:39:14.822765 (+ 275us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10244,"thread_start_us":11832,"threads_started":1}
I20260807 10:39:14.824918 2386 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:14.798715 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38424 (local address 127.20.171.65:34011)
0807 10:39:14.809678 (+ 10963us) server_negotiation.cc:206] Beginning negotiation
0807 10:39:14.809691 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 10:39:14.809727 (+ 36us) server_negotiation.cc:407] Connection header received
0807 10:39:14.809849 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:39:14.809860 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:39:14.810175 (+ 315us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:39:14.810399 (+ 224us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:39:14.811257 (+ 858us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:14.813425 (+ 2168us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:14.818230 (+ 4805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:14.821245 (+ 3015us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:14.821415 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:39:14.821769 (+ 354us) server_negotiation.cc:1035] Waiting for connection context
0807 10:39:14.824212 (+ 2443us) server_negotiation.cc:299] Negotiation successful
0807 10:39:14.824475 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10726,"thread_start_us":10966,"threads_started":1}
I20260807 10:39:14.829025 2014 tablet_service.cc:1467] Processing CreateTablet for tablet cf1c940c2348422ca170fccf8aa36c6d (DEFAULT_TABLE table=test-table [id=9e1ee7ae083141c6b9186486b2196dd9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:39:14.830242 2014 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cf1c940c2348422ca170fccf8aa36c6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:39:14.835258 2388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:14.808623 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54352 (local address 127.20.171.67:33961)
0807 10:39:14.816777 (+ 8154us) server_negotiation.cc:206] Beginning negotiation
0807 10:39:14.816786 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 10:39:14.819092 (+ 2306us) server_negotiation.cc:407] Connection header received
0807 10:39:14.819284 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:39:14.819293 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:39:14.819588 (+ 295us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:39:14.819806 (+ 218us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:39:14.824949 (+ 5143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:14.826629 (+ 1680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:14.832345 (+ 5716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:14.833842 (+ 1497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:14.833937 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:39:14.834139 (+ 202us) server_negotiation.cc:1035] Waiting for connection context
0807 10:39:14.834770 (+ 631us) server_negotiation.cc:299] Negotiation successful
0807 10:39:14.834930 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7953,"thread_start_us":8705,"threads_started":1}
I20260807 10:39:14.836048 2387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:14.808182 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.67:33961 (local address 127.0.0.1:54352)
0807 10:39:14.818981 (+ 10799us) negotiation.cc:107] Waiting for socket to connect
0807 10:39:14.818999 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 10:39:14.819128 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:39:14.824354 (+ 5226us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:39:14.824359 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:39:14.824387 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:39:14.824722 (+ 335us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:39:14.824736 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:39:14.826839 (+ 2103us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:39:14.826845 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:39:14.828931 (+ 2086us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:39:14.828947 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:39:14.834352 (+ 5405us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:39:14.834358 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:39:14.834551 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:39:14.834581 (+ 30us) client_negotiation.cc:769] Sending connection context
0807 10:39:14.835559 (+ 978us) client_negotiation.cc:240] Negotiation successful
0807 10:39:14.835721 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10682,"thread_start_us":11032,"threads_started":1}
I20260807 10:39:14.839253 2302 tablet_service.cc:1467] Processing CreateTablet for tablet cf1c940c2348422ca170fccf8aa36c6d (DEFAULT_TABLE table=test-table [id=9e1ee7ae083141c6b9186486b2196dd9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:39:14.840618 2302 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cf1c940c2348422ca170fccf8aa36c6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:39:14.850867 2385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:14.826476 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.66:44849 (local address 127.0.0.1:60660)
0807 10:39:14.836386 (+ 9910us) negotiation.cc:107] Waiting for socket to connect
0807 10:39:14.836408 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0807 10:39:14.836511 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:39:14.837214 (+ 703us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:39:14.837219 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:39:14.837244 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:39:14.837414 (+ 170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:39:14.837425 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:39:14.846472 (+ 9047us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:39:14.846479 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:39:14.848342 (+ 1863us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:39:14.848357 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:39:14.850169 (+ 1812us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:39:14.850176 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:39:14.850349 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:39:14.850385 (+ 36us) client_negotiation.cc:769] Sending connection context
0807 10:39:14.850455 (+ 70us) client_negotiation.cc:240] Negotiation successful
0807 10:39:14.850591 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9800}
I20260807 10:39:14.852092 2389 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:14.819864 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60660 (local address 127.20.171.66:44849)
0807 10:39:14.825714 (+ 5850us) server_negotiation.cc:206] Beginning negotiation
0807 10:39:14.825723 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 10:39:14.836637 (+ 10914us) server_negotiation.cc:407] Connection header received
0807 10:39:14.836775 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:39:14.836783 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:39:14.837003 (+ 220us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:39:14.837591 (+ 588us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:39:14.837837 (+ 246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:14.846305 (+ 8468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:14.848546 (+ 2241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:14.849988 (+ 1442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:14.851387 (+ 1399us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:39:14.851563 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0807 10:39:14.851638 (+ 75us) server_negotiation.cc:299] Negotiation successful
0807 10:39:14.851810 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5679,"thread_start_us":6301,"threads_started":1}
I20260807 10:39:14.855304 2390 tablet_bootstrap.cc:492] T cf1c940c2348422ca170fccf8aa36c6d P 1115cad94eac44eab3e2c85a51374d15: Bootstrap starting.
I20260807 10:39:14.855865 2165 tablet_service.cc:1467] Processing CreateTablet for tablet cf1c940c2348422ca170fccf8aa36c6d (DEFAULT_TABLE table=test-table [id=9e1ee7ae083141c6b9186486b2196dd9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:39:14.857311 2165 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cf1c940c2348422ca170fccf8aa36c6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:39:14.859066 2390 tablet_bootstrap.cc:654] T cf1c940c2348422ca170fccf8aa36c6d P 1115cad94eac44eab3e2c85a51374d15: Neither blocks nor log segments found. Creating new log.
I20260807 10:39:14.860492 2390 log.cc:824] T cf1c940c2348422ca170fccf8aa36c6d P 1115cad94eac44eab3e2c85a51374d15: Log is configured to *not* fsync() on all Append() calls
I20260807 10:39:14.862320 2391 tablet_bootstrap.cc:492] T cf1c940c2348422ca170fccf8aa36c6d P f131797edc024f49a109bd544b6a1a6a: Bootstrap starting.
I20260807 10:39:14.870261 2390 tablet_bootstrap.cc:492] T cf1c940c2348422ca170fccf8aa36c6d P 1115cad94eac44eab3e2c85a51374d15: No bootstrap required, opened a new log
I20260807 10:39:14.870630 2390 ts_tablet_manager.cc:1397] T cf1c940c2348422ca170fccf8aa36c6d P 1115cad94eac44eab3e2c85a51374d15: Time spent bootstrapping tablet: real 0.016s user 0.004s sys 0.004s
I20260807 10:39:14.880072 2393 tablet_bootstrap.cc:492] T cf1c940c2348422ca170fccf8aa36c6d P 668ecc2f8ef447489e78c0b2382d7d56: Bootstrap starting.
I20260807 10:39:14.880779 2391 tablet_bootstrap.cc:654] T cf1c940c2348422ca170fccf8aa36c6d P f131797edc024f49a109bd544b6a1a6a: Neither blocks nor log segments found. Creating new log.
I20260807 10:39:14.882117 2391 log.cc:824] T cf1c940c2348422ca170fccf8aa36c6d P f131797edc024f49a109bd544b6a1a6a: Log is configured to *not* fsync() on all Append() calls
I20260807 10:39:14.885241 2393 tablet_bootstrap.cc:654] T cf1c940c2348422ca170fccf8aa36c6d P 668ecc2f8ef447489e78c0b2382d7d56: Neither blocks nor log segments found. Creating new log.
I20260807 10:39:14.886471 2393 log.cc:824] T cf1c940c2348422ca170fccf8aa36c6d P 668ecc2f8ef447489e78c0b2382d7d56: Log is configured to *not* fsync() on all Append() calls
I20260807 10:39:14.886677 2390 raft_consensus.cc:348] T cf1c940c2348422ca170fccf8aa36c6d P 1115cad94eac44eab3e2c85a51374d15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1115cad94eac44eab3e2c85a51374d15" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 34011 } } peers { permanent_uuid: "f131797edc024f49a109bd544b6a1a6a" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 33961 } } peers { permanent_uuid: "668ecc2f8ef447489e78c0b2382d7d56" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 44849 } }
I20260807 10:39:14.887352 2390 raft_consensus.cc:374] T cf1c940c2348422ca170fccf8aa36c6d P 1115cad94eac44eab3e2c85a51374d15 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:39:14.887506 2390 raft_consensus.cc:729] T cf1c940c2348422ca170fccf8aa36c6d P 1115cad94eac44eab3e2c85a51374d15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1115cad94eac44eab3e2c85a51374d15, State: Initialized, Role: FOLLOWER
I20260807 10:39:14.889880 2391 tablet_bootstrap.cc:492] T cf1c940c2348422ca170fccf8aa36c6d P f131797edc024f49a109bd544b6a1a6a: No bootstrap required, opened a new log
I20260807 10:39:14.890232 2391 ts_tablet_manager.cc:1397] T cf1c940c2348422ca170fccf8aa36c6d P f131797edc024f49a109bd544b6a1a6a: Time spent bootstrapping tablet: real 0.028s user 0.007s sys 0.004s
I20260807 10:39:14.891894 2393 tablet_bootstrap.cc:492] T cf1c940c2348422ca170fccf8aa36c6d P 668ecc2f8ef447489e78c0b2382d7d56: No bootstrap required, opened a new log
I20260807 10:39:14.892194 2393 ts_tablet_manager.cc:1397] T cf1c940c2348422ca170fccf8aa36c6d P 668ecc2f8ef447489e78c0b2382d7d56: Time spent bootstrapping tablet: real 0.012s user 0.009s sys 0.000s
I20260807 10:39:14.896749 2390 consensus_queue.cc:260] T cf1c940c2348422ca170fccf8aa36c6d P 1115cad94eac44eab3e2c85a51374d15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1115cad94eac44eab3e2c85a51374d15" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 34011 } } peers { permanent_uuid: "f131797edc024f49a109bd544b6a1a6a" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 33961 } } peers { permanent_uuid: "668ecc2f8ef447489e78c0b2382d7d56" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 44849 } }
I20260807 10:39:14.899979 2391 raft_consensus.cc:348] T cf1c940c2348422ca170fccf8aa36c6d P f131797edc024f49a109bd544b6a1a6a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1115cad94eac44eab3e2c85a51374d15" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 34011 } } peers { permanent_uuid: "f131797edc024f49a109bd544b6a1a6a" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 33961 } } peers { permanent_uuid: "668ecc2f8ef447489e78c0b2382d7d56" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 44849 } }
I20260807 10:39:14.901168 2391 raft_consensus.cc:374] T cf1c940c2348422ca170fccf8aa36c6d P f131797edc024f49a109bd544b6a1a6a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:39:14.901335 2391 raft_consensus.cc:729] T cf1c940c2348422ca170fccf8aa36c6d P f131797edc024f49a109bd544b6a1a6a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f131797edc024f49a109bd544b6a1a6a, State: Initialized, Role: FOLLOWER
I20260807 10:39:14.902117 2391 consensus_queue.cc:260] T cf1c940c2348422ca170fccf8aa36c6d P f131797edc024f49a109bd544b6a1a6a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1115cad94eac44eab3e2c85a51374d15" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 34011 } } peers { permanent_uuid: "f131797edc024f49a109bd544b6a1a6a" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 33961 } } peers { permanent_uuid: "668ecc2f8ef447489e78c0b2382d7d56" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 44849 } }
I20260807 10:39:14.902879 2393 raft_consensus.cc:348] T cf1c940c2348422ca170fccf8aa36c6d P 668ecc2f8ef447489e78c0b2382d7d56 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1115cad94eac44eab3e2c85a51374d15" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 34011 } } peers { permanent_uuid: "f131797edc024f49a109bd544b6a1a6a" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 33961 } } peers { permanent_uuid: "668ecc2f8ef447489e78c0b2382d7d56" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 44849 } }
I20260807 10:39:14.903254 2393 raft_consensus.cc:374] T cf1c940c2348422ca170fccf8aa36c6d P 668ecc2f8ef447489e78c0b2382d7d56 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:39:14.903353 2393 raft_consensus.cc:729] T cf1c940c2348422ca170fccf8aa36c6d P 668ecc2f8ef447489e78c0b2382d7d56 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 668ecc2f8ef447489e78c0b2382d7d56, State: Initialized, Role: FOLLOWER
I20260807 10:39:14.904759 2081 heartbeater.cc:503] Master 127.20.171.126:37057 was elected leader, sending a full tablet report...
I20260807 10:39:14.906317 2390 ts_tablet_manager.cc:1428] T cf1c940c2348422ca170fccf8aa36c6d P 1115cad94eac44eab3e2c85a51374d15: Time spent starting tablet: real 0.036s user 0.010s sys 0.005s
I20260807 10:39:14.911358 2393 consensus_queue.cc:260] T cf1c940c2348422ca170fccf8aa36c6d P 668ecc2f8ef447489e78c0b2382d7d56 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1115cad94eac44eab3e2c85a51374d15" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 34011 } } peers { permanent_uuid: "f131797edc024f49a109bd544b6a1a6a" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 33961 } } peers { permanent_uuid: "668ecc2f8ef447489e78c0b2382d7d56" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 44849 } }
I20260807 10:39:14.912734 2231 heartbeater.cc:503] Master 127.20.171.126:37057 was elected leader, sending a full tablet report...
I20260807 10:39:14.913403 2393 ts_tablet_manager.cc:1428] T cf1c940c2348422ca170fccf8aa36c6d P 668ecc2f8ef447489e78c0b2382d7d56: Time spent starting tablet: real 0.021s user 0.008s sys 0.004s
I20260807 10:39:14.914345 2369 heartbeater.cc:503] Master 127.20.171.126:37057 was elected leader, sending a full tablet report...
I20260807 10:39:14.914878 2391 ts_tablet_manager.cc:1428] T cf1c940c2348422ca170fccf8aa36c6d P f131797edc024f49a109bd544b6a1a6a: Time spent starting tablet: real 0.024s user 0.018s sys 0.005s
W20260807 10:39:14.944826 2232 tablet.cc:2369] T cf1c940c2348422ca170fccf8aa36c6d P 668ecc2f8ef447489e78c0b2382d7d56: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 10:39:15.048295 2082 tablet.cc:2369] T cf1c940c2348422ca170fccf8aa36c6d P 1115cad94eac44eab3e2c85a51374d15: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 10:39:15.050519 2399 raft_consensus.cc:482] T cf1c940c2348422ca170fccf8aa36c6d P f131797edc024f49a109bd544b6a1a6a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 10:39:15.050825 2399 raft_consensus.cc:504] T cf1c940c2348422ca170fccf8aa36c6d P f131797edc024f49a109bd544b6a1a6a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1115cad94eac44eab3e2c85a51374d15" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 34011 } } peers { permanent_uuid: "f131797edc024f49a109bd544b6a1a6a" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 33961 } } peers { permanent_uuid: "668ecc2f8ef447489e78c0b2382d7d56" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 44849 } }
I20260807 10:39:15.053017 2399 leader_election.cc:288] T cf1c940c2348422ca170fccf8aa36c6d P f131797edc024f49a109bd544b6a1a6a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1115cad94eac44eab3e2c85a51374d15 (127.20.171.65:34011), 668ecc2f8ef447489e78c0b2382d7d56 (127.20.171.66:44849)
I20260807 10:39:15.059863 2389 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:15.053954 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.67:59185 (local address 127.20.171.66:44849)
0807 10:39:15.054231 (+ 277us) server_negotiation.cc:206] Beginning negotiation
0807 10:39:15.054238 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:39:15.054258 (+ 20us) server_negotiation.cc:407] Connection header received
0807 10:39:15.054331 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:39:15.054336 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:39:15.054418 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:39:15.054539 (+ 121us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:39:15.054985 (+ 446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:15.056059 (+ 1074us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:15.058063 (+ 2004us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:15.058897 (+ 834us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:15.059048 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:39:15.059124 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0807 10:39:15.059463 (+ 339us) server_negotiation.cc:299] Negotiation successful
0807 10:39:15.059596 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260807 10:39:15.059899 2371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:15.053258 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.66:44849 (local address 127.20.171.67:59185)
0807 10:39:15.053690 (+ 432us) negotiation.cc:107] Waiting for socket to connect
0807 10:39:15.053731 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0807 10:39:15.053897 (+ 166us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:39:15.054557 (+ 660us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:39:15.054561 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:39:15.054588 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:39:15.054823 (+ 235us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:39:15.054835 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:39:15.056227 (+ 1392us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:39:15.056232 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:39:15.057907 (+ 1675us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:39:15.057920 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:39:15.059070 (+ 1150us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:39:15.059077 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:39:15.059273 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:39:15.059316 (+ 43us) client_negotiation.cc:769] Sending connection context
0807 10:39:15.059424 (+ 108us) client_negotiation.cc:240] Negotiation successful
0807 10:39:15.059574 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":276,"mutex_wait_us":1}
I20260807 10:39:15.060992 2386 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:15.053474 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.67:57599 (local address 127.20.171.65:34011)
0807 10:39:15.053679 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0807 10:39:15.053685 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:39:15.054550 (+ 865us) server_negotiation.cc:407] Connection header received
0807 10:39:15.054834 (+ 284us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:39:15.054841 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:39:15.054935 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:39:15.055040 (+ 105us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:39:15.055563 (+ 523us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:15.056385 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:15.058916 (+ 2531us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:15.059981 (+ 1065us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:15.060111 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:39:15.060172 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0807 10:39:15.060599 (+ 427us) server_negotiation.cc:299] Negotiation successful
0807 10:39:15.060748 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260807 10:39:15.061112 2406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:15.053340 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.65:34011 (local address 127.20.171.67:57599)
0807 10:39:15.054430 (+ 1090us) negotiation.cc:107] Waiting for socket to connect
0807 10:39:15.054446 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 10:39:15.054668 (+ 222us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:39:15.055051 (+ 383us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:39:15.055055 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:39:15.055077 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:39:15.055383 (+ 306us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:39:15.055392 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:39:15.056538 (+ 1146us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:39:15.056544 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:39:15.058726 (+ 2182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:39:15.058743 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:39:15.060173 (+ 1430us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:39:15.060180 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:39:15.060387 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:39:15.060423 (+ 36us) client_negotiation.cc:769] Sending connection context
0807 10:39:15.060560 (+ 137us) client_negotiation.cc:240] Negotiation successful
0807 10:39:15.060718 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":988,"thread_start_us":797,"threads_started":1}
I20260807 10:39:15.061350 2186 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cf1c940c2348422ca170fccf8aa36c6d" candidate_uuid: "f131797edc024f49a109bd544b6a1a6a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "668ecc2f8ef447489e78c0b2382d7d56" is_pre_election: true
I20260807 10:39:15.061951 2186 raft_consensus.cc:2454] T cf1c940c2348422ca170fccf8aa36c6d P 668ecc2f8ef447489e78c0b2382d7d56 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f131797edc024f49a109bd544b6a1a6a in term 0.
I20260807 10:39:15.062238 2034 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cf1c940c2348422ca170fccf8aa36c6d" candidate_uuid: "f131797edc024f49a109bd544b6a1a6a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1115cad94eac44eab3e2c85a51374d15" is_pre_election: true
I20260807 10:39:15.062717 2255 leader_election.cc:302] T cf1c940c2348422ca170fccf8aa36c6d P f131797edc024f49a109bd544b6a1a6a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 668ecc2f8ef447489e78c0b2382d7d56, f131797edc024f49a109bd544b6a1a6a; no voters:
I20260807 10:39:15.062841 2034 raft_consensus.cc:2454] T cf1c940c2348422ca170fccf8aa36c6d P 1115cad94eac44eab3e2c85a51374d15 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f131797edc024f49a109bd544b6a1a6a in term 0.
I20260807 10:39:15.063133 2399 raft_consensus.cc:2781] T cf1c940c2348422ca170fccf8aa36c6d P f131797edc024f49a109bd544b6a1a6a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 10:39:15.063316 2399 raft_consensus.cc:482] T cf1c940c2348422ca170fccf8aa36c6d P f131797edc024f49a109bd544b6a1a6a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 10:39:15.063431 2399 raft_consensus.cc:3037] T cf1c940c2348422ca170fccf8aa36c6d P f131797edc024f49a109bd544b6a1a6a [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:39:15.065789 2399 raft_consensus.cc:504] T cf1c940c2348422ca170fccf8aa36c6d P f131797edc024f49a109bd544b6a1a6a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1115cad94eac44eab3e2c85a51374d15" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 34011 } } peers { permanent_uuid: "f131797edc024f49a109bd544b6a1a6a" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 33961 } } peers { permanent_uuid: "668ecc2f8ef447489e78c0b2382d7d56" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 44849 } }
I20260807 10:39:15.066434 2399 leader_election.cc:288] T cf1c940c2348422ca170fccf8aa36c6d P f131797edc024f49a109bd544b6a1a6a [CANDIDATE]: Term 1 election: Requested vote from peers 1115cad94eac44eab3e2c85a51374d15 (127.20.171.65:34011), 668ecc2f8ef447489e78c0b2382d7d56 (127.20.171.66:44849)
I20260807 10:39:15.066924 2034 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cf1c940c2348422ca170fccf8aa36c6d" candidate_uuid: "f131797edc024f49a109bd544b6a1a6a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1115cad94eac44eab3e2c85a51374d15"
I20260807 10:39:15.066996 2186 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cf1c940c2348422ca170fccf8aa36c6d" candidate_uuid: "f131797edc024f49a109bd544b6a1a6a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "668ecc2f8ef447489e78c0b2382d7d56"
I20260807 10:39:15.067126 2034 raft_consensus.cc:3037] T cf1c940c2348422ca170fccf8aa36c6d P 1115cad94eac44eab3e2c85a51374d15 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:39:15.067190 2186 raft_consensus.cc:3037] T cf1c940c2348422ca170fccf8aa36c6d P 668ecc2f8ef447489e78c0b2382d7d56 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:39:15.070457 2186 raft_consensus.cc:2454] T cf1c940c2348422ca170fccf8aa36c6d P 668ecc2f8ef447489e78c0b2382d7d56 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f131797edc024f49a109bd544b6a1a6a in term 1.
I20260807 10:39:15.070514 2034 raft_consensus.cc:2454] T cf1c940c2348422ca170fccf8aa36c6d P 1115cad94eac44eab3e2c85a51374d15 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f131797edc024f49a109bd544b6a1a6a in term 1.
I20260807 10:39:15.070868 2255 leader_election.cc:302] T cf1c940c2348422ca170fccf8aa36c6d P f131797edc024f49a109bd544b6a1a6a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 668ecc2f8ef447489e78c0b2382d7d56, f131797edc024f49a109bd544b6a1a6a; no voters:
I20260807 10:39:15.071131 2399 raft_consensus.cc:2781] T cf1c940c2348422ca170fccf8aa36c6d P f131797edc024f49a109bd544b6a1a6a [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:39:15.071645 2399 raft_consensus.cc:686] T cf1c940c2348422ca170fccf8aa36c6d P f131797edc024f49a109bd544b6a1a6a [term 1 LEADER]: Becoming Leader. State: Replica: f131797edc024f49a109bd544b6a1a6a, State: Running, Role: LEADER
I20260807 10:39:15.072165 2399 consensus_queue.cc:237] T cf1c940c2348422ca170fccf8aa36c6d P f131797edc024f49a109bd544b6a1a6a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1115cad94eac44eab3e2c85a51374d15" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 34011 } } peers { permanent_uuid: "f131797edc024f49a109bd544b6a1a6a" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 33961 } } peers { permanent_uuid: "668ecc2f8ef447489e78c0b2382d7d56" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 44849 } }
I20260807 10:39:15.077211 1879 catalog_manager.cc:5495] T cf1c940c2348422ca170fccf8aa36c6d P f131797edc024f49a109bd544b6a1a6a reported cstate change: term changed from 0 to 1, leader changed from <none> to f131797edc024f49a109bd544b6a1a6a (127.20.171.67). New cstate: current_term: 1 leader_uuid: "f131797edc024f49a109bd544b6a1a6a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1115cad94eac44eab3e2c85a51374d15" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 34011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f131797edc024f49a109bd544b6a1a6a" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 33961 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "668ecc2f8ef447489e78c0b2382d7d56" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 44849 } health_report { overall_health: UNKNOWN } } }
I20260807 10:39:15.103863 2388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:15.098247 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54358 (local address 127.20.171.67:33961)
0807 10:39:15.098420 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0807 10:39:15.098427 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:39:15.098449 (+ 22us) server_negotiation.cc:407] Connection header received
0807 10:39:15.098726 (+ 277us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:39:15.098730 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:39:15.098811 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:39:15.098958 (+ 147us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 10:39:15.099375 (+ 417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:15.100069 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:15.101669 (+ 1600us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:15.102074 (+ 405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:15.102204 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:39:15.102722 (+ 518us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 10:39:15.103210 (+ 488us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 10:39:15.103357 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0807 10:39:15.103513 (+ 156us) server_negotiation.cc:299] Negotiation successful
0807 10:39:15.103595 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260807 10:39:15.112437 2186 raft_consensus.cc:1261] T cf1c940c2348422ca170fccf8aa36c6d P 668ecc2f8ef447489e78c0b2382d7d56 [term 1 FOLLOWER]: Refusing update from remote peer f131797edc024f49a109bd544b6a1a6a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 10:39:15.112437 2034 raft_consensus.cc:1261] T cf1c940c2348422ca170fccf8aa36c6d P 1115cad94eac44eab3e2c85a51374d15 [term 1 FOLLOWER]: Refusing update from remote peer f131797edc024f49a109bd544b6a1a6a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 10:39:15.113539 2407 consensus_queue.cc:1035] T cf1c940c2348422ca170fccf8aa36c6d P f131797edc024f49a109bd544b6a1a6a [LEADER]: Connected to new peer: Peer: permanent_uuid: "668ecc2f8ef447489e78c0b2382d7d56" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 44849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 10:39:15.113883 2399 consensus_queue.cc:1035] T cf1c940c2348422ca170fccf8aa36c6d P f131797edc024f49a109bd544b6a1a6a [LEADER]: Connected to new peer: Peer: permanent_uuid: "1115cad94eac44eab3e2c85a51374d15" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 34011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260807 10:39:15.120285 2370 tablet.cc:2369] T cf1c940c2348422ca170fccf8aa36c6d P f131797edc024f49a109bd544b6a1a6a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 10:39:15.146014 1879 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44148:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 10:39:15.146812 1879 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44148:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 10:39:15.152613 1879 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7cec2f01818242f78f60d7f3be0b7ba2: Sending DeleteTablet for 3 replicas of tablet cf1c940c2348422ca170fccf8aa36c6d
I20260807 10:39:15.153996 2014 tablet_service.cc:1514] Processing DeleteTablet for tablet cf1c940c2348422ca170fccf8aa36c6d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:39:15 UTC) from {username='kudu', principal='kudu/127.20.171.126@KRBTEST.COM'} at 127.0.0.1:38424
I20260807 10:39:15.154655 2302 tablet_service.cc:1514] Processing DeleteTablet for tablet cf1c940c2348422ca170fccf8aa36c6d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:39:15 UTC) from {username='kudu', principal='kudu/127.20.171.126@KRBTEST.COM'} at 127.0.0.1:54352
I20260807 10:39:15.158879 2421 tablet_replica.cc:330] T cf1c940c2348422ca170fccf8aa36c6d P f131797edc024f49a109bd544b6a1a6a: stopping tablet replica
I20260807 10:39:15.159197 2165 tablet_service.cc:1514] Processing DeleteTablet for tablet cf1c940c2348422ca170fccf8aa36c6d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:39:15 UTC) from {username='kudu', principal='kudu/127.20.171.126@KRBTEST.COM'} at 127.0.0.1:60660
I20260807 10:39:15.159250 2162 tablet_service.cc:1514] Processing DeleteTablet for tablet cf1c940c2348422ca170fccf8aa36c6d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:39:15 UTC) from {username='kudu', principal='kudu/127.20.171.126@KRBTEST.COM'} at 127.0.0.1:60660
I20260807 10:39:15.159377 2421 raft_consensus.cc:2229] T cf1c940c2348422ca170fccf8aa36c6d P f131797edc024f49a109bd544b6a1a6a [term 1 LEADER]: Raft consensus shutting down.
I20260807 10:39:15.160132 2421 raft_consensus.cc:2258] T cf1c940c2348422ca170fccf8aa36c6d P f131797edc024f49a109bd544b6a1a6a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:39:15.162315 2421 ts_tablet_manager.cc:1905] T cf1c940c2348422ca170fccf8aa36c6d P f131797edc024f49a109bd544b6a1a6a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 10:39:15.169405 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 1917
I20260807 10:39:15.173776 2420 tablet_replica.cc:330] T cf1c940c2348422ca170fccf8aa36c6d P 1115cad94eac44eab3e2c85a51374d15: stopping tablet replica
I20260807 10:39:15.174245 2420 raft_consensus.cc:2229] T cf1c940c2348422ca170fccf8aa36c6d P 1115cad94eac44eab3e2c85a51374d15 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 10:39:15.174759 2420 raft_consensus.cc:2258] T cf1c940c2348422ca170fccf8aa36c6d P 1115cad94eac44eab3e2c85a51374d15 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:39:15.175545 2422 tablet_replica.cc:330] T cf1c940c2348422ca170fccf8aa36c6d P 668ecc2f8ef447489e78c0b2382d7d56: stopping tablet replica
I20260807 10:39:15.177477 2420 ts_tablet_manager.cc:1905] T cf1c940c2348422ca170fccf8aa36c6d P 1115cad94eac44eab3e2c85a51374d15: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 10:39:15.181388 2422 raft_consensus.cc:2229] T cf1c940c2348422ca170fccf8aa36c6d P 668ecc2f8ef447489e78c0b2382d7d56 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 10:39:15.181905 2422 raft_consensus.cc:2258] T cf1c940c2348422ca170fccf8aa36c6d P 668ecc2f8ef447489e78c0b2382d7d56 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:39:15.182408 2421 ts_tablet_manager.cc:1918] T cf1c940c2348422ca170fccf8aa36c6d P f131797edc024f49a109bd544b6a1a6a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 10:39:15.182591 2421 log.cc:1196] T cf1c940c2348422ca170fccf8aa36c6d P f131797edc024f49a109bd544b6a1a6a: Deleting WAL directory at /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/minicluster-data/ts-2/wal/wals/cf1c940c2348422ca170fccf8aa36c6d
I20260807 10:39:15.183117 2421 ts_tablet_manager.cc:1939] T cf1c940c2348422ca170fccf8aa36c6d P f131797edc024f49a109bd544b6a1a6a: Deleting consensus metadata
I20260807 10:39:15.184103 2422 ts_tablet_manager.cc:1905] T cf1c940c2348422ca170fccf8aa36c6d P 668ecc2f8ef447489e78c0b2382d7d56: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 10:39:15.184957 1865 catalog_manager.cc:4841] TS f131797edc024f49a109bd544b6a1a6a (127.20.171.67:33961): tablet cf1c940c2348422ca170fccf8aa36c6d (table test-table [id=9e1ee7ae083141c6b9186486b2196dd9]) successfully deleted
I20260807 10:39:15.192417 2386 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:15.173669 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38428 (local address 127.20.171.65:34011)
0807 10:39:15.173921 (+ 252us) server_negotiation.cc:206] Beginning negotiation
0807 10:39:15.173929 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 10:39:15.173952 (+ 23us) server_negotiation.cc:407] Connection header received
0807 10:39:15.174027 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:39:15.174047 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:39:15.174152 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:39:15.174287 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:39:15.176547 (+ 2260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:15.177661 (+ 1114us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:15.179526 (+ 1865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:15.180144 (+ 618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:15.180304 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:39:15.183681 (+ 3377us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:39:15.183693 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:39:15.183708 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:39:15.183744 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:39:15.188225 (+ 4481us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:39:15.189119 (+ 894us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:39:15.189128 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:39:15.189131 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:39:15.189296 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:39:15.189739 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:39:15.189744 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:39:15.189748 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:39:15.190159 (+ 411us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:39:15.190475 (+ 316us) server_negotiation.cc:1035] Waiting for connection context
0807 10:39:15.191708 (+ 1233us) server_negotiation.cc:299] Negotiation successful
0807 10:39:15.191942 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260807 10:39:15.193285 2075 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:39:15.194573 2422 ts_tablet_manager.cc:1918] T cf1c940c2348422ca170fccf8aa36c6d P 668ecc2f8ef447489e78c0b2382d7d56: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 10:39:15.194753 2422 log.cc:1196] T cf1c940c2348422ca170fccf8aa36c6d P 668ecc2f8ef447489e78c0b2382d7d56: Deleting WAL directory at /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/minicluster-data/ts-1/wal/wals/cf1c940c2348422ca170fccf8aa36c6d
I20260807 10:39:15.195277 2422 ts_tablet_manager.cc:1939] T cf1c940c2348422ca170fccf8aa36c6d P 668ecc2f8ef447489e78c0b2382d7d56: Deleting consensus metadata
I20260807 10:39:15.197077 1865 catalog_manager.cc:4841] TS 668ecc2f8ef447489e78c0b2382d7d56 (127.20.171.66:44849): tablet cf1c940c2348422ca170fccf8aa36c6d (table test-table [id=9e1ee7ae083141c6b9186486b2196dd9]) successfully deleted
W20260807 10:39:15.197832 1865 catalog_manager.cc:4808] TS 668ecc2f8ef447489e78c0b2382d7d56 (127.20.171.66:44849): delete failed for tablet cf1c940c2348422ca170fccf8aa36c6d because the tablet was not found. No further retry: Not found: Tablet not found: cf1c940c2348422ca170fccf8aa36c6d
I20260807 10:39:15.302634 2420 ts_tablet_manager.cc:1918] T cf1c940c2348422ca170fccf8aa36c6d P 1115cad94eac44eab3e2c85a51374d15: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 10:39:15.302906 2420 log.cc:1196] T cf1c940c2348422ca170fccf8aa36c6d P 1115cad94eac44eab3e2c85a51374d15: Deleting WAL directory at /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786098956060137-21165-0/minicluster-data/ts-0/wal/wals/cf1c940c2348422ca170fccf8aa36c6d
I20260807 10:39:15.303367 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 1917
I20260807 10:39:15.303580 2420 ts_tablet_manager.cc:1939] T cf1c940c2348422ca170fccf8aa36c6d P 1115cad94eac44eab3e2c85a51374d15: Deleting consensus metadata
W20260807 10:39:15.331466 1863 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.20.171.65:34011 (error 108)
I20260807 10:39:15.331746 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 2084
I20260807 10:39:15.333606 2385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:15.333018 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.65:34011 (local address 127.0.0.1:38434)
0807 10:39:15.333288 (+ 270us) negotiation.cc:107] Waiting for socket to connect
0807 10:39:15.333423 (+ 135us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.65:34011: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":159}
W20260807 10:39:15.333889 1863 catalog_manager.cc:4584] TS 1115cad94eac44eab3e2c85a51374d15 (127.20.171.65:34011): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet cf1c940c2348422ca170fccf8aa36c6d: Network error: Client connection negotiation failed: client connection to 127.20.171.65:34011: connect: Connection refused (error 111)
I20260807 10:39:15.352777 2389 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:15.332726 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60662 (local address 127.20.171.66:44849)
0807 10:39:15.332913 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0807 10:39:15.332919 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:39:15.332990 (+ 71us) server_negotiation.cc:407] Connection header received
0807 10:39:15.333194 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:39:15.333200 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:39:15.333283 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:39:15.333390 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:39:15.335017 (+ 1627us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:15.335766 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:15.337629 (+ 1863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:15.338029 (+ 400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:15.338137 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:39:15.346991 (+ 8854us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:39:15.347005 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:39:15.347020 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:39:15.347056 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:39:15.349949 (+ 2893us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:39:15.350761 (+ 812us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:39:15.350767 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:39:15.350770 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:39:15.350895 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:39:15.351263 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:39:15.351265 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:39:15.351267 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:39:15.351592 (+ 325us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:39:15.351817 (+ 225us) server_negotiation.cc:1035] Waiting for connection context
0807 10:39:15.352180 (+ 363us) server_negotiation.cc:299] Negotiation successful
0807 10:39:15.352428 (+ 248us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260807 10:39:15.353438 2226 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:39:15.387485 2385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:15.386921 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.65:34011 (local address 127.0.0.1:38442)
0807 10:39:15.387160 (+ 239us) negotiation.cc:107] Waiting for socket to connect
0807 10:39:15.387275 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.65:34011: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":91}
I20260807 10:39:15.388710 2385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:15.388236 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.65:34011 (local address 127.0.0.1:38456)
0807 10:39:15.388415 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0807 10:39:15.388498 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.65:34011: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
I20260807 10:39:15.444020 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 2084
I20260807 10:39:15.449548 2385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:15.448990 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.65:34011 (local address 127.0.0.1:38468)
0807 10:39:15.449235 (+ 245us) negotiation.cc:107] Waiting for socket to connect
0807 10:39:15.449351 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.65:34011: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
I20260807 10:39:15.450824 2385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:15.450355 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.65:34011 (local address 127.0.0.1:38484)
0807 10:39:15.450531 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0807 10:39:15.450647 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.65:34011: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260807 10:39:15.465183 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 2236
I20260807 10:39:15.479501 2388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:15.465963 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54362 (local address 127.20.171.67:33961)
0807 10:39:15.466162 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0807 10:39:15.466168 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:39:15.466271 (+ 103us) server_negotiation.cc:407] Connection header received
0807 10:39:15.466479 (+ 208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:39:15.466485 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:39:15.466563 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:39:15.466698 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:39:15.468070 (+ 1372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:15.468957 (+ 887us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:15.470266 (+ 1309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:15.470696 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:15.470843 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:39:15.473415 (+ 2572us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:39:15.473430 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:39:15.473446 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:39:15.473488 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:39:15.476685 (+ 3197us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:39:15.477350 (+ 665us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:39:15.477360 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:39:15.477368 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:39:15.477545 (+ 177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:39:15.477955 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:39:15.477962 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:39:15.477965 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:39:15.478298 (+ 333us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:39:15.478642 (+ 344us) server_negotiation.cc:1035] Waiting for connection context
0807 10:39:15.478911 (+ 269us) server_negotiation.cc:299] Negotiation successful
0807 10:39:15.479133 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260807 10:39:15.480151 2364 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:39:15.531581 2385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:15.531044 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.65:34011 (local address 127.0.0.1:38500)
0807 10:39:15.531267 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0807 10:39:15.531394 (+ 127us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.65:34011: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":73}
I20260807 10:39:15.532766 2385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:15.532333 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.65:34011 (local address 127.0.0.1:38510)
0807 10:39:15.532530 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0807 10:39:15.532621 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.65:34011: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":95}
I20260807 10:39:15.600637 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 2236
I20260807 10:39:15.622831 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 1846
I20260807 10:39:15.623983 1910 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:39:15.733754 2385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:15.732952 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.65:34011 (local address 127.0.0.1:38516)
0807 10:39:15.733368 (+ 416us) negotiation.cc:107] Waiting for socket to connect
0807 10:39:15.733491 (+ 123us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.65:34011: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":107}
I20260807 10:39:15.734107 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 1846
I20260807 10:39:15.756996 21165 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260807 10:39:16.102475 21165 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260807 10:39:16.102733 21165 mini_ranger.cc:66] Stopping Ranger...
I20260807 10:39:16.447129 21165 mini_ranger.cc:68] Stopped Ranger
2026-08-07 10:39:16.447 UTC [879] LOG: received smart shutdown request
2026-08-07 10:39:16.450 UTC [879] LOG: background worker "logical replication launcher" (PID 887) exited with exit code 1
2026-08-07 10:39:16.451 UTC [882] LOG: shutting down
2026-08-07 10:39:16.606 UTC [879] LOG: database system is shut down
2026-08-07T10:39:16Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (51378 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786098956060137-21165-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 10:39:16 dist-test-slave-0b58 krb5kdc[2436](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 10:39:16 dist-test-slave-0b58 krb5kdc[2436](info): set up 2 sockets
Aug 07 10:39:16 dist-test-slave-0b58 krb5kdc[2436](info): commencing operation
krb5kdc: starting...
W20260807 10:39:17.862730 21165 mini_kdc.cc:121] Time spent starting KDC: real 1.088s user 0.000s sys 0.039s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786098956060137-21165-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786098956060137-21165-0/krb5kdc/test-user.keytab.
Aug 07 10:39:18 dist-test-slave-0b58 krb5kdc[2436](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099158, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T10:39:18Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T10:39:18Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.171.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.171.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.171.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.126.keytab.
Entry for principal kudu/127.20.171.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.126.keytab.
I20260807 10:39:18.147980 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786098956060137-21165-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786098956060137-21165-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786098956060137-21165-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.171.126:44615
--webserver_interface=127.20.171.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.126.keytab
--principal=kudu/127.20.171.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.171.84:44663
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.171.126:44615,127.20.171.125:39661,127.20.171.124:40649
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786098956060137-21165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786098956060137-21165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786098956060137-21165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:39:18.484920 2450 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:39:18.485306 2450 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:39:18.485474 2450 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:39:18.492679 2450 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 10:39:18.492816 2450 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:39:18.492916 2450 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:39:18.493016 2450 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 10:39:18.493099 2450 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 10:39:18.503396 2450 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.171.84:44663
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786098956060137-21165-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786098956060137-21165-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.171.126:44615,127.20.171.125:39661,127.20.171.124:40649
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.126.keytab
--principal=kudu/127.20.171.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.171.126:44615
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.171.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786098956060137-21165-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:39:18.504752 2450 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:39:18.506049 2450 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:39:18.517874 2458 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:39:18.517944 2456 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:39:18.518276 2455 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:39:18.519124 2450 server_base.cc:1034] running on GCE node
I20260807 10:39:18.519846 2450 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:39:18.521152 2450 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:39:18.522384 2450 hybrid_clock.cc:648] HybridClock initialized: now 1786099158522348 us; error 41 us; skew 500 ppm
I20260807 10:39:18.522724 2450 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:39:18 dist-test-slave-0b58 krb5kdc[2436](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099158, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:39:18.525822 2450 init.cc:377] Logged in from keytab as kudu/127.20.171.126@KRBTEST.COM (short username kudu)
I20260807 10:39:18.527298 2450 webserver.cc:460] Webserver started at http://127.20.171.126:44297/ using document root <none> and password file <none>
I20260807 10:39:18.527968 2450 fs_manager.cc:359] Metadata directory not provided
I20260807 10:39:18.528069 2450 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:39:18.528384 2450 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:39:18.531365 2450 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786098956060137-21165-0/minicluster-data/master-0/data/instance:
uuid: "c39e2a2b15174fcabf0174ebd4f07680"
format_stamp: "Formatted at 2026-08-07 10:39:18 on dist-test-slave-0b58"
server_key: "83f0c9140c4ed3259012b430f38be44e"
server_key_iv: "1af146d0711b052ae432b8339efc4b37"
server_key_version: "encryptionkey@0"
I20260807 10:39:18.532150 2450 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786098956060137-21165-0/minicluster-data/master-0/wal/instance:
uuid: "c39e2a2b15174fcabf0174ebd4f07680"
format_stamp: "Formatted at 2026-08-07 10:39:18 on dist-test-slave-0b58"
server_key: "83f0c9140c4ed3259012b430f38be44e"
server_key_iv: "1af146d0711b052ae432b8339efc4b37"
server_key_version: "encryptionkey@0"
I20260807 10:39:18.537423 2450 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260807 10:39:18.540912 2465 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:39:18.542241 2450 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260807 10:39:18.542387 2450 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786098956060137-21165-0/minicluster-data/master-0/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786098956060137-21165-0/minicluster-data/master-0/wal
uuid: "c39e2a2b15174fcabf0174ebd4f07680"
format_stamp: "Formatted at 2026-08-07 10:39:18 on dist-test-slave-0b58"
server_key: "83f0c9140c4ed3259012b430f38be44e"
server_key_iv: "1af146d0711b052ae432b8339efc4b37"
server_key_version: "encryptionkey@0"
I20260807 10:39:18.542562 2450 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786098956060137-21165-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786098956060137-21165-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786098956060137-21165-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:39:18.565531 2450 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:39:18.569796 2450 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:39:18.570039 2450 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:39:18.589421 2450 rpc_server.cc:307] RPC server started. Bound to: 127.20.171.126:44615
I20260807 10:39:18.589460 2517 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.171.126:44615 every 8 connection(s)
I20260807 10:39:18.590783 2450 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
I20260807 10:39:18.594492 2518 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:39:18.595526 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 2450
I20260807 10:39:18.595777 21165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786098956060137-21165-0/minicluster-data/master-0/wal/instance
I20260807 10:39:18.596710 21165 external_mini_cluster.cc:1428] Setting key a9dae33e2664f90fba389e1ad9a1ce64
I20260807 10:39:18.604606 2518 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.171.126" port: 44615 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 10:39:18 dist-test-slave-0b58 krb5kdc[2436](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099158, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.126@KRBTEST.COM for kudu/127.20.171.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.20.171.125@KRBTEST.COM; defaulting to no policy
I20260807 10:39:18.630982 2520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:18.608587 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35132 (local address 127.20.171.126:44615)
0807 10:39:18.609511 (+ 924us) server_negotiation.cc:206] Beginning negotiation
0807 10:39:18.609526 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 10:39:18.610082 (+ 556us) server_negotiation.cc:407] Connection header received
0807 10:39:18.612835 (+ 2753us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:39:18.612841 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:39:18.613052 (+ 211us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:39:18.613226 (+ 174us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:39:18.614971 (+ 1745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:18.616181 (+ 1210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:18.618441 (+ 2260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:18.618982 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:18.619117 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:39:18.623054 (+ 3937us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:39:18.623062 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:39:18.623073 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:39:18.623105 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:39:18.626920 (+ 3815us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:39:18.627602 (+ 682us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:39:18.627614 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:39:18.627619 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:39:18.627839 (+ 220us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:39:18.628210 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:39:18.628215 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:39:18.628219 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:39:18.628943 (+ 724us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:39:18.629126 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0807 10:39:18.629620 (+ 494us) server_negotiation.cc:299] Negotiation successful
0807 10:39:18.629916 (+ 296us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":660,"thread_start_us":408,"threads_started":1}
I20260807 10:39:18.631027 2521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:18.608587 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:44615 (local address 127.0.0.1:35132)
0807 10:39:18.609892 (+ 1305us) negotiation.cc:107] Waiting for socket to connect
0807 10:39:18.609947 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0807 10:39:18.612444 (+ 2497us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:39:18.613312 (+ 868us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:39:18.613323 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:39:18.614235 (+ 912us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:39:18.614759 (+ 524us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:39:18.614785 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:39:18.616367 (+ 1582us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:39:18.616375 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:39:18.618297 (+ 1922us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:39:18.618321 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:39:18.619248 (+ 927us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:39:18.619257 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:39:18.619466 (+ 209us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:39:18.620162 (+ 696us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:39:18.620200 (+ 38us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:39:18.622851 (+ 2651us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:39:18.627051 (+ 4200us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:39:18.627061 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:39:18.627070 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:39:18.627462 (+ 392us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:39:18.627950 (+ 488us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:39:18.627953 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:39:18.627955 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:39:18.628093 (+ 138us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:39:18.629076 (+ 983us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:39:18.629082 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:39:18.629279 (+ 197us) client_negotiation.cc:769] Sending connection context
0807 10:39:18.629489 (+ 210us) client_negotiation.cc:240] Negotiation successful
0807 10:39:18.630065 (+ 576us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1052,"mutex_wait_us":127,"spinlock_wait_cycles":58240,"thread_start_us":811,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.171.125@KRBTEST.COM" created.
I20260807 10:39:18.633926 2518 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.171.125" port: 39661 } has no permanent_uuid. Determining permanent_uuid...
I20260807 10:39:18.634886 2521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:18.634513 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.125:39661 (local address 127.0.0.1:39420)
0807 10:39:18.634670 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0807 10:39:18.634781 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.125:39661: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260807 10:39:18.635105 2468 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.171.125:39661: connect: Connection refused (error 111)
I20260807 10:39:18.636696 2521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:18.636362 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.125:39661 (local address 127.0.0.1:39436)
0807 10:39:18.636503 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0807 10:39:18.636568 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.125:39661: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260807 10:39:18.636912 2518 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.171.125:39661: Network error: Client connection negotiation failed: client connection to 127.20.171.125:39661: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.171.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.125.keytab.
Entry for principal kudu/127.20.171.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.125.keytab.
I20260807 10:39:18.663288 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786098956060137-21165-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786098956060137-21165-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786098956060137-21165-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786098956060137-21165-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.171.125:39661
--webserver_interface=127.20.171.125
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.125.keytab
--principal=kudu/127.20.171.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.171.84:44663
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.171.126:44615,127.20.171.125:39661,127.20.171.124:40649
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786098956060137-21165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786098956060137-21165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786098956060137-21165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 10:39:18.686280 2518 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.171.125" port: 39661 } attempt: 1
I20260807 10:39:18.687531 2521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:18.687062 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.125:39661 (local address 127.0.0.1:39438)
0807 10:39:18.687287 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0807 10:39:18.687394 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.125:39661: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":76}
I20260807 10:39:18.688553 2521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:18.688178 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.125:39661 (local address 127.0.0.1:39446)
0807 10:39:18.688354 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0807 10:39:18.688425 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.125:39661: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260807 10:39:18.688722 2518 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.171.125:39661: Network error: Client connection negotiation failed: client connection to 127.20.171.125:39661: connect: Connection refused (error 111)
I20260807 10:39:18.756958 2518 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.171.125" port: 39661 } attempt: 2
I20260807 10:39:18.758208 2521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:18.757720 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.125:39661 (local address 127.0.0.1:39462)
0807 10:39:18.757956 (+ 236us) negotiation.cc:107] Waiting for socket to connect
0807 10:39:18.758054 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.125:39661: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":73}
I20260807 10:39:18.759254 2521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:18.758854 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.125:39661 (local address 127.0.0.1:39466)
0807 10:39:18.759036 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0807 10:39:18.759111 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.125:39661: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260807 10:39:18.759421 2518 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.171.125:39661: Network error: Client connection negotiation failed: client connection to 127.20.171.125:39661: connect: Connection refused (error 111)
I20260807 10:39:18.850675 2518 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.171.125" port: 39661 } attempt: 3
I20260807 10:39:18.851799 2521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:18.851384 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.125:39661 (local address 127.0.0.1:39468)
0807 10:39:18.851575 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0807 10:39:18.851664 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.125:39661: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":70}
I20260807 10:39:18.852849 2521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:18.852456 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.125:39661 (local address 127.0.0.1:39474)
0807 10:39:18.852616 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0807 10:39:18.852703 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.125:39661: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260807 10:39:18.853026 2518 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.171.125:39661: Network error: Client connection negotiation failed: client connection to 127.20.171.125:39661: connect: Connection refused (error 111)
I20260807 10:39:18.996291 2518 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.171.125" port: 39661 } attempt: 4
I20260807 10:39:18.997547 2521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:18.997020 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.125:39661 (local address 127.0.0.1:39490)
0807 10:39:18.997304 (+ 284us) negotiation.cc:107] Waiting for socket to connect
0807 10:39:18.997406 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.125:39661: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":162}
I20260807 10:39:18.998562 2521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:18.998193 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.125:39661 (local address 127.0.0.1:39494)
0807 10:39:18.998349 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0807 10:39:18.998432 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.125:39661: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260807 10:39:18.998761 2518 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.171.125:39661: Network error: Client connection negotiation failed: client connection to 127.20.171.125:39661: connect: Connection refused (error 111)
W20260807 10:39:19.003021 2525 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:39:19.003306 2525 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:39:19.003404 2525 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:39:19.010808 2525 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 10:39:19.010918 2525 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:39:19.010972 2525 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:39:19.011023 2525 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 10:39:19.011066 2525 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 10:39:19.020952 2525 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.171.84:44663
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786098956060137-21165-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786098956060137-21165-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.20.171.126:44615,127.20.171.125:39661,127.20.171.124:40649
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.125.keytab
--principal=kudu/127.20.171.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.171.125:39661
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786098956060137-21165-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.20.171.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786098956060137-21165-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:39:19.022497 2525 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:39:19.023766 2525 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:39:19.035578 2533 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:39:19.035533 2531 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:39:19.035617 2530 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:39:19.036644 2525 server_base.cc:1034] running on GCE node
I20260807 10:39:19.037437 2525 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:39:19.038786 2525 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:39:19.040009 2525 hybrid_clock.cc:648] HybridClock initialized: now 1786099159039963 us; error 54 us; skew 500 ppm
I20260807 10:39:19.040453 2525 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:39:19 dist-test-slave-0b58 krb5kdc[2436](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099159, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:39:19.055755 2525 init.cc:377] Logged in from keytab as kudu/127.20.171.125@KRBTEST.COM (short username kudu)
I20260807 10:39:19.057435 2525 webserver.cc:460] Webserver started at http://127.20.171.125:38311/ using document root <none> and password file <none>
I20260807 10:39:19.058161 2525 fs_manager.cc:359] Metadata directory not provided
I20260807 10:39:19.058317 2525 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:39:19.058633 2525 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:39:19.061774 2525 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786098956060137-21165-0/minicluster-data/master-1/data/instance:
uuid: "0f4ede8cc7d94db7a0cacb7501bb5f54"
format_stamp: "Formatted at 2026-08-07 10:39:19 on dist-test-slave-0b58"
server_key: "b0197265e4f3386693119122a461159e"
server_key_iv: "706a389600a28f8acb671c87e77457f6"
server_key_version: "encryptionkey@0"
I20260807 10:39:19.062603 2525 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786098956060137-21165-0/minicluster-data/master-1/wal/instance:
uuid: "0f4ede8cc7d94db7a0cacb7501bb5f54"
format_stamp: "Formatted at 2026-08-07 10:39:19 on dist-test-slave-0b58"
server_key: "b0197265e4f3386693119122a461159e"
server_key_iv: "706a389600a28f8acb671c87e77457f6"
server_key_version: "encryptionkey@0"
I20260807 10:39:19.067927 2525 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260807 10:39:19.071329 2540 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:39:19.072726 2525 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.003s
I20260807 10:39:19.072907 2525 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786098956060137-21165-0/minicluster-data/master-1/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786098956060137-21165-0/minicluster-data/master-1/wal
uuid: "0f4ede8cc7d94db7a0cacb7501bb5f54"
format_stamp: "Formatted at 2026-08-07 10:39:19 on dist-test-slave-0b58"
server_key: "b0197265e4f3386693119122a461159e"
server_key_iv: "706a389600a28f8acb671c87e77457f6"
server_key_version: "encryptionkey@0"
I20260807 10:39:19.073105 2525 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786098956060137-21165-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786098956060137-21165-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786098956060137-21165-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:39:19.086388 2525 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:39:19.090481 2525 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:39:19.090770 2525 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:39:19.110034 2525 rpc_server.cc:307] RPC server started. Bound to: 127.20.171.125:39661
I20260807 10:39:19.110065 2593 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.171.125:39661 every 8 connection(s)
I20260807 10:39:19.111450 2525 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786098956060137-21165-0/minicluster-data/master-1/data/info.pb
I20260807 10:39:19.115054 2594 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:39:19.120914 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 2525
I20260807 10:39:19.121111 21165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786098956060137-21165-0/minicluster-data/master-1/wal/instance
I20260807 10:39:19.121578 21165 external_mini_cluster.cc:1428] Setting key 9a33584fced9124cb93bbb088e4b3fb4
I20260807 10:39:19.121582 2594 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.171.126" port: 44615 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 10:39:19 dist-test-slave-0b58 krb5kdc[2436](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099159, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.125@KRBTEST.COM for kudu/127.20.171.126@KRBTEST.COM
I20260807 10:39:19.144774 2520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:19.124144 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35144 (local address 127.20.171.126:44615)
0807 10:39:19.124387 (+ 243us) server_negotiation.cc:206] Beginning negotiation
0807 10:39:19.124394 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:39:19.125520 (+ 1126us) server_negotiation.cc:407] Connection header received
0807 10:39:19.128620 (+ 3100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:39:19.128624 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:39:19.128693 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:39:19.128784 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:39:19.130793 (+ 2009us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:19.131440 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:19.133865 (+ 2425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:19.134474 (+ 609us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:19.134615 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:39:19.138605 (+ 3990us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:39:19.138610 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:39:19.138614 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:39:19.138648 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:39:19.141398 (+ 2750us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:39:19.142371 (+ 973us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:39:19.142375 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:39:19.142377 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:39:19.142496 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:39:19.142960 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:39:19.142963 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:39:19.142965 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:39:19.143227 (+ 262us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:39:19.143336 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0807 10:39:19.144349 (+ 1013us) server_negotiation.cc:299] Negotiation successful
0807 10:39:19.144533 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260807 10:39:19.146363 2596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:19.124528 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:44615 (local address 127.0.0.1:35144)
0807 10:39:19.125347 (+ 819us) negotiation.cc:107] Waiting for socket to connect
0807 10:39:19.125397 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0807 10:39:19.128314 (+ 2917us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:39:19.129042 (+ 728us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:39:19.129054 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:39:19.129840 (+ 786us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:39:19.130585 (+ 745us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:39:19.130610 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:39:19.131595 (+ 985us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:39:19.131603 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:39:19.133729 (+ 2126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:39:19.133747 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:39:19.134683 (+ 936us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:39:19.134689 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:39:19.134871 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:39:19.135553 (+ 682us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:39:19.135575 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:39:19.138380 (+ 2805us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:39:19.141537 (+ 3157us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:39:19.141548 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:39:19.141567 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:39:19.142256 (+ 689us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:39:19.142605 (+ 349us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:39:19.142613 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:39:19.142619 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:39:19.142853 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:39:19.143361 (+ 508us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:39:19.143371 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:39:19.143853 (+ 482us) client_negotiation.cc:769] Sending connection context
0807 10:39:19.144234 (+ 381us) client_negotiation.cc:240] Negotiation successful
0807 10:39:19.144796 (+ 562us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":526,"thread_start_us":304,"threads_started":1}
I20260807 10:39:19.148286 2594 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.171.125" port: 39661 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.20.171.124@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.171.124@KRBTEST.COM" created.
Aug 07 10:39:19 dist-test-slave-0b58 krb5kdc[2436](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099159, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.125@KRBTEST.COM for kudu/127.20.171.125@KRBTEST.COM
I20260807 10:39:19.163161 2596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:19.148988 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.125:39661 (local address 127.0.0.1:39496)
0807 10:39:19.149175 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0807 10:39:19.149194 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 10:39:19.149304 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:39:19.150467 (+ 1163us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:39:19.150475 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:39:19.151036 (+ 561us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:39:19.151275 (+ 239us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:39:19.151291 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:39:19.152734 (+ 1443us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:39:19.152738 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:39:19.153695 (+ 957us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:39:19.153707 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:39:19.154622 (+ 915us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:39:19.154628 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:39:19.154840 (+ 212us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:39:19.155476 (+ 636us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:39:19.155493 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:39:19.157528 (+ 2035us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:39:19.160704 (+ 3176us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:39:19.160721 (+ 17us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:39:19.160725 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:39:19.161072 (+ 347us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:39:19.161425 (+ 353us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:39:19.161431 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:39:19.161437 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:39:19.161574 (+ 137us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:39:19.162161 (+ 587us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:39:19.162165 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:39:19.162305 (+ 140us) client_negotiation.cc:769] Sending connection context
0807 10:39:19.162450 (+ 145us) client_negotiation.cc:240] Negotiation successful
0807 10:39:19.162718 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":47}
I20260807 10:39:19.163226 2598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:19.149246 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39496 (local address 127.20.171.125:39661)
0807 10:39:19.150035 (+ 789us) server_negotiation.cc:206] Beginning negotiation
0807 10:39:19.150041 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:39:19.150066 (+ 25us) server_negotiation.cc:407] Connection header received
0807 10:39:19.150112 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:39:19.150117 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:39:19.150287 (+ 170us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:39:19.150405 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:39:19.151443 (+ 1038us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:19.152596 (+ 1153us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:19.153831 (+ 1235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:19.154401 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:19.154508 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:39:19.157749 (+ 3241us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:39:19.157761 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:39:19.157776 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:39:19.157804 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:39:19.160577 (+ 2773us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:39:19.161204 (+ 627us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:39:19.161211 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:39:19.161213 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:39:19.161325 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:39:19.161671 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:39:19.161679 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:39:19.161683 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:39:19.162036 (+ 353us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:39:19.162245 (+ 209us) server_negotiation.cc:1035] Waiting for connection context
0807 10:39:19.162614 (+ 369us) server_negotiation.cc:299] Negotiation successful
0807 10:39:19.162827 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":629,"thread_start_us":486,"threads_started":1}
I20260807 10:39:19.165846 2594 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.171.124" port: 40649 } has no permanent_uuid. Determining permanent_uuid...
I20260807 10:39:19.167040 2596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:19.166577 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.124:40649 (local address 127.0.0.1:35166)
0807 10:39:19.166768 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0807 10:39:19.166885 (+ 117us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.124:40649: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260807 10:39:19.167366 2541 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.171.124:40649: connect: Connection refused (error 111)
I20260807 10:39:19.169027 2596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:19.168647 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.124:40649 (local address 127.0.0.1:35176)
0807 10:39:19.168795 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0807 10:39:19.168880 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.124:40649: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260807 10:39:19.169267 2594 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.171.124:40649: Network error: Client connection negotiation failed: client connection to 127.20.171.124:40649: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.171.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.124.keytab.
Entry for principal kudu/127.20.171.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.124.keytab.
I20260807 10:39:19.191972 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786098956060137-21165-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786098956060137-21165-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786098956060137-21165-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786098956060137-21165-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.171.124:40649
--webserver_interface=127.20.171.124
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.124.keytab
--principal=kudu/127.20.171.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.171.84:44663
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.171.126:44615,127.20.171.125:39661,127.20.171.124:40649
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786098956060137-21165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786098956060137-21165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786098956060137-21165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 10:39:19.218604 2594 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.171.124" port: 40649 } attempt: 1
I20260807 10:39:19.219997 2596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:19.219336 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.124:40649 (local address 127.0.0.1:35190)
0807 10:39:19.219611 (+ 275us) negotiation.cc:107] Waiting for socket to connect
0807 10:39:19.219777 (+ 166us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.124:40649: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":80}
I20260807 10:39:19.221217 2596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:19.220735 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.124:40649 (local address 127.0.0.1:35200)
0807 10:39:19.220955 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0807 10:39:19.221067 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.124:40649: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
W20260807 10:39:19.221545 2594 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.171.124:40649: Network error: Client connection negotiation failed: client connection to 127.20.171.124:40649: connect: Connection refused (error 111)
I20260807 10:39:19.289803 2594 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.171.124" port: 40649 } attempt: 2
I20260807 10:39:19.291127 2596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:19.290550 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.124:40649 (local address 127.0.0.1:35208)
0807 10:39:19.290800 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0807 10:39:19.290923 (+ 123us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.124:40649: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":85}
I20260807 10:39:19.292209 2596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:19.291809 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.124:40649 (local address 127.0.0.1:35220)
0807 10:39:19.291979 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0807 10:39:19.292062 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.124:40649: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
W20260807 10:39:19.292479 2594 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.171.124:40649: Network error: Client connection negotiation failed: client connection to 127.20.171.124:40649: connect: Connection refused (error 111)
I20260807 10:39:19.298054 2518 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.171.125" port: 39661 } attempt: 5
Aug 07 10:39:19 dist-test-slave-0b58 krb5kdc[2436](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099158, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.126@KRBTEST.COM for kudu/127.20.171.125@KRBTEST.COM
I20260807 10:39:19.312798 2521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:19.298807 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.125:39661 (local address 127.0.0.1:39510)
0807 10:39:19.299023 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0807 10:39:19.299057 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0807 10:39:19.299166 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:39:19.299565 (+ 399us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:39:19.299569 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:39:19.299933 (+ 364us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:39:19.300130 (+ 197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:39:19.300138 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:39:19.301513 (+ 1375us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:39:19.301517 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:39:19.302372 (+ 855us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:39:19.302390 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:39:19.303368 (+ 978us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:39:19.303372 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:39:19.303506 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:39:19.304156 (+ 650us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:39:19.304174 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:39:19.306272 (+ 2098us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:39:19.310193 (+ 3921us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:39:19.310197 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:39:19.310200 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:39:19.310580 (+ 380us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:39:19.311024 (+ 444us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:39:19.311027 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:39:19.311029 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:39:19.311265 (+ 236us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:39:19.311999 (+ 734us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:39:19.312003 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:39:19.312138 (+ 135us) client_negotiation.cc:769] Sending connection context
0807 10:39:19.312332 (+ 194us) client_negotiation.cc:240] Negotiation successful
0807 10:39:19.312565 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":73}
I20260807 10:39:19.313061 2598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:19.298945 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39510 (local address 127.20.171.125:39661)
0807 10:39:19.299144 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0807 10:39:19.299152 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 10:39:19.299177 (+ 25us) server_negotiation.cc:407] Connection header received
0807 10:39:19.299309 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:39:19.299315 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:39:19.299413 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:39:19.299526 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:39:19.300312 (+ 786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:19.301384 (+ 1072us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:19.302516 (+ 1132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:19.303225 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:19.303352 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:39:19.306464 (+ 3112us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:39:19.306470 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:39:19.306475 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:39:19.306514 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:39:19.310022 (+ 3508us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:39:19.310719 (+ 697us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:39:19.310727 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:39:19.310732 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:39:19.310901 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:39:19.311399 (+ 498us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:39:19.311407 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:39:19.311411 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:39:19.311870 (+ 459us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:39:19.312044 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0807 10:39:19.312481 (+ 437us) server_negotiation.cc:299] Negotiation successful
0807 10:39:19.312750 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260807 10:39:19.314199 2518 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.171.124" port: 40649 } has no permanent_uuid. Determining permanent_uuid...
I20260807 10:39:19.315217 2521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:19.314847 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.124:40649 (local address 127.0.0.1:35226)
0807 10:39:19.315012 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0807 10:39:19.315093 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.124:40649: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
I20260807 10:39:19.316130 2521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:19.315792 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.124:40649 (local address 127.0.0.1:35236)
0807 10:39:19.315963 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0807 10:39:19.316026 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.124:40649: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260807 10:39:19.316347 2518 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.171.124:40649: Network error: Client connection negotiation failed: client connection to 127.20.171.124:40649: connect: Connection refused (error 111)
I20260807 10:39:19.367597 2518 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.171.124" port: 40649 } attempt: 1
I20260807 10:39:19.368844 2521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:19.368365 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.124:40649 (local address 127.0.0.1:35244)
0807 10:39:19.368559 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0807 10:39:19.368657 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.124:40649: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
I20260807 10:39:19.369825 2521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:19.369474 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.124:40649 (local address 127.0.0.1:35258)
0807 10:39:19.369634 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0807 10:39:19.369708 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.124:40649: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260807 10:39:19.370038 2518 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.171.124:40649: Network error: Client connection negotiation failed: client connection to 127.20.171.124:40649: connect: Connection refused (error 111)
I20260807 10:39:19.383741 2594 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.171.124" port: 40649 } attempt: 3
I20260807 10:39:19.384929 2596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:19.384420 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.124:40649 (local address 127.0.0.1:35272)
0807 10:39:19.384616 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0807 10:39:19.384740 (+ 124us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.124:40649: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260807 10:39:19.386116 2596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:19.385539 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.124:40649 (local address 127.0.0.1:35288)
0807 10:39:19.385804 (+ 265us) negotiation.cc:107] Waiting for socket to connect
0807 10:39:19.385924 (+ 120us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.124:40649: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":148}
W20260807 10:39:19.386386 2594 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.171.124:40649: Network error: Client connection negotiation failed: client connection to 127.20.171.124:40649: connect: Connection refused (error 111)
I20260807 10:39:19.438254 2518 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.171.124" port: 40649 } attempt: 2
I20260807 10:39:19.439473 2521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:19.438962 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.124:40649 (local address 127.0.0.1:35292)
0807 10:39:19.439183 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0807 10:39:19.439295 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.124:40649: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
I20260807 10:39:19.440560 2521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:19.440173 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.124:40649 (local address 127.0.0.1:35302)
0807 10:39:19.440366 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0807 10:39:19.440449 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.124:40649: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260807 10:39:19.440798 2518 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.171.124:40649: Network error: Client connection negotiation failed: client connection to 127.20.171.124:40649: connect: Connection refused (error 111)
I20260807 10:39:19.529633 2594 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.171.124" port: 40649 } attempt: 4
I20260807 10:39:19.530951 2596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:19.530350 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.124:40649 (local address 127.0.0.1:35312)
0807 10:39:19.530620 (+ 270us) negotiation.cc:107] Waiting for socket to connect
0807 10:39:19.530754 (+ 134us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.124:40649: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":76}
I20260807 10:39:19.532151 2596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:19.531747 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.124:40649 (local address 127.0.0.1:35326)
0807 10:39:19.531909 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0807 10:39:19.532001 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.124:40649: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260807 10:39:19.532470 2594 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.171.124:40649: Network error: Client connection negotiation failed: client connection to 127.20.171.124:40649: connect: Connection refused (error 111)
W20260807 10:39:19.545418 2601 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:39:19.545699 2601 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:39:19.545876 2601 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260807 10:39:19.547024 2518 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.171.124" port: 40649 } attempt: 3
I20260807 10:39:19.548146 2521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:19.547629 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.124:40649 (local address 127.0.0.1:35330)
0807 10:39:19.547896 (+ 267us) negotiation.cc:107] Waiting for socket to connect
0807 10:39:19.547982 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.124:40649: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":74}
I20260807 10:39:19.549204 2521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:19.548819 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.124:40649 (local address 127.0.0.1:35334)
0807 10:39:19.549016 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0807 10:39:19.549090 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.124:40649: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":87}
W20260807 10:39:19.549404 2518 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.171.124:40649: Network error: Client connection negotiation failed: client connection to 127.20.171.124:40649: connect: Connection refused (error 111)
W20260807 10:39:19.553858 2601 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 10:39:19.553994 2601 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:39:19.554103 2601 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:39:19.554217 2601 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 10:39:19.554307 2601 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 10:39:19.564824 2601 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.171.84:44663
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786098956060137-21165-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786098956060137-21165-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.20.171.126:44615,127.20.171.125:39661,127.20.171.124:40649
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.124.keytab
--principal=kudu/127.20.171.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.171.124:40649
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786098956060137-21165-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.20.171.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786098956060137-21165-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:39:19.566293 2601 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:39:19.567631 2601 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:39:19.579855 2606 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:39:19.579856 2607 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:39:19.579856 2609 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:39:19.580806 2601 server_base.cc:1034] running on GCE node
I20260807 10:39:19.581596 2601 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:39:19.582898 2601 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:39:19.584200 2601 hybrid_clock.cc:648] HybridClock initialized: now 1786099159584104 us; error 48 us; skew 500 ppm
I20260807 10:39:19.584592 2601 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:39:19 dist-test-slave-0b58 krb5kdc[2436](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099159, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:39:19.587630 2601 init.cc:377] Logged in from keytab as kudu/127.20.171.124@KRBTEST.COM (short username kudu)
I20260807 10:39:19.589206 2601 webserver.cc:460] Webserver started at http://127.20.171.124:35677/ using document root <none> and password file <none>
I20260807 10:39:19.589882 2601 fs_manager.cc:359] Metadata directory not provided
I20260807 10:39:19.590026 2601 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:39:19.590394 2601 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:39:19.593528 2601 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786098956060137-21165-0/minicluster-data/master-2/data/instance:
uuid: "1e3a5236cee841dba92f56b84a8b3fe1"
format_stamp: "Formatted at 2026-08-07 10:39:19 on dist-test-slave-0b58"
server_key: "df9c2a15b12323040630a528d51bc442"
server_key_iv: "030fd6e55b040e56e70f8db958046296"
server_key_version: "encryptionkey@0"
I20260807 10:39:19.594359 2601 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786098956060137-21165-0/minicluster-data/master-2/wal/instance:
uuid: "1e3a5236cee841dba92f56b84a8b3fe1"
format_stamp: "Formatted at 2026-08-07 10:39:19 on dist-test-slave-0b58"
server_key: "df9c2a15b12323040630a528d51bc442"
server_key_iv: "030fd6e55b040e56e70f8db958046296"
server_key_version: "encryptionkey@0"
I20260807 10:39:19.599350 2601 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260807 10:39:19.602836 2616 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:39:19.604126 2601 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 10:39:19.604352 2601 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786098956060137-21165-0/minicluster-data/master-2/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786098956060137-21165-0/minicluster-data/master-2/wal
uuid: "1e3a5236cee841dba92f56b84a8b3fe1"
format_stamp: "Formatted at 2026-08-07 10:39:19 on dist-test-slave-0b58"
server_key: "df9c2a15b12323040630a528d51bc442"
server_key_iv: "030fd6e55b040e56e70f8db958046296"
server_key_version: "encryptionkey@0"
I20260807 10:39:19.604573 2601 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786098956060137-21165-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786098956060137-21165-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786098956060137-21165-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:39:19.627095 2601 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:39:19.631503 2601 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:39:19.631791 2601 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:39:19.650977 2601 rpc_server.cc:307] RPC server started. Bound to: 127.20.171.124:40649
I20260807 10:39:19.651016 2668 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.171.124:40649 every 8 connection(s)
I20260807 10:39:19.652468 2601 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786098956060137-21165-0/minicluster-data/master-2/data/info.pb
I20260807 10:39:19.656077 2669 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:39:19.661929 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 2601
I20260807 10:39:19.662259 21165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786098956060137-21165-0/minicluster-data/master-2/wal/instance
I20260807 10:39:19.662748 21165 external_mini_cluster.cc:1428] Setting key f5b6003f9b09092e2c1a8f02ff31ee68
I20260807 10:39:19.662631 2669 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.171.126" port: 44615 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 10:39:19 dist-test-slave-0b58 krb5kdc[2436](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099159, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.124@KRBTEST.COM for kudu/127.20.171.126@KRBTEST.COM
Aug 07 10:39:19 dist-test-slave-0b58 krb5kdc[2436](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099158, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.171.124@KRBTEST.COM
I20260807 10:39:19.684975 2673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:19.665461 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35156 (local address 127.20.171.126:44615)
0807 10:39:19.665971 (+ 510us) server_negotiation.cc:206] Beginning negotiation
0807 10:39:19.665979 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 10:39:19.666623 (+ 644us) server_negotiation.cc:407] Connection header received
0807 10:39:19.667838 (+ 1215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:39:19.667846 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:39:19.667927 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:39:19.668054 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:39:19.669803 (+ 1749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:19.671078 (+ 1275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:19.673168 (+ 2090us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:19.673756 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:19.673896 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:39:19.678081 (+ 4185us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:39:19.678088 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:39:19.678093 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:39:19.678163 (+ 70us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:39:19.681272 (+ 3109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:39:19.682221 (+ 949us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:39:19.682225 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:39:19.682227 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:39:19.682362 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:39:19.682875 (+ 513us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:39:19.682879 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:39:19.682882 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:39:19.683282 (+ 400us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:39:19.683451 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0807 10:39:19.684375 (+ 924us) server_negotiation.cc:299] Negotiation successful
0807 10:39:19.684566 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":365,"thread_start_us":253,"threads_started":1}
I20260807 10:39:19.686087 2674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:19.665521 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:44615 (local address 127.0.0.1:35156)
0807 10:39:19.666452 (+ 931us) negotiation.cc:107] Waiting for socket to connect
0807 10:39:19.666495 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0807 10:39:19.667593 (+ 1098us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:39:19.668132 (+ 539us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:39:19.668138 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:39:19.669039 (+ 901us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:39:19.669608 (+ 569us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:39:19.669635 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:39:19.671263 (+ 1628us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:39:19.671267 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:39:19.672998 (+ 1731us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:39:19.673014 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:39:19.673967 (+ 953us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:39:19.673972 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:39:19.674126 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:39:19.674929 (+ 803us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:39:19.674975 (+ 46us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:39:19.677863 (+ 2888us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:39:19.681404 (+ 3541us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:39:19.681414 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:39:19.681431 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:39:19.682074 (+ 643us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:39:19.682487 (+ 413us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:39:19.682492 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:39:19.682497 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:39:19.682740 (+ 243us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:39:19.683413 (+ 673us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:39:19.683419 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:39:19.683876 (+ 457us) client_negotiation.cc:769] Sending connection context
0807 10:39:19.684169 (+ 293us) client_negotiation.cc:240] Negotiation successful
0807 10:39:19.684732 (+ 563us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":666,"thread_start_us":493,"threads_started":1}
I20260807 10:39:19.686384 2672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:19.664731 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35338 (local address 127.20.171.124:40649)
0807 10:39:19.665537 (+ 806us) server_negotiation.cc:206] Beginning negotiation
0807 10:39:19.665547 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 10:39:19.665612 (+ 65us) server_negotiation.cc:407] Connection header received
0807 10:39:19.667583 (+ 1971us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:39:19.667603 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:39:19.667887 (+ 284us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:39:19.668096 (+ 209us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:39:19.669979 (+ 1883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:19.671559 (+ 1580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:19.673369 (+ 1810us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:19.674179 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:19.674277 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:39:19.679249 (+ 4972us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:39:19.679257 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:39:19.679269 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:39:19.679302 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:39:19.682753 (+ 3451us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:39:19.683560 (+ 807us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:39:19.683568 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:39:19.683571 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:39:19.683721 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:39:19.684155 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:39:19.684160 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:39:19.684163 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:39:19.684607 (+ 444us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:39:19.684919 (+ 312us) server_negotiation.cc:1035] Waiting for connection context
0807 10:39:19.685795 (+ 876us) server_negotiation.cc:299] Negotiation successful
0807 10:39:19.685972 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":599,"thread_start_us":387,"threads_started":1}
I20260807 10:39:19.687844 2669 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.171.125" port: 39661 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 10:39:19 dist-test-slave-0b58 krb5kdc[2436](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099159, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.124@KRBTEST.COM for kudu/127.20.171.125@KRBTEST.COM
Aug 07 10:39:19 dist-test-slave-0b58 krb5kdc[2436](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099158, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.171.126@KRBTEST.COM
I20260807 10:39:19.702379 2674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:19.688528 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.125:39661 (local address 127.0.0.1:39518)
0807 10:39:19.688703 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0807 10:39:19.688720 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 10:39:19.688810 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:39:19.689135 (+ 325us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:39:19.689139 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:39:19.689582 (+ 443us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:39:19.689829 (+ 247us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:39:19.689840 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:39:19.691273 (+ 1433us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:39:19.691277 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:39:19.692650 (+ 1373us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:39:19.692673 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:39:19.693656 (+ 983us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:39:19.693661 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:39:19.693835 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:39:19.694438 (+ 603us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:39:19.694455 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:39:19.696722 (+ 2267us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:39:19.699944 (+ 3222us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:39:19.699950 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:39:19.699954 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:39:19.700401 (+ 447us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:39:19.700782 (+ 381us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:39:19.700788 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:39:19.700792 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:39:19.700940 (+ 148us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:39:19.701427 (+ 487us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:39:19.701432 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:39:19.701593 (+ 161us) client_negotiation.cc:769] Sending connection context
0807 10:39:19.701725 (+ 132us) client_negotiation.cc:240] Negotiation successful
0807 10:39:19.701997 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":57}
I20260807 10:39:19.702423 2598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:19.688637 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39518 (local address 127.20.171.125:39661)
0807 10:39:19.688831 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0807 10:39:19.688837 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:39:19.688855 (+ 18us) server_negotiation.cc:407] Connection header received
0807 10:39:19.688918 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:39:19.688924 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:39:19.688998 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:39:19.689112 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:39:19.689984 (+ 872us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:19.691123 (+ 1139us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:19.692807 (+ 1684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:19.693466 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:19.693597 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:39:19.696918 (+ 3321us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:39:19.696927 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:39:19.696934 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:39:19.696979 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:39:19.699806 (+ 2827us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:39:19.700515 (+ 709us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:39:19.700522 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:39:19.700525 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:39:19.700664 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:39:19.701054 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:39:19.701059 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:39:19.701064 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:39:19.701311 (+ 247us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:39:19.701465 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0807 10:39:19.701837 (+ 372us) server_negotiation.cc:299] Negotiation successful
0807 10:39:19.702053 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260807 10:39:19.703513 2669 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.171.124" port: 40649 } has no permanent_uuid. Determining permanent_uuid...
I20260807 10:39:19.705312 2673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:19.689532 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35172 (local address 127.20.171.126:44615)
0807 10:39:19.689700 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0807 10:39:19.689705 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:39:19.689724 (+ 19us) server_negotiation.cc:407] Connection header received
0807 10:39:19.689854 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:39:19.689859 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:39:19.689952 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:39:19.690039 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:39:19.691564 (+ 1525us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:19.692662 (+ 1098us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:19.694257 (+ 1595us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:19.694742 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:19.694840 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:39:19.699500 (+ 4660us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:39:19.699505 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:39:19.699508 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:39:19.699538 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:39:19.702200 (+ 2662us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:39:19.703066 (+ 866us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:39:19.703074 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:39:19.703077 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:39:19.703206 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:39:19.703594 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:39:19.703600 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:39:19.703603 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:39:19.703957 (+ 354us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:39:19.704288 (+ 331us) server_negotiation.cc:1035] Waiting for connection context
0807 10:39:19.704724 (+ 436us) server_negotiation.cc:299] Negotiation successful
0807 10:39:19.704966 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
Aug 07 10:39:19 dist-test-slave-0b58 krb5kdc[2436](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099159, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.124@KRBTEST.COM for kudu/127.20.171.124@KRBTEST.COM
Aug 07 10:39:19 dist-test-slave-0b58 krb5kdc[2436](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099158, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.171.125@KRBTEST.COM
I20260807 10:39:19.717312 2672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:19.704423 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35352 (local address 127.20.171.124:40649)
0807 10:39:19.704601 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0807 10:39:19.704606 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:39:19.704623 (+ 17us) server_negotiation.cc:407] Connection header received
0807 10:39:19.704797 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:39:19.704804 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:39:19.704874 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:39:19.704969 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:39:19.705826 (+ 857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:19.706701 (+ 875us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:19.708304 (+ 1603us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:19.709008 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:19.709096 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:39:19.712111 (+ 3015us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:39:19.712116 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:39:19.712119 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:39:19.712148 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:39:19.714771 (+ 2623us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:39:19.715384 (+ 613us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:39:19.715391 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:39:19.715395 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:39:19.715503 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:39:19.715849 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:39:19.715855 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:39:19.715861 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:39:19.716146 (+ 285us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:39:19.716314 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0807 10:39:19.716672 (+ 358us) server_negotiation.cc:299] Negotiation successful
0807 10:39:19.716994 (+ 322us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":138,"server-negotiator.queue_time_us":77}
I20260807 10:39:19.717288 2674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:19.704371 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.124:40649 (local address 127.0.0.1:35352)
0807 10:39:19.704541 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0807 10:39:19.704561 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0807 10:39:19.704668 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:39:19.705016 (+ 348us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:39:19.705021 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:39:19.705500 (+ 479us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:39:19.705668 (+ 168us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:39:19.705680 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:39:19.707152 (+ 1472us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:39:19.707157 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:39:19.708138 (+ 981us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:39:19.708150 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:39:19.709126 (+ 976us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:39:19.709131 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:39:19.709354 (+ 223us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:39:19.709887 (+ 533us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:39:19.709908 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:39:19.711930 (+ 2022us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:39:19.714897 (+ 2967us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:39:19.714904 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:39:19.714907 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:39:19.715269 (+ 362us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:39:19.715608 (+ 339us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:39:19.715614 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:39:19.715618 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:39:19.715748 (+ 130us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:39:19.716281 (+ 533us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:39:19.716286 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:39:19.716438 (+ 152us) client_negotiation.cc:769] Sending connection context
0807 10:39:19.716576 (+ 138us) client_negotiation.cc:240] Negotiation successful
0807 10:39:19.716875 (+ 299us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":57}
I20260807 10:39:19.722189 2598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:19.707038 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39522 (local address 127.20.171.125:39661)
0807 10:39:19.707234 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0807 10:39:19.707239 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:39:19.707254 (+ 15us) server_negotiation.cc:407] Connection header received
0807 10:39:19.707301 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:39:19.707304 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:39:19.707352 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:39:19.707448 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:39:19.708957 (+ 1509us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:19.710033 (+ 1076us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:19.711367 (+ 1334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:19.711866 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:19.711992 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:39:19.716323 (+ 4331us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:39:19.716328 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:39:19.716332 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:39:19.716360 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:39:19.719572 (+ 3212us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:39:19.720218 (+ 646us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:39:19.720223 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:39:19.720226 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:39:19.720416 (+ 190us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:39:19.720798 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:39:19.720802 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:39:19.720805 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:39:19.721140 (+ 335us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:39:19.721440 (+ 300us) server_negotiation.cc:1035] Waiting for connection context
0807 10:39:19.721609 (+ 169us) server_negotiation.cc:299] Negotiation successful
0807 10:39:19.721837 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260807 10:39:19.723523 2669 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1e3a5236cee841dba92f56b84a8b3fe1: Bootstrap starting.
I20260807 10:39:19.726616 2518 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.171.124" port: 40649 } attempt: 4
I20260807 10:39:19.727488 2669 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1e3a5236cee841dba92f56b84a8b3fe1: Neither blocks nor log segments found. Creating new log.
I20260807 10:39:19.727684 21165 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 10:39:19.728730 2669 log.cc:824] T 00000000000000000000000000000000 P 1e3a5236cee841dba92f56b84a8b3fe1: Log is configured to *not* fsync() on all Append() calls
Aug 07 10:39:19 dist-test-slave-0b58 krb5kdc[2436](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099158, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.126@KRBTEST.COM for kudu/127.20.171.124@KRBTEST.COM
I20260807 10:39:19.738538 2669 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1e3a5236cee841dba92f56b84a8b3fe1: No bootstrap required, opened a new log
I20260807 10:39:19.746992 2521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:19.727172 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.124:40649 (local address 127.0.0.1:35362)
0807 10:39:19.727423 (+ 251us) negotiation.cc:107] Waiting for socket to connect
0807 10:39:19.727441 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 10:39:19.727536 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:39:19.728787 (+ 1251us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:39:19.728793 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:39:19.729323 (+ 530us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:39:19.729615 (+ 292us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:39:19.729633 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:39:19.731235 (+ 1602us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:39:19.731242 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:39:19.732820 (+ 1578us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:39:19.732838 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:39:19.734026 (+ 1188us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:39:19.734043 (+ 17us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:39:19.734323 (+ 280us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:39:19.735193 (+ 870us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:39:19.735225 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:39:19.738286 (+ 3061us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:39:19.743393 (+ 5107us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:39:19.743401 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:39:19.743408 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:39:19.744038 (+ 630us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:39:19.744611 (+ 573us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:39:19.744618 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:39:19.744624 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:39:19.744829 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:39:19.745643 (+ 814us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:39:19.745647 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:39:19.745877 (+ 230us) client_negotiation.cc:769] Sending connection context
0807 10:39:19.746068 (+ 191us) client_negotiation.cc:240] Negotiation successful
0807 10:39:19.746451 (+ 383us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120}
I20260807 10:39:19.748818 2672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:19.727355 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35362 (local address 127.20.171.124:40649)
0807 10:39:19.728466 (+ 1111us) server_negotiation.cc:206] Beginning negotiation
0807 10:39:19.728471 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:39:19.728493 (+ 22us) server_negotiation.cc:407] Connection header received
0807 10:39:19.728541 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:39:19.728546 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:39:19.728611 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:39:19.728717 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:39:19.729808 (+ 1091us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:19.731003 (+ 1195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:19.733030 (+ 2027us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:19.733843 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:19.737227 (+ 3384us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:39:19.738473 (+ 1246us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:39:19.738482 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:39:19.738489 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:39:19.738537 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:39:19.743194 (+ 4657us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:39:19.744226 (+ 1032us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:39:19.744234 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:39:19.744240 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:39:19.744464 (+ 224us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:39:19.744992 (+ 528us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:39:19.745000 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:39:19.745005 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:39:19.745490 (+ 485us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:39:19.747774 (+ 2284us) server_negotiation.cc:1035] Waiting for connection context
0807 10:39:19.747933 (+ 159us) server_negotiation.cc:299] Negotiation successful
0807 10:39:19.748247 (+ 314us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":965}
I20260807 10:39:19.754832 2669 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1e3a5236cee841dba92f56b84a8b3fe1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c39e2a2b15174fcabf0174ebd4f07680" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 44615 } } peers { permanent_uuid: "0f4ede8cc7d94db7a0cacb7501bb5f54" member_type: VOTER last_known_addr { host: "127.20.171.125" port: 39661 } } peers { permanent_uuid: "1e3a5236cee841dba92f56b84a8b3fe1" member_type: VOTER last_known_addr { host: "127.20.171.124" port: 40649 } }
I20260807 10:39:19.755190 2518 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c39e2a2b15174fcabf0174ebd4f07680: Bootstrap starting.
I20260807 10:39:19.755335 2669 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1e3a5236cee841dba92f56b84a8b3fe1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:39:19.755467 2669 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1e3a5236cee841dba92f56b84a8b3fe1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e3a5236cee841dba92f56b84a8b3fe1, State: Initialized, Role: FOLLOWER
I20260807 10:39:19.756191 2669 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1e3a5236cee841dba92f56b84a8b3fe1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c39e2a2b15174fcabf0174ebd4f07680" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 44615 } } peers { permanent_uuid: "0f4ede8cc7d94db7a0cacb7501bb5f54" member_type: VOTER last_known_addr { host: "127.20.171.125" port: 39661 } } peers { permanent_uuid: "1e3a5236cee841dba92f56b84a8b3fe1" member_type: VOTER last_known_addr { host: "127.20.171.124" port: 40649 } }
I20260807 10:39:19.759811 2518 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c39e2a2b15174fcabf0174ebd4f07680: Neither blocks nor log segments found. Creating new log.
I20260807 10:39:19.761492 2518 log.cc:824] T 00000000000000000000000000000000 P c39e2a2b15174fcabf0174ebd4f07680: Log is configured to *not* fsync() on all Append() calls
I20260807 10:39:19.763161 2684 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1e3a5236cee841dba92f56b84a8b3fe1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c39e2a2b15174fcabf0174ebd4f07680" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 44615 } } peers { permanent_uuid: "0f4ede8cc7d94db7a0cacb7501bb5f54" member_type: VOTER last_known_addr { host: "127.20.171.125" port: 39661 } } peers { permanent_uuid: "1e3a5236cee841dba92f56b84a8b3fe1" member_type: VOTER last_known_addr { host: "127.20.171.124" port: 40649 } } }
I20260807 10:39:19.763594 2684 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1e3a5236cee841dba92f56b84a8b3fe1 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 10:39:19.765460 2669 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1e3a5236cee841dba92f56b84a8b3fe1 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 10:39:19.772305 2518 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c39e2a2b15174fcabf0174ebd4f07680: No bootstrap required, opened a new log
I20260807 10:39:19.782596 2598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:19.751305 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39538 (local address 127.20.171.125:39661)
0807 10:39:19.751481 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0807 10:39:19.751487 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:39:19.761441 (+ 9954us) server_negotiation.cc:407] Connection header received
0807 10:39:19.761619 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:39:19.761628 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:39:19.761746 (+ 118us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:39:19.761865 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:39:19.768519 (+ 6654us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:19.769674 (+ 1155us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:19.771461 (+ 1787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:19.772060 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:19.772169 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:39:19.775521 (+ 3352us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:39:19.775528 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:39:19.775533 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:39:19.775579 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:39:19.779177 (+ 3598us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:39:19.780053 (+ 876us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:39:19.780061 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:39:19.780065 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:39:19.780232 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:39:19.780738 (+ 506us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:39:19.780743 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:39:19.780748 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:39:19.781116 (+ 368us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:39:19.781347 (+ 231us) server_negotiation.cc:1035] Waiting for connection context
0807 10:39:19.781940 (+ 593us) server_negotiation.cc:299] Negotiation successful
0807 10:39:19.782195 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260807 10:39:19.784158 2682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:19.733939 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35366 (local address 127.20.171.124:40649)
0807 10:39:19.750910 (+ 16971us) server_negotiation.cc:206] Beginning negotiation
0807 10:39:19.750918 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 10:39:19.750941 (+ 23us) server_negotiation.cc:407] Connection header received
0807 10:39:19.750989 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:39:19.750993 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:39:19.751061 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:39:19.751178 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:39:19.753772 (+ 2594us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:19.755034 (+ 1262us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:19.757078 (+ 2044us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:19.757794 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:19.757911 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:39:19.765736 (+ 7825us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:39:19.765746 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:39:19.765754 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:39:19.765806 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:39:19.775809 (+ 10003us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:39:19.778105 (+ 2296us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:39:19.778113 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:39:19.778119 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:39:19.778309 (+ 190us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:39:19.778853 (+ 544us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:39:19.778861 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:39:19.778867 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:39:19.779390 (+ 523us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:39:19.779709 (+ 319us) server_negotiation.cc:1035] Waiting for connection context
0807 10:39:19.783506 (+ 3797us) server_negotiation.cc:299] Negotiation successful
0807 10:39:19.783736 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16820,"thread_start_us":17442,"threads_started":1}
I20260807 10:39:19.785224 2673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:19.733977 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35186 (local address 127.20.171.126:44615)
0807 10:39:19.737127 (+ 3150us) server_negotiation.cc:206] Beginning negotiation
0807 10:39:19.737135 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 10:39:19.745989 (+ 8854us) server_negotiation.cc:407] Connection header received
0807 10:39:19.747110 (+ 1121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:39:19.747115 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:39:19.747190 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:39:19.747255 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:39:19.755246 (+ 7991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:19.756355 (+ 1109us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:19.759817 (+ 3462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:19.760832 (+ 1015us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:19.760957 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:39:19.767405 (+ 6448us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:39:19.767414 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:39:19.767421 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:39:19.767475 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:39:19.772104 (+ 4629us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:39:19.781092 (+ 8988us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:39:19.781106 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:39:19.781113 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:39:19.781333 (+ 220us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:39:19.781947 (+ 614us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:39:19.781955 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:39:19.781961 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:39:19.782457 (+ 496us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:39:19.782899 (+ 442us) server_negotiation.cc:1035] Waiting for connection context
0807 10:39:19.784471 (+ 1572us) server_negotiation.cc:299] Negotiation successful
0807 10:39:19.784796 (+ 325us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2977}
I20260807 10:39:19.786580 2518 raft_consensus.cc:348] T 00000000000000000000000000000000 P c39e2a2b15174fcabf0174ebd4f07680 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c39e2a2b15174fcabf0174ebd4f07680" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 44615 } } peers { permanent_uuid: "0f4ede8cc7d94db7a0cacb7501bb5f54" member_type: VOTER last_known_addr { host: "127.20.171.125" port: 39661 } } peers { permanent_uuid: "1e3a5236cee841dba92f56b84a8b3fe1" member_type: VOTER last_known_addr { host: "127.20.171.124" port: 40649 } }
I20260807 10:39:19.787001 2518 raft_consensus.cc:374] T 00000000000000000000000000000000 P c39e2a2b15174fcabf0174ebd4f07680 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:39:19.787143 2518 raft_consensus.cc:729] T 00000000000000000000000000000000 P c39e2a2b15174fcabf0174ebd4f07680 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c39e2a2b15174fcabf0174ebd4f07680, State: Initialized, Role: FOLLOWER
I20260807 10:39:19.787765 2518 consensus_queue.cc:260] T 00000000000000000000000000000000 P c39e2a2b15174fcabf0174ebd4f07680 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c39e2a2b15174fcabf0174ebd4f07680" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 44615 } } peers { permanent_uuid: "0f4ede8cc7d94db7a0cacb7501bb5f54" member_type: VOTER last_known_addr { host: "127.20.171.125" port: 39661 } } peers { permanent_uuid: "1e3a5236cee841dba92f56b84a8b3fe1" member_type: VOTER last_known_addr { host: "127.20.171.124" port: 40649 } }
I20260807 10:39:19.788890 2689 sys_catalog.cc:455] T 00000000000000000000000000000000 P c39e2a2b15174fcabf0174ebd4f07680 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c39e2a2b15174fcabf0174ebd4f07680" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 44615 } } peers { permanent_uuid: "0f4ede8cc7d94db7a0cacb7501bb5f54" member_type: VOTER last_known_addr { host: "127.20.171.125" port: 39661 } } peers { permanent_uuid: "1e3a5236cee841dba92f56b84a8b3fe1" member_type: VOTER last_known_addr { host: "127.20.171.124" port: 40649 } } }
I20260807 10:39:19.789422 2689 sys_catalog.cc:458] T 00000000000000000000000000000000 P c39e2a2b15174fcabf0174ebd4f07680 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 10:39:19.789846 2518 sys_catalog.cc:564] T 00000000000000000000000000000000 P c39e2a2b15174fcabf0174ebd4f07680 [sys.catalog]: configured and running, proceeding with master startup.
W20260807 10:39:19.805423 2702 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 1e3a5236cee841dba92f56b84a8b3fe1: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 10:39:19.805605 2702 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260807 10:39:19.818558 2708 catalog_manager.cc:1558] T 00000000000000000000000000000000 P c39e2a2b15174fcabf0174ebd4f07680: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 10:39:19.818706 2708 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 10:39:19.805676 2601 master_runner.cc:186] Error getting master registration for 127.20.171.126:44615: OK, instance_id { permanent_uuid: "c39e2a2b15174fcabf0174ebd4f07680" instance_seqno: 1786099158583926 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260807 10:39:19.819361 2601 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260807 10:39:19.822757 2471 tablet.cc:2369] T 00000000000000000000000000000000 P c39e2a2b15174fcabf0174ebd4f07680: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 10:39:19.812901 2450 master_runner.cc:186] Error getting master registration for 127.20.171.125:39661: OK, instance_id { permanent_uuid: "0f4ede8cc7d94db7a0cacb7501bb5f54" instance_seqno: 1786099159104658 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260807 10:39:19.824942 2450 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260807 10:39:19.831744 2594 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.171.124" port: 40649 } attempt: 5
Aug 07 10:39:19 dist-test-slave-0b58 krb5kdc[2436](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099159, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.125@KRBTEST.COM for kudu/127.20.171.124@KRBTEST.COM
I20260807 10:39:19.852437 2596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:19.832371 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.124:40649 (local address 127.0.0.1:35372)
0807 10:39:19.832629 (+ 258us) negotiation.cc:107] Waiting for socket to connect
0807 10:39:19.832651 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0807 10:39:19.832761 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:39:19.833349 (+ 588us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:39:19.833354 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:39:19.833924 (+ 570us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:39:19.834167 (+ 243us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:39:19.834180 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:39:19.836867 (+ 2687us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:39:19.836873 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:39:19.838317 (+ 1444us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:39:19.838333 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:39:19.839349 (+ 1016us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:39:19.839356 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:39:19.839577 (+ 221us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:39:19.840296 (+ 719us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:39:19.840323 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:39:19.843097 (+ 2774us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:39:19.849195 (+ 6098us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:39:19.849202 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:39:19.849207 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:39:19.849741 (+ 534us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:39:19.850206 (+ 465us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:39:19.850211 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:39:19.850215 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:39:19.850383 (+ 168us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:39:19.851364 (+ 981us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:39:19.851370 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:39:19.851536 (+ 166us) client_negotiation.cc:769] Sending connection context
0807 10:39:19.851712 (+ 176us) client_negotiation.cc:240] Negotiation successful
0807 10:39:19.852009 (+ 297us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132}
I20260807 10:39:19.852497 2682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:19.832444 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35372 (local address 127.20.171.124:40649)
0807 10:39:19.832988 (+ 544us) server_negotiation.cc:206] Beginning negotiation
0807 10:39:19.832995 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:39:19.833014 (+ 19us) server_negotiation.cc:407] Connection header received
0807 10:39:19.833090 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:39:19.833095 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:39:19.833189 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:39:19.833291 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:39:19.835548 (+ 2257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:19.836706 (+ 1158us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:19.838485 (+ 1779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:19.839185 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:19.839324 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:39:19.843288 (+ 3964us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:39:19.843295 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:39:19.843299 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:39:19.843336 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:39:19.849047 (+ 5711us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:39:19.849890 (+ 843us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:39:19.849895 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:39:19.849899 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:39:19.850070 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:39:19.850858 (+ 788us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:39:19.850863 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:39:19.850867 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:39:19.851225 (+ 358us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:39:19.851378 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0807 10:39:19.851851 (+ 473us) server_negotiation.cc:299] Negotiation successful
0807 10:39:19.852097 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":414}
I20260807 10:39:19.859977 2594 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0f4ede8cc7d94db7a0cacb7501bb5f54: Bootstrap starting.
I20260807 10:39:19.864058 2594 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0f4ede8cc7d94db7a0cacb7501bb5f54: Neither blocks nor log segments found. Creating new log.
I20260807 10:39:19.865440 2594 log.cc:824] T 00000000000000000000000000000000 P 0f4ede8cc7d94db7a0cacb7501bb5f54: Log is configured to *not* fsync() on all Append() calls
I20260807 10:39:19.868831 2594 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0f4ede8cc7d94db7a0cacb7501bb5f54: No bootstrap required, opened a new log
I20260807 10:39:19.879776 2594 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0f4ede8cc7d94db7a0cacb7501bb5f54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c39e2a2b15174fcabf0174ebd4f07680" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 44615 } } peers { permanent_uuid: "0f4ede8cc7d94db7a0cacb7501bb5f54" member_type: VOTER last_known_addr { host: "127.20.171.125" port: 39661 } } peers { permanent_uuid: "1e3a5236cee841dba92f56b84a8b3fe1" member_type: VOTER last_known_addr { host: "127.20.171.124" port: 40649 } }
I20260807 10:39:19.880187 2594 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0f4ede8cc7d94db7a0cacb7501bb5f54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:39:19.880326 2594 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0f4ede8cc7d94db7a0cacb7501bb5f54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f4ede8cc7d94db7a0cacb7501bb5f54, State: Initialized, Role: FOLLOWER
I20260807 10:39:19.880944 2594 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0f4ede8cc7d94db7a0cacb7501bb5f54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c39e2a2b15174fcabf0174ebd4f07680" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 44615 } } peers { permanent_uuid: "0f4ede8cc7d94db7a0cacb7501bb5f54" member_type: VOTER last_known_addr { host: "127.20.171.125" port: 39661 } } peers { permanent_uuid: "1e3a5236cee841dba92f56b84a8b3fe1" member_type: VOTER last_known_addr { host: "127.20.171.124" port: 40649 } }
I20260807 10:39:19.881945 2712 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0f4ede8cc7d94db7a0cacb7501bb5f54 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c39e2a2b15174fcabf0174ebd4f07680" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 44615 } } peers { permanent_uuid: "0f4ede8cc7d94db7a0cacb7501bb5f54" member_type: VOTER last_known_addr { host: "127.20.171.125" port: 39661 } } peers { permanent_uuid: "1e3a5236cee841dba92f56b84a8b3fe1" member_type: VOTER last_known_addr { host: "127.20.171.124" port: 40649 } } }
I20260807 10:39:19.882390 2712 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0f4ede8cc7d94db7a0cacb7501bb5f54 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 10:39:19.883199 2594 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0f4ede8cc7d94db7a0cacb7501bb5f54 [sys.catalog]: configured and running, proceeding with master startup.
W20260807 10:39:19.883881 2622 tablet.cc:2369] T 00000000000000000000000000000000 P 1e3a5236cee841dba92f56b84a8b3fe1: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 10:39:19.901779 2525 master_runner.cc:263] No leader master found from master 0f4ede8cc7d94db7a0cacb7501bb5f54
I20260807 10:39:19.901916 2525 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260807 10:39:19.902469 2684 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1e3a5236cee841dba92f56b84a8b3fe1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 10:39:19.902755 2684 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1e3a5236cee841dba92f56b84a8b3fe1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c39e2a2b15174fcabf0174ebd4f07680" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 44615 } } peers { permanent_uuid: "0f4ede8cc7d94db7a0cacb7501bb5f54" member_type: VOTER last_known_addr { host: "127.20.171.125" port: 39661 } } peers { permanent_uuid: "1e3a5236cee841dba92f56b84a8b3fe1" member_type: VOTER last_known_addr { host: "127.20.171.124" port: 40649 } }
I20260807 10:39:19.904220 2684 leader_election.cc:288] T 00000000000000000000000000000000 P 1e3a5236cee841dba92f56b84a8b3fe1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c39e2a2b15174fcabf0174ebd4f07680 (127.20.171.126:44615), 0f4ede8cc7d94db7a0cacb7501bb5f54 (127.20.171.125:39661)
W20260807 10:39:19.905059 2723 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 0f4ede8cc7d94db7a0cacb7501bb5f54: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 10:39:19.905269 2723 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 10:39:19.905501 2492 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1e3a5236cee841dba92f56b84a8b3fe1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c39e2a2b15174fcabf0174ebd4f07680" is_pre_election: true
I20260807 10:39:19.906006 2492 raft_consensus.cc:2454] T 00000000000000000000000000000000 P c39e2a2b15174fcabf0174ebd4f07680 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e3a5236cee841dba92f56b84a8b3fe1 in term 0.
I20260807 10:39:19.906687 2568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1e3a5236cee841dba92f56b84a8b3fe1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f4ede8cc7d94db7a0cacb7501bb5f54" is_pre_election: true
I20260807 10:39:19.907207 2568 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 0f4ede8cc7d94db7a0cacb7501bb5f54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e3a5236cee841dba92f56b84a8b3fe1 in term 0.
I20260807 10:39:19.907933 2619 leader_election.cc:302] T 00000000000000000000000000000000 P 1e3a5236cee841dba92f56b84a8b3fe1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f4ede8cc7d94db7a0cacb7501bb5f54, 1e3a5236cee841dba92f56b84a8b3fe1; no voters:
I20260807 10:39:19.908718 2684 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1e3a5236cee841dba92f56b84a8b3fe1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 10:39:19.908880 2684 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1e3a5236cee841dba92f56b84a8b3fe1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 10:39:19.908998 2684 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1e3a5236cee841dba92f56b84a8b3fe1 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:39:19.911703 2684 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1e3a5236cee841dba92f56b84a8b3fe1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c39e2a2b15174fcabf0174ebd4f07680" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 44615 } } peers { permanent_uuid: "0f4ede8cc7d94db7a0cacb7501bb5f54" member_type: VOTER last_known_addr { host: "127.20.171.125" port: 39661 } } peers { permanent_uuid: "1e3a5236cee841dba92f56b84a8b3fe1" member_type: VOTER last_known_addr { host: "127.20.171.124" port: 40649 } }
I20260807 10:39:19.912997 2492 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1e3a5236cee841dba92f56b84a8b3fe1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c39e2a2b15174fcabf0174ebd4f07680"
I20260807 10:39:19.913220 2492 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c39e2a2b15174fcabf0174ebd4f07680 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:39:19.916586 2492 raft_consensus.cc:2454] T 00000000000000000000000000000000 P c39e2a2b15174fcabf0174ebd4f07680 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e3a5236cee841dba92f56b84a8b3fe1 in term 1.
I20260807 10:39:19.917037 2568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1e3a5236cee841dba92f56b84a8b3fe1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f4ede8cc7d94db7a0cacb7501bb5f54"
I20260807 10:39:19.917264 2568 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0f4ede8cc7d94db7a0cacb7501bb5f54 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:39:19.920572 2568 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 0f4ede8cc7d94db7a0cacb7501bb5f54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e3a5236cee841dba92f56b84a8b3fe1 in term 1.
I20260807 10:39:19.920979 2619 leader_election.cc:302] T 00000000000000000000000000000000 P 1e3a5236cee841dba92f56b84a8b3fe1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f4ede8cc7d94db7a0cacb7501bb5f54, 1e3a5236cee841dba92f56b84a8b3fe1; no voters:
I20260807 10:39:19.922335 2684 leader_election.cc:288] T 00000000000000000000000000000000 P 1e3a5236cee841dba92f56b84a8b3fe1 [CANDIDATE]: Term 1 election: Requested vote from peers c39e2a2b15174fcabf0174ebd4f07680 (127.20.171.126:44615), 0f4ede8cc7d94db7a0cacb7501bb5f54 (127.20.171.125:39661)
I20260807 10:39:19.922546 2684 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1e3a5236cee841dba92f56b84a8b3fe1 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:39:19.922704 2684 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1e3a5236cee841dba92f56b84a8b3fe1 [term 1 LEADER]: Becoming Leader. State: Replica: 1e3a5236cee841dba92f56b84a8b3fe1, State: Running, Role: LEADER
I20260807 10:39:19.923246 2684 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1e3a5236cee841dba92f56b84a8b3fe1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c39e2a2b15174fcabf0174ebd4f07680" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 44615 } } peers { permanent_uuid: "0f4ede8cc7d94db7a0cacb7501bb5f54" member_type: VOTER last_known_addr { host: "127.20.171.125" port: 39661 } } peers { permanent_uuid: "1e3a5236cee841dba92f56b84a8b3fe1" member_type: VOTER last_known_addr { host: "127.20.171.124" port: 40649 } }
I20260807 10:39:19.941644 2726 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1e3a5236cee841dba92f56b84a8b3fe1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1e3a5236cee841dba92f56b84a8b3fe1. Latest consensus state: current_term: 1 leader_uuid: "1e3a5236cee841dba92f56b84a8b3fe1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c39e2a2b15174fcabf0174ebd4f07680" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 44615 } } peers { permanent_uuid: "0f4ede8cc7d94db7a0cacb7501bb5f54" member_type: VOTER last_known_addr { host: "127.20.171.125" port: 39661 } } peers { permanent_uuid: "1e3a5236cee841dba92f56b84a8b3fe1" member_type: VOTER last_known_addr { host: "127.20.171.124" port: 40649 } } }
I20260807 10:39:19.942036 2726 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1e3a5236cee841dba92f56b84a8b3fe1 [sys.catalog]: This master's current role is: LEADER
I20260807 10:39:19.943487 2728 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 10:39:19.945705 2728 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 10:39:19.965087 2568 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 0f4ede8cc7d94db7a0cacb7501bb5f54 [term 1 FOLLOWER]: Refusing update from remote peer 1e3a5236cee841dba92f56b84a8b3fe1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 10:39:19.966217 2492 raft_consensus.cc:1261] T 00000000000000000000000000000000 P c39e2a2b15174fcabf0174ebd4f07680 [term 1 FOLLOWER]: Refusing update from remote peer 1e3a5236cee841dba92f56b84a8b3fe1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 10:39:19.967263 2684 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 1e3a5236cee841dba92f56b84a8b3fe1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f4ede8cc7d94db7a0cacb7501bb5f54" member_type: VOTER last_known_addr { host: "127.20.171.125" port: 39661 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 10:39:19.968575 2684 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 1e3a5236cee841dba92f56b84a8b3fe1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c39e2a2b15174fcabf0174ebd4f07680" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 44615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 10:39:19.999022 2689 sys_catalog.cc:455] T 00000000000000000000000000000000 P c39e2a2b15174fcabf0174ebd4f07680 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1e3a5236cee841dba92f56b84a8b3fe1. Latest consensus state: current_term: 1 leader_uuid: "1e3a5236cee841dba92f56b84a8b3fe1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c39e2a2b15174fcabf0174ebd4f07680" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 44615 } } peers { permanent_uuid: "0f4ede8cc7d94db7a0cacb7501bb5f54" member_type: VOTER last_known_addr { host: "127.20.171.125" port: 39661 } } peers { permanent_uuid: "1e3a5236cee841dba92f56b84a8b3fe1" member_type: VOTER last_known_addr { host: "127.20.171.124" port: 40649 } } }
I20260807 10:39:19.999372 2689 sys_catalog.cc:458] T 00000000000000000000000000000000 P c39e2a2b15174fcabf0174ebd4f07680 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 10:39:20.001755 2729 mvcc.cc:205] Tried to move back new op lower bound from 7315862159207292928 to 7315862159058653184. Current Snapshot: MvccSnapshot[applied={T|T < 7315862159207292928}]
I20260807 10:39:20.010499 2712 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0f4ede8cc7d94db7a0cacb7501bb5f54 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1e3a5236cee841dba92f56b84a8b3fe1. Latest consensus state: current_term: 1 leader_uuid: "1e3a5236cee841dba92f56b84a8b3fe1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c39e2a2b15174fcabf0174ebd4f07680" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 44615 } } peers { permanent_uuid: "0f4ede8cc7d94db7a0cacb7501bb5f54" member_type: VOTER last_known_addr { host: "127.20.171.125" port: 39661 } } peers { permanent_uuid: "1e3a5236cee841dba92f56b84a8b3fe1" member_type: VOTER last_known_addr { host: "127.20.171.124" port: 40649 } } }
I20260807 10:39:20.010763 2712 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0f4ede8cc7d94db7a0cacb7501bb5f54 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 10:39:20.013113 2689 sys_catalog.cc:455] T 00000000000000000000000000000000 P c39e2a2b15174fcabf0174ebd4f07680 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "1e3a5236cee841dba92f56b84a8b3fe1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c39e2a2b15174fcabf0174ebd4f07680" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 44615 } } peers { permanent_uuid: "0f4ede8cc7d94db7a0cacb7501bb5f54" member_type: VOTER last_known_addr { host: "127.20.171.125" port: 39661 } } peers { permanent_uuid: "1e3a5236cee841dba92f56b84a8b3fe1" member_type: VOTER last_known_addr { host: "127.20.171.124" port: 40649 } } }
I20260807 10:39:20.013368 2689 sys_catalog.cc:458] T 00000000000000000000000000000000 P c39e2a2b15174fcabf0174ebd4f07680 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 10:39:20.013949 2731 mvcc.cc:205] Tried to move back new op lower bound from 7315862159207292928 to 7315862159058653184. Current Snapshot: MvccSnapshot[applied={T|T < 7315862159207292928}]
I20260807 10:39:20.018662 2712 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0f4ede8cc7d94db7a0cacb7501bb5f54 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "1e3a5236cee841dba92f56b84a8b3fe1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c39e2a2b15174fcabf0174ebd4f07680" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 44615 } } peers { permanent_uuid: "0f4ede8cc7d94db7a0cacb7501bb5f54" member_type: VOTER last_known_addr { host: "127.20.171.125" port: 39661 } } peers { permanent_uuid: "1e3a5236cee841dba92f56b84a8b3fe1" member_type: VOTER last_known_addr { host: "127.20.171.124" port: 40649 } } }
I20260807 10:39:20.018904 2712 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0f4ede8cc7d94db7a0cacb7501bb5f54 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 10:39:20.020967 2684 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1e3a5236cee841dba92f56b84a8b3fe1 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "1e3a5236cee841dba92f56b84a8b3fe1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c39e2a2b15174fcabf0174ebd4f07680" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 44615 } } peers { permanent_uuid: "0f4ede8cc7d94db7a0cacb7501bb5f54" member_type: VOTER last_known_addr { host: "127.20.171.125" port: 39661 } } peers { permanent_uuid: "1e3a5236cee841dba92f56b84a8b3fe1" member_type: VOTER last_known_addr { host: "127.20.171.124" port: 40649 } } }
I20260807 10:39:20.021276 2684 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1e3a5236cee841dba92f56b84a8b3fe1 [sys.catalog]: This master's current role is: LEADER
I20260807 10:39:20.021638 2684 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1e3a5236cee841dba92f56b84a8b3fe1 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "1e3a5236cee841dba92f56b84a8b3fe1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c39e2a2b15174fcabf0174ebd4f07680" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 44615 } } peers { permanent_uuid: "0f4ede8cc7d94db7a0cacb7501bb5f54" member_type: VOTER last_known_addr { host: "127.20.171.125" port: 39661 } } peers { permanent_uuid: "1e3a5236cee841dba92f56b84a8b3fe1" member_type: VOTER last_known_addr { host: "127.20.171.124" port: 40649 } } }
I20260807 10:39:20.021927 2684 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1e3a5236cee841dba92f56b84a8b3fe1 [sys.catalog]: This master's current role is: LEADER
I20260807 10:39:20.022696 2728 catalog_manager.cc:1347] Generated new cluster ID: 5ddf045a00ae46959acd07bee8d6d091
I20260807 10:39:20.022791 2728 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 10:39:20.045742 2728 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 10:39:20.047972 2728 catalog_manager.cc:1504] Loading token signing keys...
I20260807 10:39:20.071300 2728 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1e3a5236cee841dba92f56b84a8b3fe1: Generated new TSK 0
I20260807 10:39:20.073097 2728 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 10:39:20.820632 2708 catalog_manager.cc:1259] Loaded cluster ID: 5ddf045a00ae46959acd07bee8d6d091
I20260807 10:39:20.820785 2708 catalog_manager.cc:1552] T 00000000000000000000000000000000 P c39e2a2b15174fcabf0174ebd4f07680: loading cluster ID for follower catalog manager: success
I20260807 10:39:20.823153 2708 catalog_manager.cc:1574] T 00000000000000000000000000000000 P c39e2a2b15174fcabf0174ebd4f07680: acquiring CA information for follower catalog manager: success
I20260807 10:39:20.824858 2708 catalog_manager.cc:1602] T 00000000000000000000000000000000 P c39e2a2b15174fcabf0174ebd4f07680: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260807 10:39:20.907313 2723 catalog_manager.cc:1259] Loaded cluster ID: 5ddf045a00ae46959acd07bee8d6d091
I20260807 10:39:20.907454 2723 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 0f4ede8cc7d94db7a0cacb7501bb5f54: loading cluster ID for follower catalog manager: success
I20260807 10:39:20.910071 2723 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 0f4ede8cc7d94db7a0cacb7501bb5f54: acquiring CA information for follower catalog manager: success
I20260807 10:39:20.911741 2723 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 0f4ede8cc7d94db7a0cacb7501bb5f54: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260807 10:39:21.229907 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 2450
I20260807 10:39:21.231601 2512 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:39:21.339239 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 2450
I20260807 10:39:21.363633 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 2525
I20260807 10:39:21.364791 2589 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:39:21.471683 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 2525
I20260807 10:39:21.495679 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 2601
I20260807 10:39:21.496856 2664 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:39:21.606662 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 2601
2026-08-07T10:39:21Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (4877 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786098956060137-21165-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 10:39:21 dist-test-slave-0b58 krb5kdc[2747](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 10:39:21 dist-test-slave-0b58 krb5kdc[2747](info): set up 2 sockets
Aug 07 10:39:21 dist-test-slave-0b58 krb5kdc[2747](info): commencing operation
krb5kdc: starting...
W20260807 10:39:22.714988 21165 mini_kdc.cc:121] Time spent starting KDC: real 1.062s user 0.001s sys 0.039s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786098956060137-21165-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786098956060137-21165-0/krb5kdc/test-user.keytab.
Aug 07 10:39:22 dist-test-slave-0b58 krb5kdc[2747](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099162, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T10:39:22Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T10:39:22Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.171.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.171.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.171.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.126.keytab.
Entry for principal kudu/127.20.171.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.126.keytab.
I20260807 10:39:22.997925 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786098956060137-21165-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786098956060137-21165-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786098956060137-21165-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.171.126:38227
--webserver_interface=127.20.171.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.126.keytab
--principal=kudu/127.20.171.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.171.84:41603
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.171.126:38227
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786098956060137-21165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786098956060137-21165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786098956060137-21165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:39:23.329972 2760 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:39:23.330299 2760 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:39:23.330483 2760 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:39:23.337810 2760 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 10:39:23.337944 2760 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:39:23.338047 2760 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:39:23.338157 2760 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 10:39:23.338244 2760 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 10:39:23.347853 2760 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.171.84:41603
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786098956060137-21165-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786098956060137-21165-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.171.126:38227
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.126.keytab
--principal=kudu/127.20.171.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.171.126:38227
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.171.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786098956060137-21165-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:39:23.349165 2760 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:39:23.350464 2760 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:39:23.362314 2765 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:39:23.362226 2766 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:39:23.362280 2768 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:39:23.363435 2760 server_base.cc:1034] running on GCE node
I20260807 10:39:23.364246 2760 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:39:23.365644 2760 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:39:23.366866 2760 hybrid_clock.cc:648] HybridClock initialized: now 1786099163366817 us; error 31 us; skew 500 ppm
I20260807 10:39:23.367231 2760 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:39:23 dist-test-slave-0b58 krb5kdc[2747](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099163, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:39:23.370379 2760 init.cc:377] Logged in from keytab as kudu/127.20.171.126@KRBTEST.COM (short username kudu)
I20260807 10:39:23.371717 2760 webserver.cc:460] Webserver started at http://127.20.171.126:33415/ using document root <none> and password file <none>
I20260807 10:39:23.372417 2760 fs_manager.cc:359] Metadata directory not provided
I20260807 10:39:23.372524 2760 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:39:23.372782 2760 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:39:23.375628 2760 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786098956060137-21165-0/minicluster-data/master-0/data/instance:
uuid: "5c083dd41a754de99d382366440745e4"
format_stamp: "Formatted at 2026-08-07 10:39:23 on dist-test-slave-0b58"
server_key: "7d2fc5fcb1d3a9347b56d4ee09dbcc0d"
server_key_iv: "fcf2ebb28eae0197a7581d7bd5d611cb"
server_key_version: "encryptionkey@0"
I20260807 10:39:23.376448 2760 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786098956060137-21165-0/minicluster-data/master-0/wal/instance:
uuid: "5c083dd41a754de99d382366440745e4"
format_stamp: "Formatted at 2026-08-07 10:39:23 on dist-test-slave-0b58"
server_key: "7d2fc5fcb1d3a9347b56d4ee09dbcc0d"
server_key_iv: "fcf2ebb28eae0197a7581d7bd5d611cb"
server_key_version: "encryptionkey@0"
I20260807 10:39:23.381357 2760 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260807 10:39:23.384443 2775 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:39:23.385636 2760 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260807 10:39:23.385820 2760 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786098956060137-21165-0/minicluster-data/master-0/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786098956060137-21165-0/minicluster-data/master-0/wal
uuid: "5c083dd41a754de99d382366440745e4"
format_stamp: "Formatted at 2026-08-07 10:39:23 on dist-test-slave-0b58"
server_key: "7d2fc5fcb1d3a9347b56d4ee09dbcc0d"
server_key_iv: "fcf2ebb28eae0197a7581d7bd5d611cb"
server_key_version: "encryptionkey@0"
I20260807 10:39:23.386009 2760 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786098956060137-21165-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786098956060137-21165-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786098956060137-21165-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:39:23.429585 2760 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:39:23.433835 2760 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:39:23.434126 2760 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:39:23.453007 2760 rpc_server.cc:307] RPC server started. Bound to: 127.20.171.126:38227
I20260807 10:39:23.453014 2827 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.171.126:38227 every 8 connection(s)
I20260807 10:39:23.454319 2760 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
I20260807 10:39:23.458009 2828 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:39:23.462822 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 2760
I20260807 10:39:23.463057 21165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786098956060137-21165-0/minicluster-data/master-0/wal/instance
I20260807 10:39:23.464015 21165 external_mini_cluster.cc:1428] Setting key 5705efd69bf9831e517cfec423f1e627
I20260807 10:39:23.470405 2828 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5c083dd41a754de99d382366440745e4: Bootstrap starting.
I20260807 10:39:23.473719 2828 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5c083dd41a754de99d382366440745e4: Neither blocks nor log segments found. Creating new log.
I20260807 10:39:23.474767 2828 log.cc:824] T 00000000000000000000000000000000 P 5c083dd41a754de99d382366440745e4: Log is configured to *not* fsync() on all Append() calls
I20260807 10:39:23.478480 2828 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5c083dd41a754de99d382366440745e4: No bootstrap required, opened a new log
Aug 07 10:39:23 dist-test-slave-0b58 krb5kdc[2747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099162, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.171.126@KRBTEST.COM
I20260807 10:39:23.486526 2828 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5c083dd41a754de99d382366440745e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c083dd41a754de99d382366440745e4" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 38227 } }
I20260807 10:39:23.486923 2828 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5c083dd41a754de99d382366440745e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:39:23.487046 2828 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5c083dd41a754de99d382366440745e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c083dd41a754de99d382366440745e4, State: Initialized, Role: FOLLOWER
I20260807 10:39:23.487777 2828 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5c083dd41a754de99d382366440745e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c083dd41a754de99d382366440745e4" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 38227 } }
I20260807 10:39:23.488072 2828 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5c083dd41a754de99d382366440745e4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 10:39:23.488288 2828 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5c083dd41a754de99d382366440745e4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 10:39:23.488513 2828 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5c083dd41a754de99d382366440745e4 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:39:23.489030 2831 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:23.466153 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59300 (local address 127.20.171.126:38227)
0807 10:39:23.467015 (+ 862us) server_negotiation.cc:206] Beginning negotiation
0807 10:39:23.467028 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 10:39:23.467077 (+ 49us) server_negotiation.cc:407] Connection header received
0807 10:39:23.469149 (+ 2072us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:39:23.469176 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:39:23.469591 (+ 415us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:39:23.470132 (+ 541us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:39:23.471761 (+ 1629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:23.473247 (+ 1486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:23.474922 (+ 1675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:23.476032 (+ 1110us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:23.476311 (+ 279us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:39:23.481259 (+ 4948us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:39:23.481269 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:39:23.481282 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:39:23.481319 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:39:23.484614 (+ 3295us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:39:23.485349 (+ 735us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:39:23.485356 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:39:23.485362 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:39:23.485578 (+ 216us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:39:23.485986 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:39:23.485991 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:39:23.485994 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:39:23.486523 (+ 529us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:39:23.486835 (+ 312us) server_negotiation.cc:1035] Waiting for connection context
0807 10:39:23.487304 (+ 469us) server_negotiation.cc:299] Negotiation successful
0807 10:39:23.487771 (+ 467us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":646,"thread_start_us":405,"threads_started":1}
I20260807 10:39:23.491266 2828 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5c083dd41a754de99d382366440745e4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c083dd41a754de99d382366440745e4" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 38227 } }
I20260807 10:39:23.491838 2828 leader_election.cc:302] T 00000000000000000000000000000000 P 5c083dd41a754de99d382366440745e4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5c083dd41a754de99d382366440745e4; no voters:
I20260807 10:39:23.492558 2828 leader_election.cc:288] T 00000000000000000000000000000000 P 5c083dd41a754de99d382366440745e4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 10:39:23.492664 2833 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5c083dd41a754de99d382366440745e4 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:39:23.492846 21165 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 10:39:23.493351 2833 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5c083dd41a754de99d382366440745e4 [term 1 LEADER]: Becoming Leader. State: Replica: 5c083dd41a754de99d382366440745e4, State: Running, Role: LEADER
I20260807 10:39:23.494114 2833 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5c083dd41a754de99d382366440745e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c083dd41a754de99d382366440745e4" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 38227 } }
I20260807 10:39:23.497545 2828 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5c083dd41a754de99d382366440745e4 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 10:39:23.501267 2835 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5c083dd41a754de99d382366440745e4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5c083dd41a754de99d382366440745e4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c083dd41a754de99d382366440745e4" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 38227 } } }
I20260807 10:39:23.501652 2835 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5c083dd41a754de99d382366440745e4 [sys.catalog]: This master's current role is: LEADER
I20260807 10:39:23.502069 2834 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5c083dd41a754de99d382366440745e4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5c083dd41a754de99d382366440745e4. Latest consensus state: current_term: 1 leader_uuid: "5c083dd41a754de99d382366440745e4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c083dd41a754de99d382366440745e4" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 38227 } } }
I20260807 10:39:23.502508 2834 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5c083dd41a754de99d382366440745e4 [sys.catalog]: This master's current role is: LEADER
I20260807 10:39:23.504577 2844 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 10:39:23.508739 2844 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 10:39:23.516395 2844 catalog_manager.cc:1347] Generated new cluster ID: e5b240e335d34876b04c0b616fceaf32
I20260807 10:39:23.516507 2844 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 10:39:23.539309 2844 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 10:39:23.541225 2844 catalog_manager.cc:1504] Loading token signing keys...
I20260807 10:39:23.551409 2844 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5c083dd41a754de99d382366440745e4: Generated new TSK 0
I20260807 10:39:23.552438 2844 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 10:39:23.605455 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 2760
I20260807 10:39:23.606709 2823 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:39:23.706947 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 2760
2026-08-07T10:39:23Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (2095 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 10:39:23 dist-test-slave-0b58 krb5kdc[2856](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 10:39:23 dist-test-slave-0b58 krb5kdc[2856](info): set up 2 sockets
Aug 07 10:39:23 dist-test-slave-0b58 krb5kdc[2856](info): commencing operation
krb5kdc: starting...
W20260807 10:39:24.834497 21165 mini_kdc.cc:121] Time spent starting KDC: real 1.087s user 0.004s sys 0.037s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/krb5kdc/test-user.keytab.
Aug 07 10:39:25 dist-test-slave-0b58 krb5kdc[2856](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099165, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T10:39:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T10:39:25Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.171.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.171.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.171.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.126.keytab.
Entry for principal kudu/127.20.171.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.126.keytab.
I20260807 10:39:25.118029 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.171.126:38675
--webserver_interface=127.20.171.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.126.keytab
--principal=kudu/127.20.171.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.171.84:41719
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.171.126:38675
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:39:25.448523 2869 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:39:25.448792 2869 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:39:25.448995 2869 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:39:25.455694 2869 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 10:39:25.455797 2869 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:39:25.455842 2869 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:39:25.455921 2869 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 10:39:25.456003 2869 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 10:39:25.465340 2869 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.171.84:41719
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.171.126:38675
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.126.keytab
--principal=kudu/127.20.171.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.171.126:38675
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.171.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:39:25.466638 2869 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:39:25.467939 2869 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:39:25.479789 2875 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:39:25.479821 2874 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:39:25.479758 2877 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:39:25.480854 2869 server_base.cc:1034] running on GCE node
I20260807 10:39:25.481564 2869 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:39:25.482852 2869 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:39:25.484040 2869 hybrid_clock.cc:648] HybridClock initialized: now 1786099165483988 us; error 47 us; skew 500 ppm
I20260807 10:39:25.484392 2869 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:39:25 dist-test-slave-0b58 krb5kdc[2856](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099165, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:39:25.492085 2869 init.cc:377] Logged in from keytab as kudu/127.20.171.126@KRBTEST.COM (short username kudu)
I20260807 10:39:25.493598 2869 webserver.cc:460] Webserver started at http://127.20.171.126:40653/ using document root <none> and password file <none>
I20260807 10:39:25.494233 2869 fs_manager.cc:359] Metadata directory not provided
I20260807 10:39:25.494370 2869 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:39:25.494663 2869 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:39:25.497640 2869 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/master-0/data/instance:
uuid: "ef15abefda7940d1a2bf5dacba18eace"
format_stamp: "Formatted at 2026-08-07 10:39:25 on dist-test-slave-0b58"
server_key: "5caabc34a06b6bd79f27a88f8a43dc6f"
server_key_iv: "18adc8d358f530959f6d572240c70135"
server_key_version: "encryptionkey@0"
I20260807 10:39:25.498509 2869 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/master-0/wal/instance:
uuid: "ef15abefda7940d1a2bf5dacba18eace"
format_stamp: "Formatted at 2026-08-07 10:39:25 on dist-test-slave-0b58"
server_key: "5caabc34a06b6bd79f27a88f8a43dc6f"
server_key_iv: "18adc8d358f530959f6d572240c70135"
server_key_version: "encryptionkey@0"
I20260807 10:39:25.503398 2869 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.005s
I20260807 10:39:25.506793 2884 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:39:25.508013 2869 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 10:39:25.508193 2869 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/master-0/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/master-0/wal
uuid: "ef15abefda7940d1a2bf5dacba18eace"
format_stamp: "Formatted at 2026-08-07 10:39:25 on dist-test-slave-0b58"
server_key: "5caabc34a06b6bd79f27a88f8a43dc6f"
server_key_iv: "18adc8d358f530959f6d572240c70135"
server_key_version: "encryptionkey@0"
I20260807 10:39:25.508445 2869 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:39:25.524696 2869 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:39:25.528663 2869 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:39:25.528890 2869 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:39:25.547132 2869 rpc_server.cc:307] RPC server started. Bound to: 127.20.171.126:38675
I20260807 10:39:25.547170 2935 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.171.126:38675 every 8 connection(s)
I20260807 10:39:25.548494 2869 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
I20260807 10:39:25.551964 2936 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:39:25.554673 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 2869
I20260807 10:39:25.554914 21165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/master-0/wal/instance
I20260807 10:39:25.555760 21165 external_mini_cluster.cc:1428] Setting key 7680961e8a4141fdb50d82a5a069f645
I20260807 10:39:25.564576 2936 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ef15abefda7940d1a2bf5dacba18eace: Bootstrap starting.
I20260807 10:39:25.568171 2936 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ef15abefda7940d1a2bf5dacba18eace: Neither blocks nor log segments found. Creating new log.
I20260807 10:39:25.569478 2936 log.cc:824] T 00000000000000000000000000000000 P ef15abefda7940d1a2bf5dacba18eace: Log is configured to *not* fsync() on all Append() calls
Aug 07 10:39:25 dist-test-slave-0b58 krb5kdc[2856](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099165, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.171.126@KRBTEST.COM
I20260807 10:39:25.572445 2936 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ef15abefda7940d1a2bf5dacba18eace: No bootstrap required, opened a new log
I20260807 10:39:25.579826 2939 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:25.557865 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40924 (local address 127.20.171.126:38675)
0807 10:39:25.558666 (+ 801us) server_negotiation.cc:206] Beginning negotiation
0807 10:39:25.558682 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 10:39:25.558731 (+ 49us) server_negotiation.cc:407] Connection header received
0807 10:39:25.560597 (+ 1866us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:39:25.560619 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:39:25.560985 (+ 366us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:39:25.561370 (+ 385us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:39:25.563128 (+ 1758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:25.564425 (+ 1297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:25.566104 (+ 1679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:25.566791 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:25.566914 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:39:25.572082 (+ 5168us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:39:25.572094 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:39:25.572113 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:39:25.572156 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:39:25.575805 (+ 3649us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:39:25.576614 (+ 809us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:39:25.576625 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:39:25.576630 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:39:25.576814 (+ 184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:39:25.577253 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:39:25.577256 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:39:25.577258 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:39:25.577764 (+ 506us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:39:25.578041 (+ 277us) server_negotiation.cc:1035] Waiting for connection context
0807 10:39:25.578470 (+ 429us) server_negotiation.cc:299] Negotiation successful
0807 10:39:25.578844 (+ 374us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":574,"thread_start_us":373,"threads_started":1}
I20260807 10:39:25.582260 2936 raft_consensus.cc:348] T 00000000000000000000000000000000 P ef15abefda7940d1a2bf5dacba18eace [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ef15abefda7940d1a2bf5dacba18eace" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 38675 } }
I20260807 10:39:25.582679 2936 raft_consensus.cc:374] T 00000000000000000000000000000000 P ef15abefda7940d1a2bf5dacba18eace [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:39:25.582782 2936 raft_consensus.cc:729] T 00000000000000000000000000000000 P ef15abefda7940d1a2bf5dacba18eace [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef15abefda7940d1a2bf5dacba18eace, State: Initialized, Role: FOLLOWER
I20260807 10:39:25.583307 2936 consensus_queue.cc:260] T 00000000000000000000000000000000 P ef15abefda7940d1a2bf5dacba18eace [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ef15abefda7940d1a2bf5dacba18eace" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 38675 } }
I20260807 10:39:25.583519 2936 raft_consensus.cc:388] T 00000000000000000000000000000000 P ef15abefda7940d1a2bf5dacba18eace [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 10:39:25.583686 2936 raft_consensus.cc:482] T 00000000000000000000000000000000 P ef15abefda7940d1a2bf5dacba18eace [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 10:39:25.583847 2936 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ef15abefda7940d1a2bf5dacba18eace [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:39:25.585964 2936 raft_consensus.cc:504] T 00000000000000000000000000000000 P ef15abefda7940d1a2bf5dacba18eace [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ef15abefda7940d1a2bf5dacba18eace" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 38675 } }
I20260807 10:39:25.586486 2936 leader_election.cc:302] T 00000000000000000000000000000000 P ef15abefda7940d1a2bf5dacba18eace [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ef15abefda7940d1a2bf5dacba18eace; no voters:
I20260807 10:39:25.587162 2936 leader_election.cc:288] T 00000000000000000000000000000000 P ef15abefda7940d1a2bf5dacba18eace [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 10:39:25.587284 2941 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ef15abefda7940d1a2bf5dacba18eace [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:39:25.589196 2936 sys_catalog.cc:564] T 00000000000000000000000000000000 P ef15abefda7940d1a2bf5dacba18eace [sys.catalog]: configured and running, proceeding with master startup.
I20260807 10:39:25.589529 2941 raft_consensus.cc:686] T 00000000000000000000000000000000 P ef15abefda7940d1a2bf5dacba18eace [term 1 LEADER]: Becoming Leader. State: Replica: ef15abefda7940d1a2bf5dacba18eace, State: Running, Role: LEADER
I20260807 10:39:25.590020 2941 consensus_queue.cc:237] T 00000000000000000000000000000000 P ef15abefda7940d1a2bf5dacba18eace [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ef15abefda7940d1a2bf5dacba18eace" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 38675 } }
I20260807 10:39:25.592806 2942 sys_catalog.cc:455] T 00000000000000000000000000000000 P ef15abefda7940d1a2bf5dacba18eace [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ef15abefda7940d1a2bf5dacba18eace" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ef15abefda7940d1a2bf5dacba18eace" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 38675 } } }
I20260807 10:39:25.593168 2942 sys_catalog.cc:458] T 00000000000000000000000000000000 P ef15abefda7940d1a2bf5dacba18eace [sys.catalog]: This master's current role is: LEADER
I20260807 10:39:25.593604 2943 sys_catalog.cc:455] T 00000000000000000000000000000000 P ef15abefda7940d1a2bf5dacba18eace [sys.catalog]: SysCatalogTable state changed. Reason: New leader ef15abefda7940d1a2bf5dacba18eace. Latest consensus state: current_term: 1 leader_uuid: "ef15abefda7940d1a2bf5dacba18eace" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ef15abefda7940d1a2bf5dacba18eace" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 38675 } } }
I20260807 10:39:25.593891 2943 sys_catalog.cc:458] T 00000000000000000000000000000000 P ef15abefda7940d1a2bf5dacba18eace [sys.catalog]: This master's current role is: LEADER
I20260807 10:39:25.597565 2951 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 10:39:25.602316 2951 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 10:39:25.610119 2951 catalog_manager.cc:1347] Generated new cluster ID: 2caa8cd5a5b94bee96036c9c836bf92c
I20260807 10:39:25.610236 2951 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 10:39:25.617377 2951 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 10:39:25.618803 2951 catalog_manager.cc:1504] Loading token signing keys...
I20260807 10:39:25.624353 2951 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ef15abefda7940d1a2bf5dacba18eace: Generated new TSK 0
I20260807 10:39:25.625008 2951 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.171.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.171.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.171.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.65.keytab.
Entry for principal kudu/127.20.171.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.65.keytab.
I20260807 10:39:25.691757 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.171.65:0
--local_ip_for_outbound_sockets=127.20.171.65
--webserver_interface=127.20.171.65
--webserver_port=0
--tserver_master_addrs=127.20.171.126:38675
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.65.keytab
--principal=kudu/127.20.171.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.171.84:41719
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:39:26.024184 2962 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:39:26.024471 2962 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:39:26.024672 2962 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:39:26.032411 2962 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:39:26.032523 2962 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:39:26.032735 2962 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.171.65
I20260807 10:39:26.041999 2962 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.171.84:41719
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.65.keytab
--principal=kudu/127.20.171.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.171.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.171.65
--webserver_port=0
--tserver_master_addrs=127.20.171.126:38675
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.171.65
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:39:26.043241 2962 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:39:26.044543 2962 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:39:26.057053 2970 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:39:26.057134 2967 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:39:26.057160 2968 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:39:26.057798 2962 server_base.cc:1034] running on GCE node
I20260807 10:39:26.058439 2962 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:39:26.059260 2962 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:39:26.060463 2962 hybrid_clock.cc:648] HybridClock initialized: now 1786099166060428 us; error 47 us; skew 500 ppm
I20260807 10:39:26.060738 2962 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:39:26 dist-test-slave-0b58 krb5kdc[2856](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099166, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:39:26.063536 2962 init.cc:377] Logged in from keytab as kudu/127.20.171.65@KRBTEST.COM (short username kudu)
I20260807 10:39:26.064972 2962 webserver.cc:460] Webserver started at http://127.20.171.65:34755/ using document root <none> and password file <none>
I20260807 10:39:26.065609 2962 fs_manager.cc:359] Metadata directory not provided
I20260807 10:39:26.065747 2962 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:39:26.066023 2962 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:39:26.068800 2962 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/ts-0/data/instance:
uuid: "ffa4ec639b714cbc810bdfee1a63fdc9"
format_stamp: "Formatted at 2026-08-07 10:39:26 on dist-test-slave-0b58"
server_key: "21fc6ec42a108cbe7a15c46e78fadb74"
server_key_iv: "fd445e37302689812ecdcdc462417275"
server_key_version: "encryptionkey@0"
I20260807 10:39:26.069509 2962 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/ts-0/wal/instance:
uuid: "ffa4ec639b714cbc810bdfee1a63fdc9"
format_stamp: "Formatted at 2026-08-07 10:39:26 on dist-test-slave-0b58"
server_key: "21fc6ec42a108cbe7a15c46e78fadb74"
server_key_iv: "fd445e37302689812ecdcdc462417275"
server_key_version: "encryptionkey@0"
I20260807 10:39:26.074000 2962 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260807 10:39:26.076978 2977 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:39:26.078141 2962 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 10:39:26.078325 2962 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/ts-0/wal
uuid: "ffa4ec639b714cbc810bdfee1a63fdc9"
format_stamp: "Formatted at 2026-08-07 10:39:26 on dist-test-slave-0b58"
server_key: "21fc6ec42a108cbe7a15c46e78fadb74"
server_key_iv: "fd445e37302689812ecdcdc462417275"
server_key_version: "encryptionkey@0"
I20260807 10:39:26.078506 2962 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:39:26.104993 2962 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:39:26.109361 2962 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:39:26.109656 2962 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:39:26.110752 2962 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:39:26.112146 2962 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:39:26.112223 2962 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:39:26.112360 2962 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:39:26.112408 2962 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:39:26.144539 2962 rpc_server.cc:307] RPC server started. Bound to: 127.20.171.65:43563
I20260807 10:39:26.144577 3090 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.171.65:43563 every 8 connection(s)
I20260807 10:39:26.145782 2962 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/ts-0/data/info.pb
I20260807 10:39:26.148962 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 2962
I20260807 10:39:26.149183 21165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/ts-0/wal/instance
I20260807 10:39:26.149863 21165 external_mini_cluster.cc:1428] Setting key 0bd644ee003aa694503fee4452d0f15e
Aug 07 10:39:26 dist-test-slave-0b58 krb5kdc[2856](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099166, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.65@KRBTEST.COM for kudu/127.20.171.126@KRBTEST.COM
I20260807 10:39:26.167196 3093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:26.148290 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.65:46265 (local address 127.20.171.126:38675)
0807 10:39:26.148796 (+ 506us) server_negotiation.cc:206] Beginning negotiation
0807 10:39:26.148802 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:39:26.149749 (+ 947us) server_negotiation.cc:407] Connection header received
0807 10:39:26.151956 (+ 2207us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:39:26.151961 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:39:26.152035 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:39:26.152140 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:39:26.153570 (+ 1430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:26.154803 (+ 1233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:26.156382 (+ 1579us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:26.157115 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:26.157266 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:39:26.160902 (+ 3636us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:39:26.160910 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:39:26.160917 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:39:26.160956 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:39:26.164221 (+ 3265us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:39:26.164899 (+ 678us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:39:26.164907 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:39:26.164913 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:39:26.165059 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:39:26.165534 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:39:26.165537 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:39:26.165539 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:39:26.165777 (+ 238us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:39:26.165878 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0807 10:39:26.166791 (+ 913us) server_negotiation.cc:299] Negotiation successful
0807 10:39:26.166952 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":352,"thread_start_us":223,"threads_started":1}
I20260807 10:39:26.168687 3094 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:26.148813 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:38675 (local address 127.20.171.65:46265)
0807 10:39:26.149572 (+ 759us) negotiation.cc:107] Waiting for socket to connect
0807 10:39:26.149615 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0807 10:39:26.151663 (+ 2048us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:39:26.152391 (+ 728us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:39:26.152399 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:39:26.152879 (+ 480us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:39:26.153389 (+ 510us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:39:26.153405 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:39:26.154956 (+ 1551us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:39:26.154960 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:39:26.156189 (+ 1229us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:39:26.156205 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:39:26.157332 (+ 1127us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:39:26.157337 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:39:26.157818 (+ 481us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:39:26.158535 (+ 717us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:39:26.158558 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:39:26.160672 (+ 2114us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:39:26.164352 (+ 3680us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:39:26.164357 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:39:26.164369 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:39:26.164770 (+ 401us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:39:26.165168 (+ 398us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:39:26.165174 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:39:26.165179 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:39:26.165427 (+ 248us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:39:26.165893 (+ 466us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:39:26.165903 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:39:26.166381 (+ 478us) client_negotiation.cc:769] Sending connection context
0807 10:39:26.166689 (+ 308us) client_negotiation.cc:240] Negotiation successful
0807 10:39:26.167255 (+ 566us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":509,"thread_start_us":318,"threads_started":1}
I20260807 10:39:26.170161 3091 heartbeater.cc:347] Connected to a master server at 127.20.171.126:38675
I20260807 10:39:26.170449 3091 heartbeater.cc:464] Registering TS with master...
I20260807 10:39:26.171109 3091 heartbeater.cc:511] Master 127.20.171.126:38675 requested a full tablet report, sending...
I20260807 10:39:26.173023 2901 ts_manager.cc:194] Registered new tserver with Master: ffa4ec639b714cbc810bdfee1a63fdc9 (127.20.171.65:43563)
I20260807 10:39:26.174425 2901 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.171.65@KRBTEST.COM'} at 127.20.171.65:46265
WARNING: no policy specified for kudu/127.20.171.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.171.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.171.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.66.keytab.
Entry for principal kudu/127.20.171.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.66.keytab.
I20260807 10:39:26.216957 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.171.66:0
--local_ip_for_outbound_sockets=127.20.171.66
--webserver_interface=127.20.171.66
--webserver_port=0
--tserver_master_addrs=127.20.171.126:38675
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.66.keytab
--principal=kudu/127.20.171.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.171.84:41719
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:39:26.538090 3098 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:39:26.538388 3098 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:39:26.538559 3098 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:39:26.545706 3098 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:39:26.545845 3098 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:39:26.546026 3098 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.171.66
I20260807 10:39:26.555438 3098 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.171.84:41719
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.66.keytab
--principal=kudu/127.20.171.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.171.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.171.66
--webserver_port=0
--tserver_master_addrs=127.20.171.126:38675
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.171.66
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:39:26.556658 3098 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:39:26.557896 3098 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:39:26.570438 3103 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:39:26.570398 3104 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:39:26.570648 3106 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:39:26.571390 3098 server_base.cc:1034] running on GCE node
I20260807 10:39:26.571910 3098 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:39:26.572860 3098 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:39:26.574074 3098 hybrid_clock.cc:648] HybridClock initialized: now 1786099166574031 us; error 40 us; skew 500 ppm
I20260807 10:39:26.574381 3098 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:39:26 dist-test-slave-0b58 krb5kdc[2856](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099166, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:39:26.577430 3098 init.cc:377] Logged in from keytab as kudu/127.20.171.66@KRBTEST.COM (short username kudu)
I20260807 10:39:26.578792 3098 webserver.cc:460] Webserver started at http://127.20.171.66:46167/ using document root <none> and password file <none>
I20260807 10:39:26.579453 3098 fs_manager.cc:359] Metadata directory not provided
I20260807 10:39:26.579586 3098 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:39:26.579886 3098 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:39:26.582858 3098 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/ts-1/data/instance:
uuid: "04bb6b53e9584b818b9c9d9ee43f3e17"
format_stamp: "Formatted at 2026-08-07 10:39:26 on dist-test-slave-0b58"
server_key: "85e9c8aadebb3f3ac976eaae312b33df"
server_key_iv: "5224412a58919bc5e1b20c8f7b885ea8"
server_key_version: "encryptionkey@0"
I20260807 10:39:26.583638 3098 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/ts-1/wal/instance:
uuid: "04bb6b53e9584b818b9c9d9ee43f3e17"
format_stamp: "Formatted at 2026-08-07 10:39:26 on dist-test-slave-0b58"
server_key: "85e9c8aadebb3f3ac976eaae312b33df"
server_key_iv: "5224412a58919bc5e1b20c8f7b885ea8"
server_key_version: "encryptionkey@0"
I20260807 10:39:26.589174 3098 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260807 10:39:26.592517 3113 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:39:26.593799 3098 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260807 10:39:26.593948 3098 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/ts-1/wal
uuid: "04bb6b53e9584b818b9c9d9ee43f3e17"
format_stamp: "Formatted at 2026-08-07 10:39:26 on dist-test-slave-0b58"
server_key: "85e9c8aadebb3f3ac976eaae312b33df"
server_key_iv: "5224412a58919bc5e1b20c8f7b885ea8"
server_key_version: "encryptionkey@0"
I20260807 10:39:26.594154 3098 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:39:26.617089 3098 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:39:26.620688 3098 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:39:26.620949 3098 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:39:26.621806 3098 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:39:26.623035 3098 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:39:26.623103 3098 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:39:26.623266 3098 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:39:26.623315 3098 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:39:26.655965 3098 rpc_server.cc:307] RPC server started. Bound to: 127.20.171.66:46259
I20260807 10:39:26.656049 3227 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.171.66:46259 every 8 connection(s)
I20260807 10:39:26.657228 3098 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/ts-1/data/info.pb
I20260807 10:39:26.664565 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 3098
I20260807 10:39:26.664768 21165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/ts-1/wal/instance
I20260807 10:39:26.665241 21165 external_mini_cluster.cc:1428] Setting key afc3e280f4911510e35cc0841b0119f5
Aug 07 10:39:26 dist-test-slave-0b58 krb5kdc[2856](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099166, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.66@KRBTEST.COM for kudu/127.20.171.126@KRBTEST.COM
I20260807 10:39:26.678488 3093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:26.659749 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.66:39115 (local address 127.20.171.126:38675)
0807 10:39:26.659951 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0807 10:39:26.659957 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:39:26.661116 (+ 1159us) server_negotiation.cc:407] Connection header received
0807 10:39:26.662819 (+ 1703us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:39:26.662823 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:39:26.662892 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:39:26.662986 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:39:26.664436 (+ 1450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:26.665265 (+ 829us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:26.666974 (+ 1709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:26.667494 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:26.667592 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:39:26.671575 (+ 3983us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:39:26.671583 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:39:26.671590 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:39:26.671634 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:39:26.675156 (+ 3522us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:39:26.675963 (+ 807us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:39:26.675971 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:39:26.675976 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:39:26.676132 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:39:26.676615 (+ 483us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:39:26.676622 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:39:26.676628 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:39:26.677033 (+ 405us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:39:26.677184 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0807 10:39:26.677810 (+ 626us) server_negotiation.cc:299] Negotiation successful
0807 10:39:26.678063 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260807 10:39:26.679068 3230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:26.660248 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:38675 (local address 127.20.171.66:39115)
0807 10:39:26.660965 (+ 717us) negotiation.cc:107] Waiting for socket to connect
0807 10:39:26.661005 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0807 10:39:26.662589 (+ 1584us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:39:26.663169 (+ 580us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:39:26.663175 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:39:26.663617 (+ 442us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:39:26.664219 (+ 602us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:39:26.664271 (+ 52us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:39:26.665420 (+ 1149us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:39:26.665427 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:39:26.666787 (+ 1360us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:39:26.666799 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:39:26.667734 (+ 935us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:39:26.667743 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:39:26.668031 (+ 288us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:39:26.668750 (+ 719us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:39:26.668782 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:39:26.671365 (+ 2583us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:39:26.675295 (+ 3930us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:39:26.675301 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:39:26.675312 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:39:26.675826 (+ 514us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:39:26.676248 (+ 422us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:39:26.676293 (+ 45us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:39:26.676302 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:39:26.676480 (+ 178us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:39:26.677157 (+ 677us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:39:26.677163 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:39:26.677442 (+ 279us) client_negotiation.cc:769] Sending connection context
0807 10:39:26.677649 (+ 207us) client_negotiation.cc:240] Negotiation successful
0807 10:39:26.678008 (+ 359us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":462,"thread_start_us":266,"threads_started":1}
I20260807 10:39:26.680512 3228 heartbeater.cc:347] Connected to a master server at 127.20.171.126:38675
I20260807 10:39:26.680831 3228 heartbeater.cc:464] Registering TS with master...
I20260807 10:39:26.681532 3228 heartbeater.cc:511] Master 127.20.171.126:38675 requested a full tablet report, sending...
I20260807 10:39:26.683245 2901 ts_manager.cc:194] Registered new tserver with Master: 04bb6b53e9584b818b9c9d9ee43f3e17 (127.20.171.66:46259)
I20260807 10:39:26.684460 2901 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.171.66@KRBTEST.COM'} at 127.20.171.66:39115
WARNING: no policy specified for kudu/127.20.171.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.171.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.171.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.67.keytab.
Entry for principal kudu/127.20.171.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.67.keytab.
I20260807 10:39:26.729861 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.171.67:0
--local_ip_for_outbound_sockets=127.20.171.67
--webserver_interface=127.20.171.67
--webserver_port=0
--tserver_master_addrs=127.20.171.126:38675
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.67.keytab
--principal=kudu/127.20.171.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.171.84:41719
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:39:27.051604 3233 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:39:27.051855 3233 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:39:27.052001 3233 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:39:27.059057 3233 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:39:27.059152 3233 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:39:27.059340 3233 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.171.67
I20260807 10:39:27.068487 3233 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.171.84:41719
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.67.keytab
--principal=kudu/127.20.171.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.171.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.171.67
--webserver_port=0
--tserver_master_addrs=127.20.171.126:38675
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.171.67
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:39:27.069667 3233 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:39:27.070973 3233 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:39:27.083544 3241 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:39:27.083624 3239 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:39:27.083981 3238 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:39:27.084488 3233 server_base.cc:1034] running on GCE node
I20260807 10:39:27.084959 3233 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:39:27.085713 3233 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:39:27.086900 3233 hybrid_clock.cc:648] HybridClock initialized: now 1786099167086848 us; error 49 us; skew 500 ppm
I20260807 10:39:27.087199 3233 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:39:27 dist-test-slave-0b58 krb5kdc[2856](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099167, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:39:27.090344 3233 init.cc:377] Logged in from keytab as kudu/127.20.171.67@KRBTEST.COM (short username kudu)
I20260807 10:39:27.091741 3233 webserver.cc:460] Webserver started at http://127.20.171.67:42841/ using document root <none> and password file <none>
I20260807 10:39:27.092510 3233 fs_manager.cc:359] Metadata directory not provided
I20260807 10:39:27.092612 3233 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:39:27.092921 3233 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:39:27.095649 3233 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/ts-2/data/instance:
uuid: "1c127bab40a54ba6a8b7f42f14e3b068"
format_stamp: "Formatted at 2026-08-07 10:39:27 on dist-test-slave-0b58"
server_key: "87e2eb06cff63793f2dcbcefb62ed4e7"
server_key_iv: "80693a3894185807f903c6cb97842d90"
server_key_version: "encryptionkey@0"
I20260807 10:39:27.096441 3233 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/ts-2/wal/instance:
uuid: "1c127bab40a54ba6a8b7f42f14e3b068"
format_stamp: "Formatted at 2026-08-07 10:39:27 on dist-test-slave-0b58"
server_key: "87e2eb06cff63793f2dcbcefb62ed4e7"
server_key_iv: "80693a3894185807f903c6cb97842d90"
server_key_version: "encryptionkey@0"
I20260807 10:39:27.101473 3233 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260807 10:39:27.104625 3248 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:39:27.105852 3233 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 10:39:27.106007 3233 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/ts-2/wal
uuid: "1c127bab40a54ba6a8b7f42f14e3b068"
format_stamp: "Formatted at 2026-08-07 10:39:27 on dist-test-slave-0b58"
server_key: "87e2eb06cff63793f2dcbcefb62ed4e7"
server_key_iv: "80693a3894185807f903c6cb97842d90"
server_key_version: "encryptionkey@0"
I20260807 10:39:27.106245 3233 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:39:27.142663 3233 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:39:27.146952 3233 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:39:27.147250 3233 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:39:27.148324 3233 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:39:27.149704 3233 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:39:27.149813 3233 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:39:27.149973 3233 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:39:27.150043 3233 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:39:27.177369 3091 heartbeater.cc:503] Master 127.20.171.126:38675 was elected leader, sending a full tablet report...
I20260807 10:39:27.184978 3233 rpc_server.cc:307] RPC server started. Bound to: 127.20.171.67:37957
I20260807 10:39:27.185021 3363 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.171.67:37957 every 8 connection(s)
I20260807 10:39:27.186336 3233 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/ts-2/data/info.pb
I20260807 10:39:27.186818 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 3233
I20260807 10:39:27.187013 21165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/ts-2/wal/instance
I20260807 10:39:27.187630 21165 external_mini_cluster.cc:1428] Setting key adc8c12ce5dc1db9d8f696c59c04fecd
Aug 07 10:39:27 dist-test-slave-0b58 krb5kdc[2856](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099167, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.67@KRBTEST.COM for kudu/127.20.171.126@KRBTEST.COM
I20260807 10:39:27.205876 3366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:27.189057 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.67:59623 (local address 127.20.171.126:38675)
0807 10:39:27.189513 (+ 456us) server_negotiation.cc:206] Beginning negotiation
0807 10:39:27.189517 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 10:39:27.190885 (+ 1368us) server_negotiation.cc:407] Connection header received
0807 10:39:27.192678 (+ 1793us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:39:27.192682 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:39:27.192770 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:39:27.192850 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:39:27.194222 (+ 1372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:27.194942 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:27.196432 (+ 1490us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:27.196841 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:27.196932 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:39:27.200447 (+ 3515us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:39:27.200452 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:39:27.200454 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:39:27.200485 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:39:27.203336 (+ 2851us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:39:27.203965 (+ 629us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:39:27.203968 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:39:27.203970 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:39:27.204094 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:39:27.204522 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:39:27.204525 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:39:27.204527 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:39:27.204782 (+ 255us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:39:27.204897 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0807 10:39:27.205488 (+ 591us) server_negotiation.cc:299] Negotiation successful
0807 10:39:27.205632 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":354,"thread_start_us":244,"threads_started":1}
I20260807 10:39:27.206854 3367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:27.189794 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:38675 (local address 127.20.171.67:59623)
0807 10:39:27.190630 (+ 836us) negotiation.cc:107] Waiting for socket to connect
0807 10:39:27.190675 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0807 10:39:27.192456 (+ 1781us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:39:27.193061 (+ 605us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:39:27.193068 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:39:27.193576 (+ 508us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:39:27.194085 (+ 509us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:39:27.194100 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:39:27.195059 (+ 959us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:39:27.195062 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:39:27.196305 (+ 1243us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:39:27.196327 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:39:27.197022 (+ 695us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:39:27.197026 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:39:27.197277 (+ 251us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:39:27.197928 (+ 651us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:39:27.197955 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:39:27.200200 (+ 2245us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:39:27.203472 (+ 3272us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:39:27.203478 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:39:27.203489 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:39:27.203870 (+ 381us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:39:27.204195 (+ 325us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:39:27.204198 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:39:27.204200 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:39:27.204425 (+ 225us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:39:27.204890 (+ 465us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:39:27.204895 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:39:27.205177 (+ 282us) client_negotiation.cc:769] Sending connection context
0807 10:39:27.205389 (+ 212us) client_negotiation.cc:240] Negotiation successful
0807 10:39:27.205733 (+ 344us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":568,"thread_start_us":353,"threads_started":1}
I20260807 10:39:27.208185 3364 heartbeater.cc:347] Connected to a master server at 127.20.171.126:38675
I20260807 10:39:27.208534 3364 heartbeater.cc:464] Registering TS with master...
I20260807 10:39:27.209239 3364 heartbeater.cc:511] Master 127.20.171.126:38675 requested a full tablet report, sending...
I20260807 10:39:27.210572 2901 ts_manager.cc:194] Registered new tserver with Master: 1c127bab40a54ba6a8b7f42f14e3b068 (127.20.171.67:37957)
I20260807 10:39:27.211354 2901 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.171.67@KRBTEST.COM'} at 127.20.171.67:59623
I20260807 10:39:27.215226 21165 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 10:39:27.231240 3366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:27.219655 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40932 (local address 127.20.171.126:38675)
0807 10:39:27.219810 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0807 10:39:27.219814 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 10:39:27.220349 (+ 535us) server_negotiation.cc:407] Connection header received
0807 10:39:27.220484 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:39:27.220487 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:39:27.220540 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:39:27.220611 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:39:27.221828 (+ 1217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:27.222620 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:27.223921 (+ 1301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:27.224347 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:27.224444 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:39:27.226554 (+ 2110us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:39:27.226558 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:39:27.226561 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:39:27.226589 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:39:27.228930 (+ 2341us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:39:27.229650 (+ 720us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:39:27.229671 (+ 21us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:39:27.229674 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:39:27.229795 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:39:27.230103 (+ 308us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:39:27.230105 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:39:27.230107 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:39:27.230402 (+ 295us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:39:27.230579 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0807 10:39:27.230859 (+ 280us) server_negotiation.cc:299] Negotiation successful
0807 10:39:27.231029 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260807 10:39:27.234758 2901 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40932:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 10:39:27.241369 2901 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 10:39:27.278868 3379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:27.252843 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.65:43563 (local address 127.0.0.1:50830)
0807 10:39:27.267118 (+ 14275us) negotiation.cc:107] Waiting for socket to connect
0807 10:39:27.267172 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0807 10:39:27.267422 (+ 250us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:39:27.268419 (+ 997us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:39:27.268427 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:39:27.268457 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:39:27.269130 (+ 673us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:39:27.269142 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:39:27.272030 (+ 2888us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:39:27.272039 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:39:27.275036 (+ 2997us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:39:27.275050 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:39:27.277550 (+ 2500us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:39:27.277560 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:39:27.277858 (+ 298us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:39:27.277935 (+ 77us) client_negotiation.cc:769] Sending connection context
0807 10:39:27.278075 (+ 140us) client_negotiation.cc:240] Negotiation successful
0807 10:39:27.278322 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13903,"thread_start_us":14736,"threads_started":1}
I20260807 10:39:27.280503 3378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:27.252909 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50830 (local address 127.20.171.65:43563)
0807 10:39:27.266587 (+ 13678us) server_negotiation.cc:206] Beginning negotiation
0807 10:39:27.266600 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 10:39:27.267686 (+ 1086us) server_negotiation.cc:407] Connection header received
0807 10:39:27.267855 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:39:27.267866 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:39:27.268170 (+ 304us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:39:27.269351 (+ 1181us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:39:27.269650 (+ 299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:27.271841 (+ 2191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:27.275280 (+ 3439us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:27.277296 (+ 2016us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:27.279479 (+ 2183us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:39:27.279792 (+ 313us) server_negotiation.cc:1035] Waiting for connection context
0807 10:39:27.279880 (+ 88us) server_negotiation.cc:299] Negotiation successful
0807 10:39:27.280085 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13422,"thread_start_us":13207,"threads_started":1}
I20260807 10:39:27.280917 3377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:27.253004 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.66:46259 (local address 127.0.0.1:40914)
0807 10:39:27.267889 (+ 14885us) negotiation.cc:107] Waiting for socket to connect
0807 10:39:27.267909 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0807 10:39:27.268019 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:39:27.269540 (+ 1521us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:39:27.269548 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:39:27.269580 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:39:27.270132 (+ 552us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:39:27.270148 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:39:27.272660 (+ 2512us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:39:27.272669 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:39:27.275741 (+ 3072us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:39:27.275761 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:39:27.279999 (+ 4238us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:39:27.280008 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:39:27.280224 (+ 216us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:39:27.280250 (+ 26us) client_negotiation.cc:769] Sending connection context
0807 10:39:27.280348 (+ 98us) client_negotiation.cc:240] Negotiation successful
0807 10:39:27.280479 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14753,"thread_start_us":13631,"threads_started":1}
I20260807 10:39:27.282122 3380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:27.253408 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40914 (local address 127.20.171.66:46259)
0807 10:39:27.268570 (+ 15162us) server_negotiation.cc:206] Beginning negotiation
0807 10:39:27.268579 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 10:39:27.268608 (+ 29us) server_negotiation.cc:407] Connection header received
0807 10:39:27.268733 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:39:27.268742 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:39:27.269015 (+ 273us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:39:27.269223 (+ 208us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:39:27.270369 (+ 1146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:27.272456 (+ 2087us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:27.275963 (+ 3507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:27.279424 (+ 3461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:27.279581 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:39:27.279830 (+ 249us) server_negotiation.cc:1035] Waiting for connection context
0807 10:39:27.281650 (+ 1820us) server_negotiation.cc:299] Negotiation successful
0807 10:39:27.281824 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14997,"thread_start_us":14850,"threads_started":1}
I20260807 10:39:27.286026 3161 tablet_service.cc:1467] Processing CreateTablet for tablet 739d76ac27324e5cbc53fcf653fe2c0b (DEFAULT_TABLE table=test-table [id=0918e3c6165b49dc8b3a7ed0331b08fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:39:27.286038 3025 tablet_service.cc:1467] Processing CreateTablet for tablet 739d76ac27324e5cbc53fcf653fe2c0b (DEFAULT_TABLE table=test-table [id=0918e3c6165b49dc8b3a7ed0331b08fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:39:27.287261 3161 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 739d76ac27324e5cbc53fcf653fe2c0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:39:27.287359 3025 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 739d76ac27324e5cbc53fcf653fe2c0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:39:27.290031 3379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:27.268580 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.67:37957 (local address 127.0.0.1:32814)
0807 10:39:27.279159 (+ 10579us) negotiation.cc:107] Waiting for socket to connect
0807 10:39:27.279180 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0807 10:39:27.279290 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:39:27.283537 (+ 4247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:39:27.283543 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:39:27.283570 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:39:27.283737 (+ 167us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:39:27.283748 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:39:27.285870 (+ 2122us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:39:27.285875 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:39:27.287654 (+ 1779us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:39:27.287689 (+ 35us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:39:27.289332 (+ 1643us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:39:27.289338 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:39:27.289487 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:39:27.289543 (+ 56us) client_negotiation.cc:769] Sending connection context
0807 10:39:27.289630 (+ 87us) client_negotiation.cc:240] Negotiation successful
0807 10:39:27.289772 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10461,"thread_start_us":14470,"threads_started":1}
I20260807 10:39:27.290288 3381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:27.268387 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32814 (local address 127.20.171.67:37957)
0807 10:39:27.282953 (+ 14566us) server_negotiation.cc:206] Beginning negotiation
0807 10:39:27.282961 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 10:39:27.282991 (+ 30us) server_negotiation.cc:407] Connection header received
0807 10:39:27.283081 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:39:27.283087 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:39:27.283307 (+ 220us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:39:27.283903 (+ 596us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:39:27.284179 (+ 276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:27.285715 (+ 1536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:27.287829 (+ 2114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:27.289187 (+ 1358us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:27.289303 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:39:27.289559 (+ 256us) server_negotiation.cc:1035] Waiting for connection context
0807 10:39:27.289687 (+ 128us) server_negotiation.cc:299] Negotiation successful
0807 10:39:27.289847 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14404,"thread_start_us":14256,"threads_started":1}
I20260807 10:39:27.293465 3297 tablet_service.cc:1467] Processing CreateTablet for tablet 739d76ac27324e5cbc53fcf653fe2c0b (DEFAULT_TABLE table=test-table [id=0918e3c6165b49dc8b3a7ed0331b08fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:39:27.294480 3297 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 739d76ac27324e5cbc53fcf653fe2c0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:39:27.301394 3383 tablet_bootstrap.cc:492] T 739d76ac27324e5cbc53fcf653fe2c0b P ffa4ec639b714cbc810bdfee1a63fdc9: Bootstrap starting.
I20260807 10:39:27.303493 3384 tablet_bootstrap.cc:492] T 739d76ac27324e5cbc53fcf653fe2c0b P 04bb6b53e9584b818b9c9d9ee43f3e17: Bootstrap starting.
I20260807 10:39:27.305136 3383 tablet_bootstrap.cc:654] T 739d76ac27324e5cbc53fcf653fe2c0b P ffa4ec639b714cbc810bdfee1a63fdc9: Neither blocks nor log segments found. Creating new log.
I20260807 10:39:27.306313 3384 tablet_bootstrap.cc:654] T 739d76ac27324e5cbc53fcf653fe2c0b P 04bb6b53e9584b818b9c9d9ee43f3e17: Neither blocks nor log segments found. Creating new log.
I20260807 10:39:27.306463 3383 log.cc:824] T 739d76ac27324e5cbc53fcf653fe2c0b P ffa4ec639b714cbc810bdfee1a63fdc9: Log is configured to *not* fsync() on all Append() calls
I20260807 10:39:27.307183 3385 tablet_bootstrap.cc:492] T 739d76ac27324e5cbc53fcf653fe2c0b P 1c127bab40a54ba6a8b7f42f14e3b068: Bootstrap starting.
I20260807 10:39:27.307552 3384 log.cc:824] T 739d76ac27324e5cbc53fcf653fe2c0b P 04bb6b53e9584b818b9c9d9ee43f3e17: Log is configured to *not* fsync() on all Append() calls
I20260807 10:39:27.310731 3384 tablet_bootstrap.cc:492] T 739d76ac27324e5cbc53fcf653fe2c0b P 04bb6b53e9584b818b9c9d9ee43f3e17: No bootstrap required, opened a new log
I20260807 10:39:27.310724 3385 tablet_bootstrap.cc:654] T 739d76ac27324e5cbc53fcf653fe2c0b P 1c127bab40a54ba6a8b7f42f14e3b068: Neither blocks nor log segments found. Creating new log.
I20260807 10:39:27.310807 3383 tablet_bootstrap.cc:492] T 739d76ac27324e5cbc53fcf653fe2c0b P ffa4ec639b714cbc810bdfee1a63fdc9: No bootstrap required, opened a new log
I20260807 10:39:27.311064 3383 ts_tablet_manager.cc:1397] T 739d76ac27324e5cbc53fcf653fe2c0b P ffa4ec639b714cbc810bdfee1a63fdc9: Time spent bootstrapping tablet: real 0.010s user 0.007s sys 0.000s
I20260807 10:39:27.311036 3384 ts_tablet_manager.cc:1397] T 739d76ac27324e5cbc53fcf653fe2c0b P 04bb6b53e9584b818b9c9d9ee43f3e17: Time spent bootstrapping tablet: real 0.008s user 0.003s sys 0.003s
I20260807 10:39:27.311967 3385 log.cc:824] T 739d76ac27324e5cbc53fcf653fe2c0b P 1c127bab40a54ba6a8b7f42f14e3b068: Log is configured to *not* fsync() on all Append() calls
I20260807 10:39:27.315397 3385 tablet_bootstrap.cc:492] T 739d76ac27324e5cbc53fcf653fe2c0b P 1c127bab40a54ba6a8b7f42f14e3b068: No bootstrap required, opened a new log
I20260807 10:39:27.315649 3385 ts_tablet_manager.cc:1397] T 739d76ac27324e5cbc53fcf653fe2c0b P 1c127bab40a54ba6a8b7f42f14e3b068: Time spent bootstrapping tablet: real 0.009s user 0.003s sys 0.004s
I20260807 10:39:27.319445 3384 raft_consensus.cc:348] T 739d76ac27324e5cbc53fcf653fe2c0b P 04bb6b53e9584b818b9c9d9ee43f3e17 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffa4ec639b714cbc810bdfee1a63fdc9" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 43563 } } peers { permanent_uuid: "04bb6b53e9584b818b9c9d9ee43f3e17" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 46259 } } peers { permanent_uuid: "1c127bab40a54ba6a8b7f42f14e3b068" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 37957 } }
I20260807 10:39:27.319772 3384 raft_consensus.cc:374] T 739d76ac27324e5cbc53fcf653fe2c0b P 04bb6b53e9584b818b9c9d9ee43f3e17 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:39:27.319887 3384 raft_consensus.cc:729] T 739d76ac27324e5cbc53fcf653fe2c0b P 04bb6b53e9584b818b9c9d9ee43f3e17 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04bb6b53e9584b818b9c9d9ee43f3e17, State: Initialized, Role: FOLLOWER
I20260807 10:39:27.320454 3384 consensus_queue.cc:260] T 739d76ac27324e5cbc53fcf653fe2c0b P 04bb6b53e9584b818b9c9d9ee43f3e17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffa4ec639b714cbc810bdfee1a63fdc9" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 43563 } } peers { permanent_uuid: "04bb6b53e9584b818b9c9d9ee43f3e17" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 46259 } } peers { permanent_uuid: "1c127bab40a54ba6a8b7f42f14e3b068" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 37957 } }
I20260807 10:39:27.321533 3228 heartbeater.cc:503] Master 127.20.171.126:38675 was elected leader, sending a full tablet report...
I20260807 10:39:27.321593 3383 raft_consensus.cc:348] T 739d76ac27324e5cbc53fcf653fe2c0b P ffa4ec639b714cbc810bdfee1a63fdc9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffa4ec639b714cbc810bdfee1a63fdc9" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 43563 } } peers { permanent_uuid: "04bb6b53e9584b818b9c9d9ee43f3e17" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 46259 } } peers { permanent_uuid: "1c127bab40a54ba6a8b7f42f14e3b068" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 37957 } }
I20260807 10:39:27.321965 3383 raft_consensus.cc:374] T 739d76ac27324e5cbc53fcf653fe2c0b P ffa4ec639b714cbc810bdfee1a63fdc9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:39:27.322069 3383 raft_consensus.cc:729] T 739d76ac27324e5cbc53fcf653fe2c0b P ffa4ec639b714cbc810bdfee1a63fdc9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ffa4ec639b714cbc810bdfee1a63fdc9, State: Initialized, Role: FOLLOWER
I20260807 10:39:27.322065 3384 ts_tablet_manager.cc:1428] T 739d76ac27324e5cbc53fcf653fe2c0b P 04bb6b53e9584b818b9c9d9ee43f3e17: Time spent starting tablet: real 0.011s user 0.011s sys 0.001s
I20260807 10:39:27.322562 3383 consensus_queue.cc:260] T 739d76ac27324e5cbc53fcf653fe2c0b P ffa4ec639b714cbc810bdfee1a63fdc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffa4ec639b714cbc810bdfee1a63fdc9" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 43563 } } peers { permanent_uuid: "04bb6b53e9584b818b9c9d9ee43f3e17" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 46259 } } peers { permanent_uuid: "1c127bab40a54ba6a8b7f42f14e3b068" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 37957 } }
I20260807 10:39:27.324081 3383 ts_tablet_manager.cc:1428] T 739d76ac27324e5cbc53fcf653fe2c0b P ffa4ec639b714cbc810bdfee1a63fdc9: Time spent starting tablet: real 0.013s user 0.010s sys 0.004s
I20260807 10:39:27.327137 3385 raft_consensus.cc:348] T 739d76ac27324e5cbc53fcf653fe2c0b P 1c127bab40a54ba6a8b7f42f14e3b068 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffa4ec639b714cbc810bdfee1a63fdc9" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 43563 } } peers { permanent_uuid: "04bb6b53e9584b818b9c9d9ee43f3e17" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 46259 } } peers { permanent_uuid: "1c127bab40a54ba6a8b7f42f14e3b068" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 37957 } }
I20260807 10:39:27.327548 3385 raft_consensus.cc:374] T 739d76ac27324e5cbc53fcf653fe2c0b P 1c127bab40a54ba6a8b7f42f14e3b068 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:39:27.327659 3385 raft_consensus.cc:729] T 739d76ac27324e5cbc53fcf653fe2c0b P 1c127bab40a54ba6a8b7f42f14e3b068 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c127bab40a54ba6a8b7f42f14e3b068, State: Initialized, Role: FOLLOWER
I20260807 10:39:27.328111 3385 consensus_queue.cc:260] T 739d76ac27324e5cbc53fcf653fe2c0b P 1c127bab40a54ba6a8b7f42f14e3b068 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffa4ec639b714cbc810bdfee1a63fdc9" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 43563 } } peers { permanent_uuid: "04bb6b53e9584b818b9c9d9ee43f3e17" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 46259 } } peers { permanent_uuid: "1c127bab40a54ba6a8b7f42f14e3b068" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 37957 } }
I20260807 10:39:27.329042 3364 heartbeater.cc:503] Master 127.20.171.126:38675 was elected leader, sending a full tablet report...
I20260807 10:39:27.329617 3385 ts_tablet_manager.cc:1428] T 739d76ac27324e5cbc53fcf653fe2c0b P 1c127bab40a54ba6a8b7f42f14e3b068: Time spent starting tablet: real 0.014s user 0.010s sys 0.003s
W20260807 10:39:27.398180 3092 tablet.cc:2369] T 739d76ac27324e5cbc53fcf653fe2c0b P ffa4ec639b714cbc810bdfee1a63fdc9: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 10:39:27.409199 3229 tablet.cc:2369] T 739d76ac27324e5cbc53fcf653fe2c0b P 04bb6b53e9584b818b9c9d9ee43f3e17: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 10:39:27.438133 3365 tablet.cc:2369] T 739d76ac27324e5cbc53fcf653fe2c0b P 1c127bab40a54ba6a8b7f42f14e3b068: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 10:39:27.695591 3391 raft_consensus.cc:482] T 739d76ac27324e5cbc53fcf653fe2c0b P 1c127bab40a54ba6a8b7f42f14e3b068 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 10:39:27.695852 3391 raft_consensus.cc:504] T 739d76ac27324e5cbc53fcf653fe2c0b P 1c127bab40a54ba6a8b7f42f14e3b068 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffa4ec639b714cbc810bdfee1a63fdc9" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 43563 } } peers { permanent_uuid: "04bb6b53e9584b818b9c9d9ee43f3e17" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 46259 } } peers { permanent_uuid: "1c127bab40a54ba6a8b7f42f14e3b068" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 37957 } }
I20260807 10:39:27.697619 3391 leader_election.cc:288] T 739d76ac27324e5cbc53fcf653fe2c0b P 1c127bab40a54ba6a8b7f42f14e3b068 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ffa4ec639b714cbc810bdfee1a63fdc9 (127.20.171.65:43563), 04bb6b53e9584b818b9c9d9ee43f3e17 (127.20.171.66:46259)
I20260807 10:39:27.702519 3390 raft_consensus.cc:482] T 739d76ac27324e5cbc53fcf653fe2c0b P ffa4ec639b714cbc810bdfee1a63fdc9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 10:39:27.702862 3390 raft_consensus.cc:504] T 739d76ac27324e5cbc53fcf653fe2c0b P ffa4ec639b714cbc810bdfee1a63fdc9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffa4ec639b714cbc810bdfee1a63fdc9" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 43563 } } peers { permanent_uuid: "04bb6b53e9584b818b9c9d9ee43f3e17" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 46259 } } peers { permanent_uuid: "1c127bab40a54ba6a8b7f42f14e3b068" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 37957 } }
I20260807 10:39:27.703675 3380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:27.698021 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.67:49039 (local address 127.20.171.66:46259)
0807 10:39:27.698255 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0807 10:39:27.698261 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:39:27.698365 (+ 104us) server_negotiation.cc:407] Connection header received
0807 10:39:27.698605 (+ 240us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:39:27.698612 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:39:27.698696 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:39:27.698797 (+ 101us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:39:27.699177 (+ 380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:27.699882 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:27.701639 (+ 1757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:27.702789 (+ 1150us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:27.702953 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:39:27.703022 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0807 10:39:27.703307 (+ 285us) server_negotiation.cc:299] Negotiation successful
0807 10:39:27.703425 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260807 10:39:27.703675 3367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:27.697933 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.66:46259 (local address 127.20.171.67:49039)
0807 10:39:27.698262 (+ 329us) negotiation.cc:107] Waiting for socket to connect
0807 10:39:27.698281 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 10:39:27.698444 (+ 163us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:39:27.698819 (+ 375us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:39:27.698823 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:39:27.698863 (+ 40us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:39:27.699048 (+ 185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:39:27.699056 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:39:27.700028 (+ 972us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:39:27.700033 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:39:27.701493 (+ 1460us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:39:27.701504 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:39:27.702945 (+ 1441us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:39:27.702950 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:39:27.703160 (+ 210us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:39:27.703191 (+ 31us) client_negotiation.cc:769] Sending connection context
0807 10:39:27.703281 (+ 90us) client_negotiation.cc:240] Negotiation successful
0807 10:39:27.703416 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":225}
I20260807 10:39:27.705053 3378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:27.697921 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.67:38777 (local address 127.20.171.65:43563)
0807 10:39:27.698139 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0807 10:39:27.698166 (+ 27us) server_negotiation.cc:399] Waiting for connection header
0807 10:39:27.698807 (+ 641us) server_negotiation.cc:407] Connection header received
0807 10:39:27.699023 (+ 216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:39:27.699027 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:39:27.699087 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:39:27.699185 (+ 98us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:39:27.699748 (+ 563us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:27.700483 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:27.702477 (+ 1994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:27.703861 (+ 1384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:27.704017 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:39:27.704083 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0807 10:39:27.704632 (+ 549us) server_negotiation.cc:299] Negotiation successful
0807 10:39:27.704782 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260807 10:39:27.705061 3392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:27.697962 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.65:43563 (local address 127.20.171.67:38777)
0807 10:39:27.698693 (+ 731us) negotiation.cc:107] Waiting for socket to connect
0807 10:39:27.698707 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 10:39:27.698861 (+ 154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:39:27.699219 (+ 358us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:39:27.699223 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:39:27.699250 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:39:27.699587 (+ 337us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:39:27.699595 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:39:27.700631 (+ 1036us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:39:27.700636 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:39:27.702292 (+ 1656us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:39:27.702307 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:39:27.704224 (+ 1917us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:39:27.704230 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:39:27.704419 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:39:27.704461 (+ 42us) client_negotiation.cc:769] Sending connection context
0807 10:39:27.704560 (+ 99us) client_negotiation.cc:240] Negotiation successful
0807 10:39:27.704680 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":607,"thread_start_us":455,"threads_started":1}
I20260807 10:39:27.704907 3182 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "739d76ac27324e5cbc53fcf653fe2c0b" candidate_uuid: "1c127bab40a54ba6a8b7f42f14e3b068" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04bb6b53e9584b818b9c9d9ee43f3e17" is_pre_election: true
I20260807 10:39:27.705482 3182 raft_consensus.cc:2454] T 739d76ac27324e5cbc53fcf653fe2c0b P 04bb6b53e9584b818b9c9d9ee43f3e17 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c127bab40a54ba6a8b7f42f14e3b068 in term 0.
I20260807 10:39:27.706244 3250 leader_election.cc:302] T 739d76ac27324e5cbc53fcf653fe2c0b P 1c127bab40a54ba6a8b7f42f14e3b068 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04bb6b53e9584b818b9c9d9ee43f3e17, 1c127bab40a54ba6a8b7f42f14e3b068; no voters:
I20260807 10:39:27.706168 3045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "739d76ac27324e5cbc53fcf653fe2c0b" candidate_uuid: "1c127bab40a54ba6a8b7f42f14e3b068" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ffa4ec639b714cbc810bdfee1a63fdc9" is_pre_election: true
I20260807 10:39:27.706671 3391 raft_consensus.cc:2781] T 739d76ac27324e5cbc53fcf653fe2c0b P 1c127bab40a54ba6a8b7f42f14e3b068 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 10:39:27.706745 3045 raft_consensus.cc:2454] T 739d76ac27324e5cbc53fcf653fe2c0b P ffa4ec639b714cbc810bdfee1a63fdc9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c127bab40a54ba6a8b7f42f14e3b068 in term 0.
I20260807 10:39:27.706849 3391 raft_consensus.cc:482] T 739d76ac27324e5cbc53fcf653fe2c0b P 1c127bab40a54ba6a8b7f42f14e3b068 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 10:39:27.706943 3391 raft_consensus.cc:3037] T 739d76ac27324e5cbc53fcf653fe2c0b P 1c127bab40a54ba6a8b7f42f14e3b068 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:39:27.707352 3390 leader_election.cc:288] T 739d76ac27324e5cbc53fcf653fe2c0b P ffa4ec639b714cbc810bdfee1a63fdc9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04bb6b53e9584b818b9c9d9ee43f3e17 (127.20.171.66:46259), 1c127bab40a54ba6a8b7f42f14e3b068 (127.20.171.67:37957)
I20260807 10:39:27.710016 3391 raft_consensus.cc:504] T 739d76ac27324e5cbc53fcf653fe2c0b P 1c127bab40a54ba6a8b7f42f14e3b068 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffa4ec639b714cbc810bdfee1a63fdc9" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 43563 } } peers { permanent_uuid: "04bb6b53e9584b818b9c9d9ee43f3e17" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 46259 } } peers { permanent_uuid: "1c127bab40a54ba6a8b7f42f14e3b068" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 37957 } }
I20260807 10:39:27.710708 3391 leader_election.cc:288] T 739d76ac27324e5cbc53fcf653fe2c0b P 1c127bab40a54ba6a8b7f42f14e3b068 [CANDIDATE]: Term 1 election: Requested vote from peers ffa4ec639b714cbc810bdfee1a63fdc9 (127.20.171.65:43563), 04bb6b53e9584b818b9c9d9ee43f3e17 (127.20.171.66:46259)
I20260807 10:39:27.711163 3045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "739d76ac27324e5cbc53fcf653fe2c0b" candidate_uuid: "1c127bab40a54ba6a8b7f42f14e3b068" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ffa4ec639b714cbc810bdfee1a63fdc9"
I20260807 10:39:27.711391 3045 raft_consensus.cc:3037] T 739d76ac27324e5cbc53fcf653fe2c0b P ffa4ec639b714cbc810bdfee1a63fdc9 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:39:27.711407 3182 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "739d76ac27324e5cbc53fcf653fe2c0b" candidate_uuid: "1c127bab40a54ba6a8b7f42f14e3b068" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04bb6b53e9584b818b9c9d9ee43f3e17"
I20260807 10:39:27.711617 3182 raft_consensus.cc:3037] T 739d76ac27324e5cbc53fcf653fe2c0b P 04bb6b53e9584b818b9c9d9ee43f3e17 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:39:27.714509 3393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:27.705233 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.66:46259 (local address 127.20.171.65:59389)
0807 10:39:27.706608 (+ 1375us) negotiation.cc:107] Waiting for socket to connect
0807 10:39:27.706628 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0807 10:39:27.706838 (+ 210us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:39:27.707351 (+ 513us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:39:27.707356 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:39:27.707381 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:39:27.707825 (+ 444us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:39:27.707836 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:39:27.709801 (+ 1965us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:39:27.709808 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:39:27.711819 (+ 2011us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:39:27.711840 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:39:27.713716 (+ 1876us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:39:27.713724 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:39:27.713903 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:39:27.713950 (+ 47us) client_negotiation.cc:769] Sending connection context
0807 10:39:27.714024 (+ 74us) client_negotiation.cc:240] Negotiation successful
0807 10:39:27.714151 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1230,"thread_start_us":1003,"threads_started":1}
I20260807 10:39:27.714951 3045 raft_consensus.cc:2454] T 739d76ac27324e5cbc53fcf653fe2c0b P ffa4ec639b714cbc810bdfee1a63fdc9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c127bab40a54ba6a8b7f42f14e3b068 in term 1.
I20260807 10:39:27.715075 3182 raft_consensus.cc:2454] T 739d76ac27324e5cbc53fcf653fe2c0b P 04bb6b53e9584b818b9c9d9ee43f3e17 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c127bab40a54ba6a8b7f42f14e3b068 in term 1.
I20260807 10:39:27.715371 3380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:27.705639 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.65:59389 (local address 127.20.171.66:46259)
0807 10:39:27.705842 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0807 10:39:27.705847 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:39:27.706697 (+ 850us) server_negotiation.cc:407] Connection header received
0807 10:39:27.707010 (+ 313us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:39:27.707016 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:39:27.707077 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:39:27.707183 (+ 106us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:39:27.707962 (+ 779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:27.709696 (+ 1734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:27.712033 (+ 2337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:27.713447 (+ 1414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:27.714786 (+ 1339us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:39:27.714873 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0807 10:39:27.714926 (+ 53us) server_negotiation.cc:299] Negotiation successful
0807 10:39:27.715063 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90}
I20260807 10:39:27.715571 3250 leader_election.cc:302] T 739d76ac27324e5cbc53fcf653fe2c0b P 1c127bab40a54ba6a8b7f42f14e3b068 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04bb6b53e9584b818b9c9d9ee43f3e17, 1c127bab40a54ba6a8b7f42f14e3b068; no voters:
I20260807 10:39:27.716090 3381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:27.708581 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.65:40105 (local address 127.20.171.67:37957)
0807 10:39:27.708809 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0807 10:39:27.708816 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:39:27.708837 (+ 21us) server_negotiation.cc:407] Connection header received
0807 10:39:27.708886 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:39:27.708890 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:39:27.708953 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:39:27.709053 (+ 100us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:39:27.709633 (+ 580us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:27.710751 (+ 1118us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:27.713678 (+ 2927us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:27.714917 (+ 1239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:27.715051 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:39:27.715131 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0807 10:39:27.715727 (+ 596us) server_negotiation.cc:299] Negotiation successful
0807 10:39:27.715858 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260807 10:39:27.716162 3394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:27.707907 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.67:37957 (local address 127.20.171.65:40105)
0807 10:39:27.708605 (+ 698us) negotiation.cc:107] Waiting for socket to connect
0807 10:39:27.708624 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 10:39:27.708737 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:39:27.709066 (+ 329us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:39:27.709071 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:39:27.709096 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:39:27.709435 (+ 339us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:39:27.709446 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:39:27.710994 (+ 1548us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:39:27.710999 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:39:27.713501 (+ 2502us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:39:27.713516 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:39:27.715342 (+ 1826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:39:27.715348 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:39:27.715512 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:39:27.715543 (+ 31us) client_negotiation.cc:769] Sending connection context
0807 10:39:27.715680 (+ 137us) client_negotiation.cc:240] Negotiation successful
0807 10:39:27.715805 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":571,"thread_start_us":355,"threads_started":1}
I20260807 10:39:27.716274 3391 raft_consensus.cc:2781] T 739d76ac27324e5cbc53fcf653fe2c0b P 1c127bab40a54ba6a8b7f42f14e3b068 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:39:27.716826 3391 raft_consensus.cc:686] T 739d76ac27324e5cbc53fcf653fe2c0b P 1c127bab40a54ba6a8b7f42f14e3b068 [term 1 LEADER]: Becoming Leader. State: Replica: 1c127bab40a54ba6a8b7f42f14e3b068, State: Running, Role: LEADER
I20260807 10:39:27.717339 3318 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "739d76ac27324e5cbc53fcf653fe2c0b" candidate_uuid: "ffa4ec639b714cbc810bdfee1a63fdc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c127bab40a54ba6a8b7f42f14e3b068" is_pre_election: true
I20260807 10:39:27.717446 3391 consensus_queue.cc:237] T 739d76ac27324e5cbc53fcf653fe2c0b P 1c127bab40a54ba6a8b7f42f14e3b068 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffa4ec639b714cbc810bdfee1a63fdc9" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 43563 } } peers { permanent_uuid: "04bb6b53e9584b818b9c9d9ee43f3e17" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 46259 } } peers { permanent_uuid: "1c127bab40a54ba6a8b7f42f14e3b068" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 37957 } }
I20260807 10:39:27.716804 3182 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "739d76ac27324e5cbc53fcf653fe2c0b" candidate_uuid: "ffa4ec639b714cbc810bdfee1a63fdc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04bb6b53e9584b818b9c9d9ee43f3e17" is_pre_election: true
I20260807 10:39:27.718513 3182 raft_consensus.cc:2379] T 739d76ac27324e5cbc53fcf653fe2c0b P 04bb6b53e9584b818b9c9d9ee43f3e17 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ffa4ec639b714cbc810bdfee1a63fdc9 in current term 1: Already voted for candidate 1c127bab40a54ba6a8b7f42f14e3b068 in this term.
I20260807 10:39:27.719094 2979 leader_election.cc:302] T 739d76ac27324e5cbc53fcf653fe2c0b P ffa4ec639b714cbc810bdfee1a63fdc9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ffa4ec639b714cbc810bdfee1a63fdc9; no voters: 04bb6b53e9584b818b9c9d9ee43f3e17, 1c127bab40a54ba6a8b7f42f14e3b068
I20260807 10:39:27.719513 3390 raft_consensus.cc:2726] T 739d76ac27324e5cbc53fcf653fe2c0b P ffa4ec639b714cbc810bdfee1a63fdc9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 10:39:27.722328 2901 catalog_manager.cc:5495] T 739d76ac27324e5cbc53fcf653fe2c0b P 1c127bab40a54ba6a8b7f42f14e3b068 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1c127bab40a54ba6a8b7f42f14e3b068 (127.20.171.67). New cstate: current_term: 1 leader_uuid: "1c127bab40a54ba6a8b7f42f14e3b068" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffa4ec639b714cbc810bdfee1a63fdc9" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 43563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04bb6b53e9584b818b9c9d9ee43f3e17" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 46259 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c127bab40a54ba6a8b7f42f14e3b068" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 37957 } health_report { overall_health: HEALTHY } } }
I20260807 10:39:27.824685 3381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:27.819045 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32816 (local address 127.20.171.67:37957)
0807 10:39:27.819197 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0807 10:39:27.819201 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 10:39:27.819664 (+ 463us) server_negotiation.cc:407] Connection header received
0807 10:39:27.819850 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:39:27.819853 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:39:27.819937 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:39:27.820060 (+ 123us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 10:39:27.820466 (+ 406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:27.821113 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:27.822515 (+ 1402us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:27.823030 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:27.823120 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:39:27.823559 (+ 439us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 10:39:27.824047 (+ 488us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 10:39:27.824146 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0807 10:39:27.824290 (+ 144us) server_negotiation.cc:299] Negotiation successful
0807 10:39:27.824363 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260807 10:39:27.832469 3182 raft_consensus.cc:1261] T 739d76ac27324e5cbc53fcf653fe2c0b P 04bb6b53e9584b818b9c9d9ee43f3e17 [term 1 FOLLOWER]: Refusing update from remote peer 1c127bab40a54ba6a8b7f42f14e3b068: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 10:39:27.832516 3045 raft_consensus.cc:1261] T 739d76ac27324e5cbc53fcf653fe2c0b P ffa4ec639b714cbc810bdfee1a63fdc9 [term 1 FOLLOWER]: Refusing update from remote peer 1c127bab40a54ba6a8b7f42f14e3b068: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 10:39:27.833364 3395 consensus_queue.cc:1035] T 739d76ac27324e5cbc53fcf653fe2c0b P 1c127bab40a54ba6a8b7f42f14e3b068 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ffa4ec639b714cbc810bdfee1a63fdc9" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 43563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 10:39:27.833686 3391 consensus_queue.cc:1035] T 739d76ac27324e5cbc53fcf653fe2c0b P 1c127bab40a54ba6a8b7f42f14e3b068 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04bb6b53e9584b818b9c9d9ee43f3e17" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 46259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 10:39:27.843879 3399 mvcc.cc:205] Tried to move back new op lower bound from 7315862191432331264 to 7315862190975856640. Current Snapshot: MvccSnapshot[applied={T|T < 7315862191432331264}]
I20260807 10:39:27.845274 3402 mvcc.cc:205] Tried to move back new op lower bound from 7315862191432331264 to 7315862190975856640. Current Snapshot: MvccSnapshot[applied={T|T < 7315862191432331264}]
I20260807 10:39:27.858294 2899 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40932:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 10:39:27.858546 2899 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40932:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 10:39:27.861851 2899 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ef15abefda7940d1a2bf5dacba18eace: Sending DeleteTablet for 3 replicas of tablet 739d76ac27324e5cbc53fcf653fe2c0b
I20260807 10:39:27.862987 3297 tablet_service.cc:1514] Processing DeleteTablet for tablet 739d76ac27324e5cbc53fcf653fe2c0b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:39:27 UTC) from {username='kudu', principal='kudu/127.20.171.126@KRBTEST.COM'} at 127.0.0.1:32814
I20260807 10:39:27.863018 3161 tablet_service.cc:1514] Processing DeleteTablet for tablet 739d76ac27324e5cbc53fcf653fe2c0b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:39:27 UTC) from {username='kudu', principal='kudu/127.20.171.126@KRBTEST.COM'} at 127.0.0.1:40914
I20260807 10:39:27.863178 3025 tablet_service.cc:1514] Processing DeleteTablet for tablet 739d76ac27324e5cbc53fcf653fe2c0b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:39:27 UTC) from {username='kudu', principal='kudu/127.20.171.126@KRBTEST.COM'} at 127.0.0.1:50830
I20260807 10:39:27.863636 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 2962
I20260807 10:39:27.875507 3410 tablet_replica.cc:330] T 739d76ac27324e5cbc53fcf653fe2c0b P 1c127bab40a54ba6a8b7f42f14e3b068: stopping tablet replica
I20260807 10:39:27.876135 3410 raft_consensus.cc:2229] T 739d76ac27324e5cbc53fcf653fe2c0b P 1c127bab40a54ba6a8b7f42f14e3b068 [term 1 LEADER]: Raft consensus shutting down.
I20260807 10:39:27.877166 3410 raft_consensus.cc:2258] T 739d76ac27324e5cbc53fcf653fe2c0b P 1c127bab40a54ba6a8b7f42f14e3b068 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:39:27.879201 3411 tablet_replica.cc:330] T 739d76ac27324e5cbc53fcf653fe2c0b P 04bb6b53e9584b818b9c9d9ee43f3e17: stopping tablet replica
I20260807 10:39:27.879577 3411 raft_consensus.cc:2229] T 739d76ac27324e5cbc53fcf653fe2c0b P 04bb6b53e9584b818b9c9d9ee43f3e17 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 10:39:27.880064 3411 raft_consensus.cc:2258] T 739d76ac27324e5cbc53fcf653fe2c0b P 04bb6b53e9584b818b9c9d9ee43f3e17 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:39:27.880162 3412 tablet_replica.cc:330] T 739d76ac27324e5cbc53fcf653fe2c0b P ffa4ec639b714cbc810bdfee1a63fdc9: stopping tablet replica
I20260807 10:39:27.880592 3410 ts_tablet_manager.cc:1905] T 739d76ac27324e5cbc53fcf653fe2c0b P 1c127bab40a54ba6a8b7f42f14e3b068: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 10:39:27.880568 3412 raft_consensus.cc:2229] T 739d76ac27324e5cbc53fcf653fe2c0b P ffa4ec639b714cbc810bdfee1a63fdc9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 10:39:27.881042 3412 raft_consensus.cc:2258] T 739d76ac27324e5cbc53fcf653fe2c0b P ffa4ec639b714cbc810bdfee1a63fdc9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:39:27.882659 3412 ts_tablet_manager.cc:1905] T 739d76ac27324e5cbc53fcf653fe2c0b P ffa4ec639b714cbc810bdfee1a63fdc9: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 07 10:39:27 dist-test-slave-0b58 krb5kdc[2856](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099165, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.171.65@KRBTEST.COM
I20260807 10:39:27.889242 3410 ts_tablet_manager.cc:1918] T 739d76ac27324e5cbc53fcf653fe2c0b P 1c127bab40a54ba6a8b7f42f14e3b068: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 10:39:27.889503 3410 log.cc:1196] T 739d76ac27324e5cbc53fcf653fe2c0b P 1c127bab40a54ba6a8b7f42f14e3b068: Deleting WAL directory at /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/ts-2/wal/wals/739d76ac27324e5cbc53fcf653fe2c0b
I20260807 10:39:27.889425 3412 ts_tablet_manager.cc:1918] T 739d76ac27324e5cbc53fcf653fe2c0b P ffa4ec639b714cbc810bdfee1a63fdc9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 10:39:27.889624 3412 log.cc:1196] T 739d76ac27324e5cbc53fcf653fe2c0b P ffa4ec639b714cbc810bdfee1a63fdc9: Deleting WAL directory at /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/ts-0/wal/wals/739d76ac27324e5cbc53fcf653fe2c0b
I20260807 10:39:27.890162 3412 ts_tablet_manager.cc:1939] T 739d76ac27324e5cbc53fcf653fe2c0b P ffa4ec639b714cbc810bdfee1a63fdc9: Deleting consensus metadata
I20260807 10:39:27.890569 3410 ts_tablet_manager.cc:1939] T 739d76ac27324e5cbc53fcf653fe2c0b P 1c127bab40a54ba6a8b7f42f14e3b068: Deleting consensus metadata
I20260807 10:39:27.892112 2885 catalog_manager.cc:4841] TS ffa4ec639b714cbc810bdfee1a63fdc9 (127.20.171.65:43563): tablet 739d76ac27324e5cbc53fcf653fe2c0b (table test-table [id=0918e3c6165b49dc8b3a7ed0331b08fb]) successfully deleted
I20260807 10:39:27.892304 3411 ts_tablet_manager.cc:1905] T 739d76ac27324e5cbc53fcf653fe2c0b P 04bb6b53e9584b818b9c9d9ee43f3e17: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 10:39:27.892594 2885 catalog_manager.cc:4841] TS 1c127bab40a54ba6a8b7f42f14e3b068 (127.20.171.67:37957): tablet 739d76ac27324e5cbc53fcf653fe2c0b (table test-table [id=0918e3c6165b49dc8b3a7ed0331b08fb]) successfully deleted
I20260807 10:39:27.897604 3378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:27.865074 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50834 (local address 127.20.171.65:43563)
0807 10:39:27.865315 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0807 10:39:27.865325 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 10:39:27.875672 (+ 10347us) server_negotiation.cc:407] Connection header received
0807 10:39:27.876093 (+ 421us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:39:27.876098 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:39:27.876196 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:39:27.876312 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:39:27.880479 (+ 4167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:27.881686 (+ 1207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:27.883674 (+ 1988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:27.884428 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:27.884534 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:39:27.890236 (+ 5702us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:39:27.890252 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:39:27.890271 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:39:27.890316 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:39:27.894127 (+ 3811us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:39:27.895074 (+ 947us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:39:27.895083 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:39:27.895086 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:39:27.895247 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:39:27.895765 (+ 518us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:39:27.895771 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:39:27.895774 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:39:27.896195 (+ 421us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:39:27.896561 (+ 366us) server_negotiation.cc:1035] Waiting for connection context
0807 10:39:27.896935 (+ 374us) server_negotiation.cc:299] Negotiation successful
0807 10:39:27.897168 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260807 10:39:27.898290 3086 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:39:27.898988 3411 ts_tablet_manager.cc:1918] T 739d76ac27324e5cbc53fcf653fe2c0b P 04bb6b53e9584b818b9c9d9ee43f3e17: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 10:39:27.899199 3411 log.cc:1196] T 739d76ac27324e5cbc53fcf653fe2c0b P 04bb6b53e9584b818b9c9d9ee43f3e17: Deleting WAL directory at /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/ts-1/wal/wals/739d76ac27324e5cbc53fcf653fe2c0b
I20260807 10:39:27.899834 3411 ts_tablet_manager.cc:1939] T 739d76ac27324e5cbc53fcf653fe2c0b P 04bb6b53e9584b818b9c9d9ee43f3e17: Deleting consensus metadata
I20260807 10:39:27.901964 2886 catalog_manager.cc:4841] TS 04bb6b53e9584b818b9c9d9ee43f3e17 (127.20.171.66:46259): tablet 739d76ac27324e5cbc53fcf653fe2c0b (table test-table [id=0918e3c6165b49dc8b3a7ed0331b08fb]) successfully deleted
I20260807 10:39:27.990725 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 2962
I20260807 10:39:28.013149 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 3098
Aug 07 10:39:28 dist-test-slave-0b58 krb5kdc[2856](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099165, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.171.66@KRBTEST.COM
I20260807 10:39:28.029399 3380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:28.013988 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40918 (local address 127.20.171.66:46259)
0807 10:39:28.014168 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0807 10:39:28.014174 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:39:28.014193 (+ 19us) server_negotiation.cc:407] Connection header received
0807 10:39:28.014370 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:39:28.014376 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:39:28.014457 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:39:28.014578 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:39:28.015791 (+ 1213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:28.016996 (+ 1205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:28.018407 (+ 1411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:28.019051 (+ 644us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:28.019163 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:39:28.023766 (+ 4603us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:39:28.023781 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:39:28.023796 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:39:28.023826 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:39:28.026738 (+ 2912us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:39:28.027523 (+ 785us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:39:28.027530 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:39:28.027532 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:39:28.027646 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:39:28.028037 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:39:28.028039 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:39:28.028041 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:39:28.028418 (+ 377us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:39:28.028627 (+ 209us) server_negotiation.cc:1035] Waiting for connection context
0807 10:39:28.028962 (+ 335us) server_negotiation.cc:299] Negotiation successful
0807 10:39:28.029108 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260807 10:39:28.030157 3223 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:39:28.120462 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 3098
I20260807 10:39:28.146536 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 3233
Aug 07 10:39:28 dist-test-slave-0b58 krb5kdc[2856](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099165, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.171.67@KRBTEST.COM
I20260807 10:39:28.165966 3381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:28.147390 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32824 (local address 127.20.171.67:37957)
0807 10:39:28.147595 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0807 10:39:28.147600 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:39:28.147641 (+ 41us) server_negotiation.cc:407] Connection header received
0807 10:39:28.147896 (+ 255us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:39:28.147900 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:39:28.147975 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:39:28.148060 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:39:28.149818 (+ 1758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:28.150522 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:28.152396 (+ 1874us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:28.152835 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:28.152924 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:39:28.158625 (+ 5701us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:39:28.158644 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:39:28.158674 (+ 30us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:39:28.158738 (+ 64us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:39:28.162847 (+ 4109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:39:28.163562 (+ 715us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:39:28.163574 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:39:28.163578 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:39:28.163777 (+ 199us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:39:28.164207 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:39:28.164212 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:39:28.164215 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:39:28.164747 (+ 532us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:39:28.165083 (+ 336us) server_negotiation.cc:1035] Waiting for connection context
0807 10:39:28.165349 (+ 266us) server_negotiation.cc:299] Negotiation successful
0807 10:39:28.165587 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260807 10:39:28.166796 3359 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:39:28.294152 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 3233
I20260807 10:39:28.317173 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 2869
I20260807 10:39:28.318430 2931 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:39:28.426258 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 2869
I20260807 10:39:28.451808 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.171.126:38675
--webserver_interface=127.20.171.126
--webserver_port=40653
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.126.keytab
--principal=kudu/127.20.171.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.171.84:41719
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.171.126:38675
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:39:28.790081 3418 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:39:28.790349 3418 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:39:28.790518 3418 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:39:28.797533 3418 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 10:39:28.797678 3418 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:39:28.797787 3418 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:39:28.797902 3418 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 10:39:28.797986 3418 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 10:39:28.807488 3418 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.171.84:41719
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.20.171.126:38675
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.126.keytab
--principal=kudu/127.20.171.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.171.126:38675
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.171.126
--webserver_port=40653
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:39:28.808764 3418 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:39:28.810110 3418 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:39:28.835937 3425 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:39:28.836063 3424 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:39:28.836040 3427 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:39:28.836772 3418 server_base.cc:1034] running on GCE node
I20260807 10:39:28.837636 3418 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:39:28.839178 3418 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:39:28.840368 3418 hybrid_clock.cc:648] HybridClock initialized: now 1786099168840293 us; error 56 us; skew 500 ppm
I20260807 10:39:28.840824 3418 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:39:28 dist-test-slave-0b58 krb5kdc[2856](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099168, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:39:28.844292 3418 init.cc:377] Logged in from keytab as kudu/127.20.171.126@KRBTEST.COM (short username kudu)
I20260807 10:39:28.845826 3418 webserver.cc:460] Webserver started at http://127.20.171.126:40653/ using document root <none> and password file <none>
I20260807 10:39:28.846637 3418 fs_manager.cc:359] Metadata directory not provided
I20260807 10:39:28.846819 3418 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:39:28.852612 3418 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.002s sys 0.001s
I20260807 10:39:28.855485 3434 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:39:28.856899 3418 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 10:39:28.857089 3418 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/master-0/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/master-0/wal
uuid: "ef15abefda7940d1a2bf5dacba18eace"
format_stamp: "Formatted at 2026-08-07 10:39:25 on dist-test-slave-0b58"
server_key: "5caabc34a06b6bd79f27a88f8a43dc6f"
server_key_iv: "18adc8d358f530959f6d572240c70135"
server_key_version: "encryptionkey@0"
I20260807 10:39:28.858197 3418 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:39:28.873317 3418 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:39:28.877353 3418 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:39:28.877642 3418 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:39:28.896788 3418 rpc_server.cc:307] RPC server started. Bound to: 127.20.171.126:38675
I20260807 10:39:28.896809 3487 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.171.126:38675 every 8 connection(s)
I20260807 10:39:28.898331 3418 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
I20260807 10:39:28.901108 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 3418
I20260807 10:39:28.902056 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.171.65:43563
--local_ip_for_outbound_sockets=127.20.171.65
--tserver_master_addrs=127.20.171.126:38675
--webserver_port=34755
--webserver_interface=127.20.171.65
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.65.keytab
--principal=kudu/127.20.171.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.171.84:41719
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 10:39:28.907297 3488 sys_catalog.cc:263] Verifying existing consensus state
I20260807 10:39:28.912189 3488 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ef15abefda7940d1a2bf5dacba18eace: Bootstrap starting.
I20260807 10:39:28.933430 3488 log.cc:824] T 00000000000000000000000000000000 P ef15abefda7940d1a2bf5dacba18eace: Log is configured to *not* fsync() on all Append() calls
I20260807 10:39:28.945367 3488 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ef15abefda7940d1a2bf5dacba18eace: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 10:39:28.945904 3488 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ef15abefda7940d1a2bf5dacba18eace: Bootstrap complete.
I20260807 10:39:28.955478 3488 raft_consensus.cc:348] T 00000000000000000000000000000000 P ef15abefda7940d1a2bf5dacba18eace [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ef15abefda7940d1a2bf5dacba18eace" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 38675 } }
I20260807 10:39:28.956432 3488 raft_consensus.cc:729] T 00000000000000000000000000000000 P ef15abefda7940d1a2bf5dacba18eace [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef15abefda7940d1a2bf5dacba18eace, State: Initialized, Role: FOLLOWER
I20260807 10:39:28.957105 3488 consensus_queue.cc:260] T 00000000000000000000000000000000 P ef15abefda7940d1a2bf5dacba18eace [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ef15abefda7940d1a2bf5dacba18eace" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 38675 } }
I20260807 10:39:28.957427 3488 raft_consensus.cc:388] T 00000000000000000000000000000000 P ef15abefda7940d1a2bf5dacba18eace [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 10:39:28.957554 3488 raft_consensus.cc:482] T 00000000000000000000000000000000 P ef15abefda7940d1a2bf5dacba18eace [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 10:39:28.957742 3488 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ef15abefda7940d1a2bf5dacba18eace [term 1 FOLLOWER]: Advancing to term 2
I20260807 10:39:28.961680 3488 raft_consensus.cc:504] T 00000000000000000000000000000000 P ef15abefda7940d1a2bf5dacba18eace [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ef15abefda7940d1a2bf5dacba18eace" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 38675 } }
I20260807 10:39:28.962250 3488 leader_election.cc:302] T 00000000000000000000000000000000 P ef15abefda7940d1a2bf5dacba18eace [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ef15abefda7940d1a2bf5dacba18eace; no voters:
I20260807 10:39:28.963035 3488 leader_election.cc:288] T 00000000000000000000000000000000 P ef15abefda7940d1a2bf5dacba18eace [CANDIDATE]: Term 2 election: Requested vote from peers
I20260807 10:39:28.963186 3492 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ef15abefda7940d1a2bf5dacba18eace [term 2 FOLLOWER]: Leader election won for term 2
I20260807 10:39:28.964510 3492 raft_consensus.cc:686] T 00000000000000000000000000000000 P ef15abefda7940d1a2bf5dacba18eace [term 2 LEADER]: Becoming Leader. State: Replica: ef15abefda7940d1a2bf5dacba18eace, State: Running, Role: LEADER
I20260807 10:39:28.965171 3492 consensus_queue.cc:237] T 00000000000000000000000000000000 P ef15abefda7940d1a2bf5dacba18eace [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ef15abefda7940d1a2bf5dacba18eace" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 38675 } }
I20260807 10:39:28.965433 3488 sys_catalog.cc:564] T 00000000000000000000000000000000 P ef15abefda7940d1a2bf5dacba18eace [sys.catalog]: configured and running, proceeding with master startup.
I20260807 10:39:28.967834 3493 sys_catalog.cc:455] T 00000000000000000000000000000000 P ef15abefda7940d1a2bf5dacba18eace [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "ef15abefda7940d1a2bf5dacba18eace" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ef15abefda7940d1a2bf5dacba18eace" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 38675 } } }
I20260807 10:39:28.968299 3493 sys_catalog.cc:458] T 00000000000000000000000000000000 P ef15abefda7940d1a2bf5dacba18eace [sys.catalog]: This master's current role is: LEADER
I20260807 10:39:28.970654 3494 sys_catalog.cc:455] T 00000000000000000000000000000000 P ef15abefda7940d1a2bf5dacba18eace [sys.catalog]: SysCatalogTable state changed. Reason: New leader ef15abefda7940d1a2bf5dacba18eace. Latest consensus state: current_term: 2 leader_uuid: "ef15abefda7940d1a2bf5dacba18eace" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ef15abefda7940d1a2bf5dacba18eace" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 38675 } } }
I20260807 10:39:28.971066 3494 sys_catalog.cc:458] T 00000000000000000000000000000000 P ef15abefda7940d1a2bf5dacba18eace [sys.catalog]: This master's current role is: LEADER
I20260807 10:39:28.972601 3498 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 10:39:28.981032 3498 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 10:39:28.982373 3498 catalog_manager.cc:1259] Loaded cluster ID: 2caa8cd5a5b94bee96036c9c836bf92c
I20260807 10:39:28.982519 3498 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 10:39:28.985586 3498 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260807 10:39:29.002538 3498 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260807 10:39:29.022209 3498 catalog_manager.cc:1504] Loading token signing keys...
I20260807 10:39:29.023873 3498 catalog_manager.cc:5879] T 00000000000000000000000000000000 P ef15abefda7940d1a2bf5dacba18eace: Loaded TSK: 0
I20260807 10:39:29.025488 3498 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260807 10:39:29.268585 3490 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:39:29.268908 3490 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:39:29.269086 3490 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:39:29.276365 3490 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:39:29.276503 3490 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:39:29.276676 3490 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.171.65
I20260807 10:39:29.285717 3490 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.171.84:41719
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.65.keytab
--principal=kudu/127.20.171.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.171.65:43563
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.171.65
--webserver_port=34755
--tserver_master_addrs=127.20.171.126:38675
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.171.65
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:39:29.286994 3490 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:39:29.288347 3490 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:39:29.302173 3515 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:39:29.302137 3516 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:39:29.302592 3518 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:39:29.303365 3490 server_base.cc:1034] running on GCE node
I20260807 10:39:29.303956 3490 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:39:29.304930 3490 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:39:29.306156 3490 hybrid_clock.cc:648] HybridClock initialized: now 1786099169306093 us; error 47 us; skew 500 ppm
I20260807 10:39:29.306460 3490 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:39:29 dist-test-slave-0b58 krb5kdc[2856](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099169, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:39:29.309850 3490 init.cc:377] Logged in from keytab as kudu/127.20.171.65@KRBTEST.COM (short username kudu)
I20260807 10:39:29.311414 3490 webserver.cc:460] Webserver started at http://127.20.171.65:34755/ using document root <none> and password file <none>
I20260807 10:39:29.312237 3490 fs_manager.cc:359] Metadata directory not provided
I20260807 10:39:29.312433 3490 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:39:29.319080 3490 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.005s sys 0.001s
I20260807 10:39:29.322028 3525 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:39:29.323447 3490 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260807 10:39:29.323601 3490 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/ts-0/wal
uuid: "ffa4ec639b714cbc810bdfee1a63fdc9"
format_stamp: "Formatted at 2026-08-07 10:39:26 on dist-test-slave-0b58"
server_key: "21fc6ec42a108cbe7a15c46e78fadb74"
server_key_iv: "fd445e37302689812ecdcdc462417275"
server_key_version: "encryptionkey@0"
I20260807 10:39:29.324884 3490 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:39:29.354712 3490 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:39:29.359066 3490 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:39:29.359335 3490 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:39:29.360415 3490 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:39:29.361914 3490 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:39:29.362043 3490 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:39:29.362185 3490 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:39:29.362270 3490 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:39:29.397604 3490 rpc_server.cc:307] RPC server started. Bound to: 127.20.171.65:43563
I20260807 10:39:29.397698 3639 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.171.65:43563 every 8 connection(s)
I20260807 10:39:29.399039 3490 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/ts-0/data/info.pb
I20260807 10:39:29.406415 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 3490
I20260807 10:39:29.407166 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.171.66:46259
--local_ip_for_outbound_sockets=127.20.171.66
--tserver_master_addrs=127.20.171.126:38675
--webserver_port=46167
--webserver_interface=127.20.171.66
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.66.keytab
--principal=kudu/127.20.171.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.171.84:41719
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 10:39:29 dist-test-slave-0b58 krb5kdc[2856](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099169, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.65@KRBTEST.COM for kudu/127.20.171.126@KRBTEST.COM
I20260807 10:39:29.427583 3643 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:29.402330 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:38675 (local address 127.20.171.65:56103)
0807 10:39:29.403152 (+ 822us) negotiation.cc:107] Waiting for socket to connect
0807 10:39:29.403198 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0807 10:39:29.405016 (+ 1818us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:39:29.406552 (+ 1536us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:39:29.406565 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:39:29.407081 (+ 516us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:39:29.407708 (+ 627us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:39:29.407727 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:39:29.410217 (+ 2490us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:39:29.410222 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:39:29.411399 (+ 1177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:39:29.411412 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:39:29.412963 (+ 1551us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:39:29.412968 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:39:29.413161 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:39:29.413852 (+ 691us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:39:29.413874 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:39:29.416167 (+ 2293us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:39:29.423315 (+ 7148us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:39:29.423323 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:39:29.423337 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:39:29.423763 (+ 426us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:39:29.424223 (+ 460us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:39:29.424228 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:39:29.424231 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:39:29.424475 (+ 244us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:39:29.425201 (+ 726us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:39:29.425209 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:39:29.425524 (+ 315us) client_negotiation.cc:769] Sending connection context
0807 10:39:29.425784 (+ 260us) client_negotiation.cc:240] Negotiation successful
0807 10:39:29.426318 (+ 534us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":551,"thread_start_us":368,"threads_started":1}
I20260807 10:39:29.427583 3642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:29.402220 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.65:56103 (local address 127.20.171.126:38675)
0807 10:39:29.402839 (+ 619us) server_negotiation.cc:206] Beginning negotiation
0807 10:39:29.402850 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 10:39:29.403327 (+ 477us) server_negotiation.cc:407] Connection header received
0807 10:39:29.405543 (+ 2216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:39:29.405556 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:39:29.405968 (+ 412us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:39:29.406426 (+ 458us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:39:29.407950 (+ 1524us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:29.410019 (+ 2069us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:29.411569 (+ 1550us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:29.412725 (+ 1156us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:29.412915 (+ 190us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:39:29.416473 (+ 3558us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:39:29.416486 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:39:29.416505 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:39:29.416555 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:39:29.423155 (+ 6600us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:39:29.423919 (+ 764us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:39:29.423927 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:39:29.423932 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:39:29.424092 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:39:29.424594 (+ 502us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:39:29.424600 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:39:29.424603 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:39:29.425050 (+ 447us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:39:29.425256 (+ 206us) server_negotiation.cc:1035] Waiting for connection context
0807 10:39:29.426004 (+ 748us) server_negotiation.cc:299] Negotiation successful
0807 10:39:29.426406 (+ 402us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":423,"thread_start_us":294,"threads_started":1}
I20260807 10:39:29.430574 3640 heartbeater.cc:347] Connected to a master server at 127.20.171.126:38675
I20260807 10:39:29.430928 3640 heartbeater.cc:464] Registering TS with master...
I20260807 10:39:29.431656 3640 heartbeater.cc:511] Master 127.20.171.126:38675 requested a full tablet report, sending...
I20260807 10:39:29.433915 3451 ts_manager.cc:194] Registered new tserver with Master: ffa4ec639b714cbc810bdfee1a63fdc9 (127.20.171.65:43563)
I20260807 10:39:29.435518 3451 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.171.65@KRBTEST.COM'} at 127.20.171.65:56103
W20260807 10:39:29.761284 3644 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:39:29.761525 3644 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:39:29.761682 3644 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:39:29.768496 3644 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:39:29.768615 3644 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:39:29.768810 3644 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.171.66
I20260807 10:39:29.777819 3644 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.171.84:41719
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.66.keytab
--principal=kudu/127.20.171.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.171.66:46259
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.171.66
--webserver_port=46167
--tserver_master_addrs=127.20.171.126:38675
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.171.66
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:39:29.779048 3644 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:39:29.780325 3644 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:39:29.793577 3649 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:39:29.793510 3650 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:39:29.793547 3652 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:39:29.794261 3644 server_base.cc:1034] running on GCE node
I20260807 10:39:29.794844 3644 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:39:29.795756 3644 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:39:29.796957 3644 hybrid_clock.cc:648] HybridClock initialized: now 1786099169796921 us; error 33 us; skew 500 ppm
I20260807 10:39:29.797278 3644 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:39:29 dist-test-slave-0b58 krb5kdc[2856](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099169, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:39:29.800330 3644 init.cc:377] Logged in from keytab as kudu/127.20.171.66@KRBTEST.COM (short username kudu)
I20260807 10:39:29.801642 3644 webserver.cc:460] Webserver started at http://127.20.171.66:46167/ using document root <none> and password file <none>
I20260807 10:39:29.802278 3644 fs_manager.cc:359] Metadata directory not provided
I20260807 10:39:29.802448 3644 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:39:29.807575 3644 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.001s
I20260807 10:39:29.810153 3659 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:39:29.811316 3644 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 10:39:29.811478 3644 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/ts-1/wal
uuid: "04bb6b53e9584b818b9c9d9ee43f3e17"
format_stamp: "Formatted at 2026-08-07 10:39:26 on dist-test-slave-0b58"
server_key: "85e9c8aadebb3f3ac976eaae312b33df"
server_key_iv: "5224412a58919bc5e1b20c8f7b885ea8"
server_key_version: "encryptionkey@0"
I20260807 10:39:29.812430 3644 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:39:29.828158 3644 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:39:29.832443 3644 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:39:29.832688 3644 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:39:29.833619 3644 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:39:29.834820 3644 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:39:29.834936 3644 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:39:29.835057 3644 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:39:29.835135 3644 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:39:29.868970 3644 rpc_server.cc:307] RPC server started. Bound to: 127.20.171.66:46259
I20260807 10:39:29.869051 3771 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.171.66:46259 every 8 connection(s)
I20260807 10:39:29.870375 3644 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/ts-1/data/info.pb
I20260807 10:39:29.880661 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 3644
I20260807 10:39:29.881260 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.171.67:37957
--local_ip_for_outbound_sockets=127.20.171.67
--tserver_master_addrs=127.20.171.126:38675
--webserver_port=42841
--webserver_interface=127.20.171.67
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.67.keytab
--principal=kudu/127.20.171.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.171.84:41719
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 10:39:29 dist-test-slave-0b58 krb5kdc[2856](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099169, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.66@KRBTEST.COM for kudu/127.20.171.126@KRBTEST.COM
I20260807 10:39:29.889560 3642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:29.872711 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.66:45225 (local address 127.20.171.126:38675)
0807 10:39:29.872889 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0807 10:39:29.872893 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 10:39:29.874061 (+ 1168us) server_negotiation.cc:407] Connection header received
0807 10:39:29.875728 (+ 1667us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:39:29.875733 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:39:29.875816 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:39:29.876018 (+ 202us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:39:29.877585 (+ 1567us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:29.878313 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:29.879843 (+ 1530us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:29.880354 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:29.880482 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:39:29.884095 (+ 3613us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:39:29.884101 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:39:29.884105 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:39:29.884145 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:39:29.886636 (+ 2491us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:39:29.887345 (+ 709us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:39:29.887357 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:39:29.887360 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:39:29.887478 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:39:29.887909 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:39:29.887914 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:39:29.887917 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:39:29.888169 (+ 252us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:39:29.888359 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0807 10:39:29.888996 (+ 637us) server_negotiation.cc:299] Negotiation successful
0807 10:39:29.889222 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260807 10:39:29.890432 3775 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:29.873177 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:38675 (local address 127.20.171.66:45225)
0807 10:39:29.873925 (+ 748us) negotiation.cc:107] Waiting for socket to connect
0807 10:39:29.873965 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0807 10:39:29.875462 (+ 1497us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:39:29.876350 (+ 888us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:39:29.876358 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:39:29.876881 (+ 523us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:39:29.877409 (+ 528us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:39:29.877425 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:39:29.878488 (+ 1063us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:39:29.878493 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:39:29.879684 (+ 1191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:39:29.879706 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:39:29.880570 (+ 864us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:39:29.880577 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:39:29.880884 (+ 307us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:39:29.881628 (+ 744us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:39:29.881654 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:39:29.883906 (+ 2252us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:39:29.886794 (+ 2888us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:39:29.886803 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:39:29.886817 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:39:29.887216 (+ 399us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:39:29.887594 (+ 378us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:39:29.887599 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:39:29.887603 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:39:29.887793 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:39:29.888327 (+ 534us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:39:29.888334 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:39:29.888649 (+ 315us) client_negotiation.cc:769] Sending connection context
0807 10:39:29.888917 (+ 268us) client_negotiation.cc:240] Negotiation successful
0807 10:39:29.889369 (+ 452us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":500,"thread_start_us":303,"threads_started":1}
I20260807 10:39:29.891865 3773 heartbeater.cc:347] Connected to a master server at 127.20.171.126:38675
I20260807 10:39:29.892144 3773 heartbeater.cc:464] Registering TS with master...
I20260807 10:39:29.892856 3773 heartbeater.cc:511] Master 127.20.171.126:38675 requested a full tablet report, sending...
I20260807 10:39:29.894320 3451 ts_manager.cc:194] Registered new tserver with Master: 04bb6b53e9584b818b9c9d9ee43f3e17 (127.20.171.66:46259)
I20260807 10:39:29.895427 3451 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.171.66@KRBTEST.COM'} at 127.20.171.66:45225
W20260807 10:39:30.210476 3776 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:39:30.210742 3776 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:39:30.210835 3776 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:39:30.217850 3776 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:39:30.217950 3776 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:39:30.218072 3776 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.171.67
I20260807 10:39:30.230603 3776 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.171.84:41719
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.67.keytab
--principal=kudu/127.20.171.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.171.67:37957
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.171.67
--webserver_port=42841
--tserver_master_addrs=127.20.171.126:38675
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.171.67
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:39:30.232475 3776 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:39:30.234179 3776 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:39:30.247913 3782 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:39:30.248132 3784 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:39:30.248586 3781 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:39:30.249076 3776 server_base.cc:1034] running on GCE node
I20260807 10:39:30.249693 3776 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:39:30.250605 3776 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:39:30.251833 3776 hybrid_clock.cc:648] HybridClock initialized: now 1786099170251786 us; error 61 us; skew 500 ppm
I20260807 10:39:30.252148 3776 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:39:30 dist-test-slave-0b58 krb5kdc[2856](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099170, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:39:30.255287 3776 init.cc:377] Logged in from keytab as kudu/127.20.171.67@KRBTEST.COM (short username kudu)
I20260807 10:39:30.256887 3776 webserver.cc:460] Webserver started at http://127.20.171.67:42841/ using document root <none> and password file <none>
I20260807 10:39:30.257570 3776 fs_manager.cc:359] Metadata directory not provided
I20260807 10:39:30.257748 3776 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:39:30.263131 3776 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.003s
I20260807 10:39:30.265844 3791 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:39:30.267282 3776 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260807 10:39:30.267458 3776 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/ts-2/wal
uuid: "1c127bab40a54ba6a8b7f42f14e3b068"
format_stamp: "Formatted at 2026-08-07 10:39:27 on dist-test-slave-0b58"
server_key: "87e2eb06cff63793f2dcbcefb62ed4e7"
server_key_iv: "80693a3894185807f903c6cb97842d90"
server_key_version: "encryptionkey@0"
I20260807 10:39:30.268527 3776 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:39:30.299913 3776 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:39:30.303846 3776 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:39:30.304116 3776 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:39:30.305202 3776 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:39:30.306531 3776 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:39:30.306660 3776 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:39:30.306806 3776 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:39:30.306905 3776 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:39:30.340619 3776 rpc_server.cc:307] RPC server started. Bound to: 127.20.171.67:37957
I20260807 10:39:30.340703 3906 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.171.67:37957 every 8 connection(s)
I20260807 10:39:30.342053 3776 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/ts-2/data/info.pb
I20260807 10:39:30.342612 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 3776
Aug 07 10:39:30 dist-test-slave-0b58 krb5kdc[2856](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099170, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.67@KRBTEST.COM for kudu/127.20.171.126@KRBTEST.COM
I20260807 10:39:30.361255 3642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:30.343791 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40948 (local address 127.20.171.126:38675)
0807 10:39:30.343972 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0807 10:39:30.343978 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:39:30.344711 (+ 733us) server_negotiation.cc:407] Connection header received
0807 10:39:30.344796 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:39:30.344801 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:39:30.344900 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:39:30.344986 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:39:30.347168 (+ 2182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:30.348309 (+ 1141us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:30.349840 (+ 1531us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:30.350475 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:30.350616 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:39:30.353554 (+ 2938us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:39:30.353560 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:39:30.353565 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:39:30.353600 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:39:30.357978 (+ 4378us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:39:30.358924 (+ 946us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:39:30.358931 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:39:30.358934 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:39:30.359129 (+ 195us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:39:30.359576 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:39:30.359580 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:39:30.359583 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:39:30.359991 (+ 408us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:39:30.360253 (+ 262us) server_negotiation.cc:1035] Waiting for connection context
0807 10:39:30.360628 (+ 375us) server_negotiation.cc:299] Negotiation successful
0807 10:39:30.360868 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260807 10:39:30.367807 3910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:30.345493 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.67:60799 (local address 127.20.171.126:38675)
0807 10:39:30.345947 (+ 454us) server_negotiation.cc:206] Beginning negotiation
0807 10:39:30.345951 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 10:39:30.348336 (+ 2385us) server_negotiation.cc:407] Connection header received
0807 10:39:30.349344 (+ 1008us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:39:30.349351 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:39:30.349430 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:39:30.349556 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:39:30.351353 (+ 1797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:30.352510 (+ 1157us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:30.354266 (+ 1756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:30.354897 (+ 631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:30.354987 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:39:30.361214 (+ 6227us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:39:30.361222 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:39:30.361227 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:39:30.361265 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:39:30.364000 (+ 2735us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:39:30.364916 (+ 916us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:39:30.364921 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:39:30.364923 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:39:30.365057 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:39:30.365582 (+ 525us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:39:30.365587 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:39:30.365589 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:39:30.366310 (+ 721us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:39:30.366448 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0807 10:39:30.367207 (+ 759us) server_negotiation.cc:299] Negotiation successful
0807 10:39:30.367418 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":366,"thread_start_us":260,"threads_started":1}
I20260807 10:39:30.369071 3911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:30.346221 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:38675 (local address 127.20.171.67:60799)
0807 10:39:30.346997 (+ 776us) negotiation.cc:107] Waiting for socket to connect
0807 10:39:30.347039 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0807 10:39:30.349099 (+ 2060us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:39:30.349741 (+ 642us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:39:30.349749 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:39:30.350442 (+ 693us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:39:30.351142 (+ 700us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:39:30.351167 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:39:30.352677 (+ 1510us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:39:30.352681 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:39:30.354115 (+ 1434us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:39:30.354131 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:39:30.355109 (+ 978us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:39:30.355117 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:39:30.355440 (+ 323us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:39:30.356147 (+ 707us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:39:30.356189 (+ 42us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:39:30.360863 (+ 4674us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:39:30.364127 (+ 3264us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:39:30.364136 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:39:30.364150 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:39:30.364755 (+ 605us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:39:30.365217 (+ 462us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:39:30.365222 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:39:30.365225 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:39:30.365457 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:39:30.366430 (+ 973us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:39:30.366438 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:39:30.366857 (+ 419us) client_negotiation.cc:769] Sending connection context
0807 10:39:30.367119 (+ 262us) client_negotiation.cc:240] Negotiation successful
0807 10:39:30.367873 (+ 754us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":510,"thread_start_us":318,"threads_started":1}
I20260807 10:39:30.370515 3907 heartbeater.cc:347] Connected to a master server at 127.20.171.126:38675
I20260807 10:39:30.370826 3907 heartbeater.cc:464] Registering TS with master...
I20260807 10:39:30.371769 3907 heartbeater.cc:511] Master 127.20.171.126:38675 requested a full tablet report, sending...
I20260807 10:39:30.373514 3451 ts_manager.cc:194] Registered new tserver with Master: 1c127bab40a54ba6a8b7f42f14e3b068 (127.20.171.67:37957)
I20260807 10:39:30.374495 3451 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.171.67@KRBTEST.COM'} at 127.20.171.67:60799
I20260807 10:39:30.380043 21165 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 10:39:30.389788 3910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:30.381202 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40956 (local address 127.20.171.126:38675)
0807 10:39:30.381399 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0807 10:39:30.381405 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:39:30.381974 (+ 569us) server_negotiation.cc:407] Connection header received
0807 10:39:30.382237 (+ 263us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:39:30.382245 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:39:30.382460 (+ 215us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:39:30.382598 (+ 138us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 10:39:30.383063 (+ 465us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:30.384174 (+ 1111us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:30.386536 (+ 2362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:30.387327 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:30.387477 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:39:30.388131 (+ 654us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 10:39:30.388988 (+ 857us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 10:39:30.389143 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0807 10:39:30.389343 (+ 200us) server_negotiation.cc:299] Negotiation successful
0807 10:39:30.389447 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260807 10:39:30.390718 3451 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:40956:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 10:39:30.398445 3451 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 10:39:30.424638 3918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:30.410611 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32834 (local address 127.20.171.67:37957)
0807 10:39:30.416015 (+ 5404us) server_negotiation.cc:206] Beginning negotiation
0807 10:39:30.416021 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:39:30.416046 (+ 25us) server_negotiation.cc:407] Connection header received
0807 10:39:30.416118 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:39:30.416123 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:39:30.416382 (+ 259us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:39:30.417411 (+ 1029us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:39:30.417752 (+ 341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:30.419482 (+ 1730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:30.422263 (+ 2781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:30.423414 (+ 1151us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:30.423557 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:39:30.423793 (+ 236us) server_negotiation.cc:1035] Waiting for connection context
0807 10:39:30.424118 (+ 325us) server_negotiation.cc:299] Negotiation successful
0807 10:39:30.424297 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5272,"thread_start_us":5089,"threads_started":1}
I20260807 10:39:30.424973 3917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:30.410280 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.67:37957 (local address 127.0.0.1:32834)
0807 10:39:30.411948 (+ 1668us) negotiation.cc:107] Waiting for socket to connect
0807 10:39:30.412007 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0807 10:39:30.412189 (+ 182us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:39:30.416689 (+ 4500us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:39:30.416696 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:39:30.416733 (+ 37us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:39:30.417236 (+ 503us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:39:30.417247 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:39:30.419614 (+ 2367us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:39:30.419621 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:39:30.422082 (+ 2461us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:39:30.422097 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:39:30.423624 (+ 1527us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:39:30.423631 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:39:30.423892 (+ 261us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:39:30.423933 (+ 41us) client_negotiation.cc:769] Sending connection context
0807 10:39:30.424073 (+ 140us) client_negotiation.cc:240] Negotiation successful
0807 10:39:30.424250 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":672,"mutex_wait_us":50,"thread_start_us":517,"threads_started":1}
I20260807 10:39:30.425124 3921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:30.411554 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40922 (local address 127.20.171.66:46259)
0807 10:39:30.412837 (+ 1283us) server_negotiation.cc:206] Beginning negotiation
0807 10:39:30.412848 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 10:39:30.416963 (+ 4115us) server_negotiation.cc:407] Connection header received
0807 10:39:30.417294 (+ 331us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:39:30.417306 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:39:30.417564 (+ 258us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:39:30.417790 (+ 226us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:39:30.418814 (+ 1024us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:30.420234 (+ 1420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:30.422547 (+ 2313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:30.423755 (+ 1208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:30.423865 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:39:30.424042 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0807 10:39:30.424662 (+ 620us) server_negotiation.cc:299] Negotiation successful
0807 10:39:30.424807 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1098,"thread_start_us":985,"threads_started":1}
I20260807 10:39:30.425819 3920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:30.411009 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.66:46259 (local address 127.0.0.1:40922)
0807 10:39:30.416833 (+ 5824us) negotiation.cc:107] Waiting for socket to connect
0807 10:39:30.416860 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0807 10:39:30.417069 (+ 209us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:39:30.418105 (+ 1036us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:39:30.418113 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:39:30.418147 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:39:30.418635 (+ 488us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:39:30.418648 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:39:30.420412 (+ 1764us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:39:30.420415 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:39:30.422368 (+ 1953us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:39:30.422380 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:39:30.424251 (+ 1871us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:39:30.424277 (+ 26us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:39:30.424454 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:39:30.424485 (+ 31us) client_negotiation.cc:769] Sending connection context
0807 10:39:30.425346 (+ 861us) client_negotiation.cc:240] Negotiation successful
0807 10:39:30.425480 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5652,"mutex_wait_us":29,"thread_start_us":8778,"threads_started":1}
I20260807 10:39:30.427968 3922 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:30.412118 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50836 (local address 127.20.171.65:43563)
0807 10:39:30.415539 (+ 3421us) server_negotiation.cc:206] Beginning negotiation
0807 10:39:30.415549 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 10:39:30.420183 (+ 4634us) server_negotiation.cc:407] Connection header received
0807 10:39:30.420395 (+ 212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:39:30.420403 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:39:30.420608 (+ 205us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:39:30.420806 (+ 198us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:39:30.421541 (+ 735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:30.422907 (+ 1366us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:30.425233 (+ 2326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:30.426482 (+ 1249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:30.426623 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:39:30.426883 (+ 260us) server_negotiation.cc:1035] Waiting for connection context
0807 10:39:30.427452 (+ 569us) server_negotiation.cc:299] Negotiation successful
0807 10:39:30.427615 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3218,"thread_start_us":3079,"threads_started":1}
I20260807 10:39:30.428678 3919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:30.411562 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.65:43563 (local address 127.0.0.1:50836)
0807 10:39:30.420055 (+ 8493us) negotiation.cc:107] Waiting for socket to connect
0807 10:39:30.420073 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 10:39:30.420203 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:39:30.420814 (+ 611us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:39:30.420825 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:39:30.420856 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:39:30.421328 (+ 472us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:39:30.421340 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:39:30.423045 (+ 1705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:39:30.423051 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:39:30.425005 (+ 1954us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:39:30.425035 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:39:30.427055 (+ 2020us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:39:30.427064 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:39:30.427228 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:39:30.427266 (+ 38us) client_negotiation.cc:769] Sending connection context
0807 10:39:30.428157 (+ 891us) client_negotiation.cc:240] Negotiation successful
0807 10:39:30.428314 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8369,"mutex_wait_us":6,"thread_start_us":4898,"threads_started":1}
I20260807 10:39:30.429348 3841 tablet_service.cc:1467] Processing CreateTablet for tablet 929aecdb79fe4461aa321891b84f8c5a (DEFAULT_TABLE table=test-table [id=d6ceda5bd78b4407a0175705dc5659c0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:39:30.429347 3707 tablet_service.cc:1467] Processing CreateTablet for tablet 929aecdb79fe4461aa321891b84f8c5a (DEFAULT_TABLE table=test-table [id=d6ceda5bd78b4407a0175705dc5659c0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:39:30.430568 3707 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 929aecdb79fe4461aa321891b84f8c5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:39:30.430575 3841 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 929aecdb79fe4461aa321891b84f8c5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:39:30.435629 3573 tablet_service.cc:1467] Processing CreateTablet for tablet 929aecdb79fe4461aa321891b84f8c5a (DEFAULT_TABLE table=test-table [id=d6ceda5bd78b4407a0175705dc5659c0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:39:30.437050 3573 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 929aecdb79fe4461aa321891b84f8c5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:39:30.438266 3640 heartbeater.cc:503] Master 127.20.171.126:38675 was elected leader, sending a full tablet report...
I20260807 10:39:30.443285 3923 tablet_bootstrap.cc:492] T 929aecdb79fe4461aa321891b84f8c5a P 04bb6b53e9584b818b9c9d9ee43f3e17: Bootstrap starting.
I20260807 10:39:30.445175 3924 tablet_bootstrap.cc:492] T 929aecdb79fe4461aa321891b84f8c5a P 1c127bab40a54ba6a8b7f42f14e3b068: Bootstrap starting.
I20260807 10:39:30.447157 3923 tablet_bootstrap.cc:654] T 929aecdb79fe4461aa321891b84f8c5a P 04bb6b53e9584b818b9c9d9ee43f3e17: Neither blocks nor log segments found. Creating new log.
I20260807 10:39:30.448534 3923 log.cc:824] T 929aecdb79fe4461aa321891b84f8c5a P 04bb6b53e9584b818b9c9d9ee43f3e17: Log is configured to *not* fsync() on all Append() calls
I20260807 10:39:30.448598 3924 tablet_bootstrap.cc:654] T 929aecdb79fe4461aa321891b84f8c5a P 1c127bab40a54ba6a8b7f42f14e3b068: Neither blocks nor log segments found. Creating new log.
I20260807 10:39:30.449934 3924 log.cc:824] T 929aecdb79fe4461aa321891b84f8c5a P 1c127bab40a54ba6a8b7f42f14e3b068: Log is configured to *not* fsync() on all Append() calls
I20260807 10:39:30.450968 3926 tablet_bootstrap.cc:492] T 929aecdb79fe4461aa321891b84f8c5a P ffa4ec639b714cbc810bdfee1a63fdc9: Bootstrap starting.
I20260807 10:39:30.454360 3926 tablet_bootstrap.cc:654] T 929aecdb79fe4461aa321891b84f8c5a P ffa4ec639b714cbc810bdfee1a63fdc9: Neither blocks nor log segments found. Creating new log.
I20260807 10:39:30.454730 3923 tablet_bootstrap.cc:492] T 929aecdb79fe4461aa321891b84f8c5a P 04bb6b53e9584b818b9c9d9ee43f3e17: No bootstrap required, opened a new log
I20260807 10:39:30.454988 3923 ts_tablet_manager.cc:1397] T 929aecdb79fe4461aa321891b84f8c5a P 04bb6b53e9584b818b9c9d9ee43f3e17: Time spent bootstrapping tablet: real 0.012s user 0.006s sys 0.003s
I20260807 10:39:30.455220 3924 tablet_bootstrap.cc:492] T 929aecdb79fe4461aa321891b84f8c5a P 1c127bab40a54ba6a8b7f42f14e3b068: No bootstrap required, opened a new log
I20260807 10:39:30.455485 3924 ts_tablet_manager.cc:1397] T 929aecdb79fe4461aa321891b84f8c5a P 1c127bab40a54ba6a8b7f42f14e3b068: Time spent bootstrapping tablet: real 0.011s user 0.008s sys 0.000s
I20260807 10:39:30.455657 3926 log.cc:824] T 929aecdb79fe4461aa321891b84f8c5a P ffa4ec639b714cbc810bdfee1a63fdc9: Log is configured to *not* fsync() on all Append() calls
I20260807 10:39:30.458757 3926 tablet_bootstrap.cc:492] T 929aecdb79fe4461aa321891b84f8c5a P ffa4ec639b714cbc810bdfee1a63fdc9: No bootstrap required, opened a new log
I20260807 10:39:30.459031 3926 ts_tablet_manager.cc:1397] T 929aecdb79fe4461aa321891b84f8c5a P ffa4ec639b714cbc810bdfee1a63fdc9: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.006s
I20260807 10:39:30.463047 3923 raft_consensus.cc:348] T 929aecdb79fe4461aa321891b84f8c5a P 04bb6b53e9584b818b9c9d9ee43f3e17 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c127bab40a54ba6a8b7f42f14e3b068" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 37957 } } peers { permanent_uuid: "ffa4ec639b714cbc810bdfee1a63fdc9" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 43563 } } peers { permanent_uuid: "04bb6b53e9584b818b9c9d9ee43f3e17" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 46259 } }
I20260807 10:39:30.463409 3923 raft_consensus.cc:374] T 929aecdb79fe4461aa321891b84f8c5a P 04bb6b53e9584b818b9c9d9ee43f3e17 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:39:30.463526 3923 raft_consensus.cc:729] T 929aecdb79fe4461aa321891b84f8c5a P 04bb6b53e9584b818b9c9d9ee43f3e17 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04bb6b53e9584b818b9c9d9ee43f3e17, State: Initialized, Role: FOLLOWER
I20260807 10:39:30.464087 3923 consensus_queue.cc:260] T 929aecdb79fe4461aa321891b84f8c5a P 04bb6b53e9584b818b9c9d9ee43f3e17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c127bab40a54ba6a8b7f42f14e3b068" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 37957 } } peers { permanent_uuid: "ffa4ec639b714cbc810bdfee1a63fdc9" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 43563 } } peers { permanent_uuid: "04bb6b53e9584b818b9c9d9ee43f3e17" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 46259 } }
I20260807 10:39:30.465322 3773 heartbeater.cc:503] Master 127.20.171.126:38675 was elected leader, sending a full tablet report...
I20260807 10:39:30.465600 3924 raft_consensus.cc:348] T 929aecdb79fe4461aa321891b84f8c5a P 1c127bab40a54ba6a8b7f42f14e3b068 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c127bab40a54ba6a8b7f42f14e3b068" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 37957 } } peers { permanent_uuid: "ffa4ec639b714cbc810bdfee1a63fdc9" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 43563 } } peers { permanent_uuid: "04bb6b53e9584b818b9c9d9ee43f3e17" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 46259 } }
I20260807 10:39:30.466001 3923 ts_tablet_manager.cc:1428] T 929aecdb79fe4461aa321891b84f8c5a P 04bb6b53e9584b818b9c9d9ee43f3e17: Time spent starting tablet: real 0.011s user 0.011s sys 0.000s
I20260807 10:39:30.466078 3924 raft_consensus.cc:374] T 929aecdb79fe4461aa321891b84f8c5a P 1c127bab40a54ba6a8b7f42f14e3b068 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:39:30.466208 3924 raft_consensus.cc:729] T 929aecdb79fe4461aa321891b84f8c5a P 1c127bab40a54ba6a8b7f42f14e3b068 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c127bab40a54ba6a8b7f42f14e3b068, State: Initialized, Role: FOLLOWER
I20260807 10:39:30.466768 3924 consensus_queue.cc:260] T 929aecdb79fe4461aa321891b84f8c5a P 1c127bab40a54ba6a8b7f42f14e3b068 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c127bab40a54ba6a8b7f42f14e3b068" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 37957 } } peers { permanent_uuid: "ffa4ec639b714cbc810bdfee1a63fdc9" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 43563 } } peers { permanent_uuid: "04bb6b53e9584b818b9c9d9ee43f3e17" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 46259 } }
I20260807 10:39:30.467922 3907 heartbeater.cc:503] Master 127.20.171.126:38675 was elected leader, sending a full tablet report...
I20260807 10:39:30.468551 3924 ts_tablet_manager.cc:1428] T 929aecdb79fe4461aa321891b84f8c5a P 1c127bab40a54ba6a8b7f42f14e3b068: Time spent starting tablet: real 0.013s user 0.015s sys 0.000s
I20260807 10:39:30.470541 3926 raft_consensus.cc:348] T 929aecdb79fe4461aa321891b84f8c5a P ffa4ec639b714cbc810bdfee1a63fdc9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c127bab40a54ba6a8b7f42f14e3b068" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 37957 } } peers { permanent_uuid: "ffa4ec639b714cbc810bdfee1a63fdc9" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 43563 } } peers { permanent_uuid: "04bb6b53e9584b818b9c9d9ee43f3e17" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 46259 } }
I20260807 10:39:30.470924 3926 raft_consensus.cc:374] T 929aecdb79fe4461aa321891b84f8c5a P ffa4ec639b714cbc810bdfee1a63fdc9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:39:30.471047 3926 raft_consensus.cc:729] T 929aecdb79fe4461aa321891b84f8c5a P ffa4ec639b714cbc810bdfee1a63fdc9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ffa4ec639b714cbc810bdfee1a63fdc9, State: Initialized, Role: FOLLOWER
I20260807 10:39:30.471529 3926 consensus_queue.cc:260] T 929aecdb79fe4461aa321891b84f8c5a P ffa4ec639b714cbc810bdfee1a63fdc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c127bab40a54ba6a8b7f42f14e3b068" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 37957 } } peers { permanent_uuid: "ffa4ec639b714cbc810bdfee1a63fdc9" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 43563 } } peers { permanent_uuid: "04bb6b53e9584b818b9c9d9ee43f3e17" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 46259 } }
I20260807 10:39:30.473106 3926 ts_tablet_manager.cc:1428] T 929aecdb79fe4461aa321891b84f8c5a P ffa4ec639b714cbc810bdfee1a63fdc9: Time spent starting tablet: real 0.014s user 0.010s sys 0.004s
W20260807 10:39:30.593778 3908 tablet.cc:2369] T 929aecdb79fe4461aa321891b84f8c5a P 1c127bab40a54ba6a8b7f42f14e3b068: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 10:39:30.622340 3774 tablet.cc:2369] T 929aecdb79fe4461aa321891b84f8c5a P 04bb6b53e9584b818b9c9d9ee43f3e17: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 10:39:30.651566 3641 tablet.cc:2369] T 929aecdb79fe4461aa321891b84f8c5a P ffa4ec639b714cbc810bdfee1a63fdc9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 10:39:30.746436 3929 raft_consensus.cc:482] T 929aecdb79fe4461aa321891b84f8c5a P 04bb6b53e9584b818b9c9d9ee43f3e17 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 10:39:30.746739 3929 raft_consensus.cc:504] T 929aecdb79fe4461aa321891b84f8c5a P 04bb6b53e9584b818b9c9d9ee43f3e17 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c127bab40a54ba6a8b7f42f14e3b068" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 37957 } } peers { permanent_uuid: "ffa4ec639b714cbc810bdfee1a63fdc9" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 43563 } } peers { permanent_uuid: "04bb6b53e9584b818b9c9d9ee43f3e17" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 46259 } }
I20260807 10:39:30.748494 3929 leader_election.cc:288] T 929aecdb79fe4461aa321891b84f8c5a P 04bb6b53e9584b818b9c9d9ee43f3e17 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c127bab40a54ba6a8b7f42f14e3b068 (127.20.171.67:37957), ffa4ec639b714cbc810bdfee1a63fdc9 (127.20.171.65:43563)
I20260807 10:39:30.756569 3922 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:30.749863 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.66:56121 (local address 127.20.171.65:43563)
0807 10:39:30.750071 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0807 10:39:30.750079 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 10:39:30.750384 (+ 305us) server_negotiation.cc:407] Connection header received
0807 10:39:30.750545 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:39:30.750549 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:39:30.750604 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:39:30.750697 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:39:30.751215 (+ 518us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:30.752071 (+ 856us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:30.754312 (+ 2241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:30.755458 (+ 1146us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:30.755604 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:39:30.755685 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0807 10:39:30.756169 (+ 484us) server_negotiation.cc:299] Negotiation successful
0807 10:39:30.756325 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260807 10:39:30.756569 3918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:30.748936 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.66:39623 (local address 127.20.171.67:37957)
0807 10:39:30.749194 (+ 258us) server_negotiation.cc:206] Beginning negotiation
0807 10:39:30.749203 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 10:39:30.749646 (+ 443us) server_negotiation.cc:407] Connection header received
0807 10:39:30.749917 (+ 271us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:39:30.749922 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:39:30.750005 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:39:30.750112 (+ 107us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:39:30.750755 (+ 643us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:30.751746 (+ 991us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:30.754176 (+ 2430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:30.755385 (+ 1209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:30.755567 (+ 182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:39:30.755673 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0807 10:39:30.756149 (+ 476us) server_negotiation.cc:299] Negotiation successful
0807 10:39:30.756304 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260807 10:39:30.756814 3933 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:30.749671 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.65:43563 (local address 127.20.171.66:56121)
0807 10:39:30.750267 (+ 596us) negotiation.cc:107] Waiting for socket to connect
0807 10:39:30.750289 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0807 10:39:30.750428 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:39:30.750718 (+ 290us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:39:30.750724 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:39:30.750748 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:39:30.751023 (+ 275us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:39:30.751030 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:39:30.752196 (+ 1166us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:39:30.752201 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:39:30.754156 (+ 1955us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:39:30.754167 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:39:30.755675 (+ 1508us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:39:30.755680 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:39:30.755954 (+ 274us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:39:30.756006 (+ 52us) client_negotiation.cc:769] Sending connection context
0807 10:39:30.756104 (+ 98us) client_negotiation.cc:240] Negotiation successful
0807 10:39:30.756296 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":466,"mutex_wait_us":101,"thread_start_us":404,"threads_started":1}
I20260807 10:39:30.756836 3932 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:30.748868 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.67:37957 (local address 127.20.171.66:39623)
0807 10:39:30.749528 (+ 660us) negotiation.cc:107] Waiting for socket to connect
0807 10:39:30.749544 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 10:39:30.749726 (+ 182us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:39:30.750158 (+ 432us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:39:30.750164 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:39:30.750192 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:39:30.750601 (+ 409us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:39:30.750610 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:39:30.751862 (+ 1252us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:39:30.751865 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:39:30.754007 (+ 2142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:39:30.754022 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:39:30.755671 (+ 1649us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:39:30.755677 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:39:30.755949 (+ 272us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:39:30.756006 (+ 57us) client_negotiation.cc:769] Sending connection context
0807 10:39:30.756104 (+ 98us) client_negotiation.cc:240] Negotiation successful
0807 10:39:30.756296 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":546,"mutex_wait_us":89,"thread_start_us":395,"threads_started":1}
I20260807 10:39:30.758162 3861 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "929aecdb79fe4461aa321891b84f8c5a" candidate_uuid: "04bb6b53e9584b818b9c9d9ee43f3e17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c127bab40a54ba6a8b7f42f14e3b068" is_pre_election: true
I20260807 10:39:30.758194 3593 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "929aecdb79fe4461aa321891b84f8c5a" candidate_uuid: "04bb6b53e9584b818b9c9d9ee43f3e17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ffa4ec639b714cbc810bdfee1a63fdc9" is_pre_election: true
I20260807 10:39:30.758796 3861 raft_consensus.cc:2454] T 929aecdb79fe4461aa321891b84f8c5a P 1c127bab40a54ba6a8b7f42f14e3b068 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04bb6b53e9584b818b9c9d9ee43f3e17 in term 0.
I20260807 10:39:30.758797 3593 raft_consensus.cc:2454] T 929aecdb79fe4461aa321891b84f8c5a P ffa4ec639b714cbc810bdfee1a63fdc9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04bb6b53e9584b818b9c9d9ee43f3e17 in term 0.
I20260807 10:39:30.759476 3660 leader_election.cc:302] T 929aecdb79fe4461aa321891b84f8c5a P 04bb6b53e9584b818b9c9d9ee43f3e17 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04bb6b53e9584b818b9c9d9ee43f3e17, 1c127bab40a54ba6a8b7f42f14e3b068; no voters:
I20260807 10:39:30.759814 3929 raft_consensus.cc:2781] T 929aecdb79fe4461aa321891b84f8c5a P 04bb6b53e9584b818b9c9d9ee43f3e17 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 10:39:30.759994 3929 raft_consensus.cc:482] T 929aecdb79fe4461aa321891b84f8c5a P 04bb6b53e9584b818b9c9d9ee43f3e17 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 10:39:30.760102 3929 raft_consensus.cc:3037] T 929aecdb79fe4461aa321891b84f8c5a P 04bb6b53e9584b818b9c9d9ee43f3e17 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:39:30.762478 3929 raft_consensus.cc:504] T 929aecdb79fe4461aa321891b84f8c5a P 04bb6b53e9584b818b9c9d9ee43f3e17 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c127bab40a54ba6a8b7f42f14e3b068" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 37957 } } peers { permanent_uuid: "ffa4ec639b714cbc810bdfee1a63fdc9" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 43563 } } peers { permanent_uuid: "04bb6b53e9584b818b9c9d9ee43f3e17" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 46259 } }
I20260807 10:39:30.763052 3929 leader_election.cc:288] T 929aecdb79fe4461aa321891b84f8c5a P 04bb6b53e9584b818b9c9d9ee43f3e17 [CANDIDATE]: Term 1 election: Requested vote from peers 1c127bab40a54ba6a8b7f42f14e3b068 (127.20.171.67:37957), ffa4ec639b714cbc810bdfee1a63fdc9 (127.20.171.65:43563)
I20260807 10:39:30.763512 3861 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "929aecdb79fe4461aa321891b84f8c5a" candidate_uuid: "04bb6b53e9584b818b9c9d9ee43f3e17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c127bab40a54ba6a8b7f42f14e3b068"
I20260807 10:39:30.763579 3593 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "929aecdb79fe4461aa321891b84f8c5a" candidate_uuid: "04bb6b53e9584b818b9c9d9ee43f3e17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ffa4ec639b714cbc810bdfee1a63fdc9"
I20260807 10:39:30.763705 3861 raft_consensus.cc:3037] T 929aecdb79fe4461aa321891b84f8c5a P 1c127bab40a54ba6a8b7f42f14e3b068 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:39:30.763834 3593 raft_consensus.cc:3037] T 929aecdb79fe4461aa321891b84f8c5a P ffa4ec639b714cbc810bdfee1a63fdc9 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:39:30.766269 3593 raft_consensus.cc:2454] T 929aecdb79fe4461aa321891b84f8c5a P ffa4ec639b714cbc810bdfee1a63fdc9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04bb6b53e9584b818b9c9d9ee43f3e17 in term 1.
I20260807 10:39:30.766299 3861 raft_consensus.cc:2454] T 929aecdb79fe4461aa321891b84f8c5a P 1c127bab40a54ba6a8b7f42f14e3b068 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04bb6b53e9584b818b9c9d9ee43f3e17 in term 1.
I20260807 10:39:30.766760 3660 leader_election.cc:302] T 929aecdb79fe4461aa321891b84f8c5a P 04bb6b53e9584b818b9c9d9ee43f3e17 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04bb6b53e9584b818b9c9d9ee43f3e17, 1c127bab40a54ba6a8b7f42f14e3b068; no voters:
I20260807 10:39:30.767033 3929 raft_consensus.cc:2781] T 929aecdb79fe4461aa321891b84f8c5a P 04bb6b53e9584b818b9c9d9ee43f3e17 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:39:30.767457 3929 raft_consensus.cc:686] T 929aecdb79fe4461aa321891b84f8c5a P 04bb6b53e9584b818b9c9d9ee43f3e17 [term 1 LEADER]: Becoming Leader. State: Replica: 04bb6b53e9584b818b9c9d9ee43f3e17, State: Running, Role: LEADER
I20260807 10:39:30.767918 3929 consensus_queue.cc:237] T 929aecdb79fe4461aa321891b84f8c5a P 04bb6b53e9584b818b9c9d9ee43f3e17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c127bab40a54ba6a8b7f42f14e3b068" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 37957 } } peers { permanent_uuid: "ffa4ec639b714cbc810bdfee1a63fdc9" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 43563 } } peers { permanent_uuid: "04bb6b53e9584b818b9c9d9ee43f3e17" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 46259 } }
I20260807 10:39:30.772461 3451 catalog_manager.cc:5495] T 929aecdb79fe4461aa321891b84f8c5a P 04bb6b53e9584b818b9c9d9ee43f3e17 reported cstate change: term changed from 0 to 1, leader changed from <none> to 04bb6b53e9584b818b9c9d9ee43f3e17 (127.20.171.66). New cstate: current_term: 1 leader_uuid: "04bb6b53e9584b818b9c9d9ee43f3e17" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c127bab40a54ba6a8b7f42f14e3b068" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 37957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ffa4ec639b714cbc810bdfee1a63fdc9" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 43563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04bb6b53e9584b818b9c9d9ee43f3e17" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 46259 } health_report { overall_health: HEALTHY } } }
I20260807 10:39:30.875211 3921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:30.869150 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59592 (local address 127.20.171.66:46259)
0807 10:39:30.869357 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0807 10:39:30.869361 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 10:39:30.869377 (+ 16us) server_negotiation.cc:407] Connection header received
0807 10:39:30.869642 (+ 265us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:39:30.869650 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:39:30.869770 (+ 120us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:39:30.869914 (+ 144us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 10:39:30.870356 (+ 442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:30.871065 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:30.872958 (+ 1893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:30.873522 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:30.873604 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:39:30.874123 (+ 519us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 10:39:30.874572 (+ 449us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 10:39:30.874672 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0807 10:39:30.874817 (+ 145us) server_negotiation.cc:299] Negotiation successful
0807 10:39:30.874883 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260807 10:39:30.883558 3861 raft_consensus.cc:1261] T 929aecdb79fe4461aa321891b84f8c5a P 1c127bab40a54ba6a8b7f42f14e3b068 [term 1 FOLLOWER]: Refusing update from remote peer 04bb6b53e9584b818b9c9d9ee43f3e17: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 10:39:30.883555 3593 raft_consensus.cc:1261] T 929aecdb79fe4461aa321891b84f8c5a P ffa4ec639b714cbc810bdfee1a63fdc9 [term 1 FOLLOWER]: Refusing update from remote peer 04bb6b53e9584b818b9c9d9ee43f3e17: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 10:39:30.884478 3934 consensus_queue.cc:1035] T 929aecdb79fe4461aa321891b84f8c5a P 04bb6b53e9584b818b9c9d9ee43f3e17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ffa4ec639b714cbc810bdfee1a63fdc9" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 43563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 10:39:30.884792 3929 consensus_queue.cc:1035] T 929aecdb79fe4461aa321891b84f8c5a P 04bb6b53e9584b818b9c9d9ee43f3e17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c127bab40a54ba6a8b7f42f14e3b068" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 37957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 10:39:30.895125 3937 mvcc.cc:205] Tried to move back new op lower bound from 7315862203929169920 to 7315862203469254656. Current Snapshot: MvccSnapshot[applied={T|T < 7315862203929169920}]
I20260807 10:39:30.895704 3939 mvcc.cc:205] Tried to move back new op lower bound from 7315862203929169920 to 7315862203469254656. Current Snapshot: MvccSnapshot[applied={T|T < 7315862203929169920}]
I20260807 10:39:30.922155 3450 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:40956:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 10:39:30.922436 3450 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:40956:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 10:39:30.925837 3450 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ef15abefda7940d1a2bf5dacba18eace: Sending DeleteTablet for 3 replicas of tablet 929aecdb79fe4461aa321891b84f8c5a
I20260807 10:39:30.927011 3841 tablet_service.cc:1514] Processing DeleteTablet for tablet 929aecdb79fe4461aa321891b84f8c5a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:39:30 UTC) from {username='kudu', principal='kudu/127.20.171.126@KRBTEST.COM'} at 127.0.0.1:32834
I20260807 10:39:30.927225 3707 tablet_service.cc:1514] Processing DeleteTablet for tablet 929aecdb79fe4461aa321891b84f8c5a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:39:30 UTC) from {username='kudu', principal='kudu/127.20.171.126@KRBTEST.COM'} at 127.0.0.1:40922
I20260807 10:39:30.927258 3573 tablet_service.cc:1514] Processing DeleteTablet for tablet 929aecdb79fe4461aa321891b84f8c5a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:39:30 UTC) from {username='kudu', principal='kudu/127.20.171.126@KRBTEST.COM'} at 127.0.0.1:50836
I20260807 10:39:30.928457 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 3490
I20260807 10:39:30.939600 3946 tablet_replica.cc:330] T 929aecdb79fe4461aa321891b84f8c5a P 1c127bab40a54ba6a8b7f42f14e3b068: stopping tablet replica
I20260807 10:39:30.939966 3947 tablet_replica.cc:330] T 929aecdb79fe4461aa321891b84f8c5a P 04bb6b53e9584b818b9c9d9ee43f3e17: stopping tablet replica
I20260807 10:39:30.940418 3946 raft_consensus.cc:2229] T 929aecdb79fe4461aa321891b84f8c5a P 1c127bab40a54ba6a8b7f42f14e3b068 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 10:39:30.940476 3947 raft_consensus.cc:2229] T 929aecdb79fe4461aa321891b84f8c5a P 04bb6b53e9584b818b9c9d9ee43f3e17 [term 1 LEADER]: Raft consensus shutting down.
I20260807 10:39:30.941161 3946 raft_consensus.cc:2258] T 929aecdb79fe4461aa321891b84f8c5a P 1c127bab40a54ba6a8b7f42f14e3b068 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:39:30.941326 3947 raft_consensus.cc:2258] T 929aecdb79fe4461aa321891b84f8c5a P 04bb6b53e9584b818b9c9d9ee43f3e17 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:39:30.943663 3946 ts_tablet_manager.cc:1905] T 929aecdb79fe4461aa321891b84f8c5a P 1c127bab40a54ba6a8b7f42f14e3b068: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 10:39:30.943670 3947 ts_tablet_manager.cc:1905] T 929aecdb79fe4461aa321891b84f8c5a P 04bb6b53e9584b818b9c9d9ee43f3e17: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 10:39:30.947999 3948 tablet_replica.cc:330] T 929aecdb79fe4461aa321891b84f8c5a P ffa4ec639b714cbc810bdfee1a63fdc9: stopping tablet replica
I20260807 10:39:30.948486 3948 raft_consensus.cc:2229] T 929aecdb79fe4461aa321891b84f8c5a P ffa4ec639b714cbc810bdfee1a63fdc9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 10:39:30.949036 3948 raft_consensus.cc:2258] T 929aecdb79fe4461aa321891b84f8c5a P ffa4ec639b714cbc810bdfee1a63fdc9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:39:30.951453 3946 ts_tablet_manager.cc:1918] T 929aecdb79fe4461aa321891b84f8c5a P 1c127bab40a54ba6a8b7f42f14e3b068: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 10:39:30.951682 3946 log.cc:1196] T 929aecdb79fe4461aa321891b84f8c5a P 1c127bab40a54ba6a8b7f42f14e3b068: Deleting WAL directory at /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/ts-2/wal/wals/929aecdb79fe4461aa321891b84f8c5a
I20260807 10:39:30.952076 3947 ts_tablet_manager.cc:1918] T 929aecdb79fe4461aa321891b84f8c5a P 04bb6b53e9584b818b9c9d9ee43f3e17: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 10:39:30.952278 3947 log.cc:1196] T 929aecdb79fe4461aa321891b84f8c5a P 04bb6b53e9584b818b9c9d9ee43f3e17: Deleting WAL directory at /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/ts-1/wal/wals/929aecdb79fe4461aa321891b84f8c5a
I20260807 10:39:30.952512 3946 ts_tablet_manager.cc:1939] T 929aecdb79fe4461aa321891b84f8c5a P 1c127bab40a54ba6a8b7f42f14e3b068: Deleting consensus metadata
I20260807 10:39:30.952877 3947 ts_tablet_manager.cc:1939] T 929aecdb79fe4461aa321891b84f8c5a P 04bb6b53e9584b818b9c9d9ee43f3e17: Deleting consensus metadata
I20260807 10:39:30.954293 3948 ts_tablet_manager.cc:1905] T 929aecdb79fe4461aa321891b84f8c5a P ffa4ec639b714cbc810bdfee1a63fdc9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 10:39:30.954499 3435 catalog_manager.cc:4841] TS 1c127bab40a54ba6a8b7f42f14e3b068 (127.20.171.67:37957): tablet 929aecdb79fe4461aa321891b84f8c5a (table test-table [id=d6ceda5bd78b4407a0175705dc5659c0]) successfully deleted
I20260807 10:39:30.954581 3436 catalog_manager.cc:4841] TS 04bb6b53e9584b818b9c9d9ee43f3e17 (127.20.171.66:46259): tablet 929aecdb79fe4461aa321891b84f8c5a (table test-table [id=d6ceda5bd78b4407a0175705dc5659c0]) successfully deleted
I20260807 10:39:30.959117 3948 ts_tablet_manager.cc:1918] T 929aecdb79fe4461aa321891b84f8c5a P ffa4ec639b714cbc810bdfee1a63fdc9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 10:39:30.959316 3948 log.cc:1196] T 929aecdb79fe4461aa321891b84f8c5a P ffa4ec639b714cbc810bdfee1a63fdc9: Deleting WAL directory at /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/ts-0/wal/wals/929aecdb79fe4461aa321891b84f8c5a
I20260807 10:39:30.959887 3948 ts_tablet_manager.cc:1939] T 929aecdb79fe4461aa321891b84f8c5a P ffa4ec639b714cbc810bdfee1a63fdc9: Deleting consensus metadata
I20260807 10:39:30.961606 3435 catalog_manager.cc:4841] TS ffa4ec639b714cbc810bdfee1a63fdc9 (127.20.171.65:43563): tablet 929aecdb79fe4461aa321891b84f8c5a (table test-table [id=d6ceda5bd78b4407a0175705dc5659c0]) successfully deleted
I20260807 10:39:30.975268 3922 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:30.929902 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58082 (local address 127.20.171.65:43563)
0807 10:39:30.930128 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0807 10:39:30.930135 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:39:30.943107 (+ 12972us) server_negotiation.cc:407] Connection header received
0807 10:39:30.943561 (+ 454us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:39:30.943568 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:39:30.943671 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:39:30.943751 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:39:30.950098 (+ 6347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:30.951340 (+ 1242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:30.960748 (+ 9408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:30.961484 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:30.961615 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:39:30.968284 (+ 6669us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:39:30.968301 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:39:30.968319 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:39:30.968360 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:39:30.972112 (+ 3752us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:39:30.972930 (+ 818us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:39:30.972938 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:39:30.972942 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:39:30.973097 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:39:30.973604 (+ 507us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:39:30.973639 (+ 35us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:39:30.973642 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:39:30.974153 (+ 511us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:39:30.974476 (+ 323us) server_negotiation.cc:1035] Waiting for connection context
0807 10:39:30.974768 (+ 292us) server_negotiation.cc:299] Negotiation successful
0807 10:39:30.974940 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260807 10:39:30.975926 3635 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:39:31.065678 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 3490
I20260807 10:39:31.089126 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 3644
I20260807 10:39:31.103286 3921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:31.089949 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59594 (local address 127.20.171.66:46259)
0807 10:39:31.090132 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0807 10:39:31.090139 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:39:31.090215 (+ 76us) server_negotiation.cc:407] Connection header received
0807 10:39:31.090413 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:39:31.090418 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:39:31.090492 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:39:31.090619 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:39:31.091924 (+ 1305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:31.092894 (+ 970us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:31.094230 (+ 1336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:31.094668 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:31.094814 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:39:31.097483 (+ 2669us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:39:31.097495 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:39:31.097511 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:39:31.097548 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:39:31.100550 (+ 3002us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:39:31.101227 (+ 677us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:39:31.101233 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:39:31.101235 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:39:31.101382 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:39:31.101753 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:39:31.101759 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:39:31.101762 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:39:31.102115 (+ 353us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:39:31.102452 (+ 337us) server_negotiation.cc:1035] Waiting for connection context
0807 10:39:31.102719 (+ 267us) server_negotiation.cc:299] Negotiation successful
0807 10:39:31.102943 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260807 10:39:31.104027 3767 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:39:31.216391 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 3644
I20260807 10:39:31.238838 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 3776
I20260807 10:39:31.257303 3918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:31.244276 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43096 (local address 127.20.171.67:37957)
0807 10:39:31.244452 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0807 10:39:31.244460 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 10:39:31.244481 (+ 21us) server_negotiation.cc:407] Connection header received
0807 10:39:31.244698 (+ 217us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:39:31.244703 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:39:31.244763 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:39:31.244865 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:39:31.246254 (+ 1389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:31.246964 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:31.248424 (+ 1460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:31.248856 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:31.248988 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:39:31.251624 (+ 2636us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:39:31.251639 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:39:31.251655 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:39:31.251693 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:39:31.254284 (+ 2591us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:39:31.254958 (+ 674us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:39:31.254965 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:39:31.254967 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:39:31.255095 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:39:31.255520 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:39:31.255526 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:39:31.255529 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:39:31.255887 (+ 358us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:39:31.256196 (+ 309us) server_negotiation.cc:1035] Waiting for connection context
0807 10:39:31.256736 (+ 540us) server_negotiation.cc:299] Negotiation successful
0807 10:39:31.256977 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260807 10:39:31.257911 3902 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:39:31.345563 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 3776
I20260807 10:39:31.365491 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 3418
I20260807 10:39:31.366711 3482 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:39:31.479389 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 3418
I20260807 10:39:31.504951 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.171.126:38675
--webserver_interface=127.20.171.126
--webserver_port=40653
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.126.keytab
--principal=kudu/127.20.171.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.171.84:41719
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.171.126:38675
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:39:31.834147 3954 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:39:31.834446 3954 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:39:31.834613 3954 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:39:31.841599 3954 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 10:39:31.841722 3954 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:39:31.841830 3954 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:39:31.841936 3954 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 10:39:31.842023 3954 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 10:39:31.851265 3954 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.171.84:41719
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.171.126:38675
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.126.keytab
--principal=kudu/127.20.171.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.171.126:38675
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.171.126
--webserver_port=40653
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:39:31.852514 3954 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:39:31.853811 3954 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:39:31.865324 3959 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:39:31.865355 3960 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:39:31.865387 3962 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:39:31.866470 3954 server_base.cc:1034] running on GCE node
I20260807 10:39:31.867156 3954 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:39:31.868458 3954 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:39:31.869656 3954 hybrid_clock.cc:648] HybridClock initialized: now 1786099171869625 us; error 33 us; skew 500 ppm
I20260807 10:39:31.869999 3954 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:39:31 dist-test-slave-0b58 krb5kdc[2856](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099171, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:39:31.872905 3954 init.cc:377] Logged in from keytab as kudu/127.20.171.126@KRBTEST.COM (short username kudu)
I20260807 10:39:31.874269 3954 webserver.cc:460] Webserver started at http://127.20.171.126:40653/ using document root <none> and password file <none>
I20260807 10:39:31.874887 3954 fs_manager.cc:359] Metadata directory not provided
I20260807 10:39:31.874987 3954 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:39:31.880134 3954 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.001s
I20260807 10:39:31.884334 3969 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:39:31.885558 3954 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 10:39:31.885740 3954 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/master-0/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/master-0/wal
uuid: "ef15abefda7940d1a2bf5dacba18eace"
format_stamp: "Formatted at 2026-08-07 10:39:25 on dist-test-slave-0b58"
server_key: "5caabc34a06b6bd79f27a88f8a43dc6f"
server_key_iv: "18adc8d358f530959f6d572240c70135"
server_key_version: "encryptionkey@0"
I20260807 10:39:31.886713 3954 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:39:31.904431 3954 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:39:31.908788 3954 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:39:31.909075 3954 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:39:31.927829 3954 rpc_server.cc:307] RPC server started. Bound to: 127.20.171.126:38675
I20260807 10:39:31.927865 4021 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.171.126:38675 every 8 connection(s)
I20260807 10:39:31.929286 3954 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
I20260807 10:39:31.933418 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 3954
I20260807 10:39:31.934264 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.171.65:43563
--local_ip_for_outbound_sockets=127.20.171.65
--tserver_master_addrs=127.20.171.126:38675
--webserver_port=34755
--webserver_interface=127.20.171.65
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.65.keytab
--principal=kudu/127.20.171.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.171.84:41719
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 10:39:31.935842 4022 sys_catalog.cc:263] Verifying existing consensus state
I20260807 10:39:31.939050 4022 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ef15abefda7940d1a2bf5dacba18eace: Bootstrap starting.
I20260807 10:39:31.959518 4022 log.cc:824] T 00000000000000000000000000000000 P ef15abefda7940d1a2bf5dacba18eace: Log is configured to *not* fsync() on all Append() calls
I20260807 10:39:31.975364 4022 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ef15abefda7940d1a2bf5dacba18eace: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 10:39:31.975950 4022 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ef15abefda7940d1a2bf5dacba18eace: Bootstrap complete.
I20260807 10:39:31.985508 4022 raft_consensus.cc:348] T 00000000000000000000000000000000 P ef15abefda7940d1a2bf5dacba18eace [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ef15abefda7940d1a2bf5dacba18eace" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 38675 } }
I20260807 10:39:31.986423 4022 raft_consensus.cc:729] T 00000000000000000000000000000000 P ef15abefda7940d1a2bf5dacba18eace [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef15abefda7940d1a2bf5dacba18eace, State: Initialized, Role: FOLLOWER
I20260807 10:39:31.987025 4022 consensus_queue.cc:260] T 00000000000000000000000000000000 P ef15abefda7940d1a2bf5dacba18eace [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ef15abefda7940d1a2bf5dacba18eace" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 38675 } }
I20260807 10:39:31.987264 4022 raft_consensus.cc:388] T 00000000000000000000000000000000 P ef15abefda7940d1a2bf5dacba18eace [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 10:39:31.987404 4022 raft_consensus.cc:482] T 00000000000000000000000000000000 P ef15abefda7940d1a2bf5dacba18eace [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 10:39:31.987602 4022 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ef15abefda7940d1a2bf5dacba18eace [term 2 FOLLOWER]: Advancing to term 3
I20260807 10:39:31.991547 4022 raft_consensus.cc:504] T 00000000000000000000000000000000 P ef15abefda7940d1a2bf5dacba18eace [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ef15abefda7940d1a2bf5dacba18eace" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 38675 } }
I20260807 10:39:31.991998 4022 leader_election.cc:302] T 00000000000000000000000000000000 P ef15abefda7940d1a2bf5dacba18eace [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ef15abefda7940d1a2bf5dacba18eace; no voters:
I20260807 10:39:31.992671 4022 leader_election.cc:288] T 00000000000000000000000000000000 P ef15abefda7940d1a2bf5dacba18eace [CANDIDATE]: Term 3 election: Requested vote from peers
I20260807 10:39:31.992815 4026 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ef15abefda7940d1a2bf5dacba18eace [term 3 FOLLOWER]: Leader election won for term 3
I20260807 10:39:31.995000 4022 sys_catalog.cc:564] T 00000000000000000000000000000000 P ef15abefda7940d1a2bf5dacba18eace [sys.catalog]: configured and running, proceeding with master startup.
I20260807 10:39:31.996556 4026 raft_consensus.cc:686] T 00000000000000000000000000000000 P ef15abefda7940d1a2bf5dacba18eace [term 3 LEADER]: Becoming Leader. State: Replica: ef15abefda7940d1a2bf5dacba18eace, State: Running, Role: LEADER
I20260807 10:39:31.997227 4026 consensus_queue.cc:237] T 00000000000000000000000000000000 P ef15abefda7940d1a2bf5dacba18eace [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ef15abefda7940d1a2bf5dacba18eace" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 38675 } }
I20260807 10:39:31.999920 4029 sys_catalog.cc:455] T 00000000000000000000000000000000 P ef15abefda7940d1a2bf5dacba18eace [sys.catalog]: SysCatalogTable state changed. Reason: New leader ef15abefda7940d1a2bf5dacba18eace. Latest consensus state: current_term: 3 leader_uuid: "ef15abefda7940d1a2bf5dacba18eace" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ef15abefda7940d1a2bf5dacba18eace" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 38675 } } }
I20260807 10:39:32.000290 4029 sys_catalog.cc:458] T 00000000000000000000000000000000 P ef15abefda7940d1a2bf5dacba18eace [sys.catalog]: This master's current role is: LEADER
I20260807 10:39:32.000844 4027 sys_catalog.cc:455] T 00000000000000000000000000000000 P ef15abefda7940d1a2bf5dacba18eace [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "ef15abefda7940d1a2bf5dacba18eace" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ef15abefda7940d1a2bf5dacba18eace" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 38675 } } }
I20260807 10:39:32.001116 4027 sys_catalog.cc:458] T 00000000000000000000000000000000 P ef15abefda7940d1a2bf5dacba18eace [sys.catalog]: This master's current role is: LEADER
I20260807 10:39:32.011502 4036 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 10:39:32.020358 4036 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 10:39:32.021860 4036 catalog_manager.cc:1259] Loaded cluster ID: 2caa8cd5a5b94bee96036c9c836bf92c
I20260807 10:39:32.022006 4036 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260807 10:39:32.024204 4036 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f53be0899ad google::LogMessage::Fail() at ??:0
@ 0x7f53be08c88a google::LogMessage::SendToLog() at ??:0
@ 0x7f53be0894de google::LogMessage::Flush() at ??:0
@ 0x7f53be08aa19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f53d3ac0512 kudu::master::CatalogManager::PrepareForLeadershipTask()::$_6::operator()() at ??:0
@ 0x7f53d3abd976 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f53d3b45610 kudu::master::CatalogManager::ElectedAsLeaderCb()::$_2::operator()() at ??:0
@ 0x7f53d3b45439 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7f53c0cd5345 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f53c0cd891c kudu::ThreadPool::CreateThread()::$_2::operator()() at ??:0
@ 0x7f53c0cd8799 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7f53c0cb3eaf kudu::Thread::SuperviseThread() at ??:0
@ 0x7f53c3f8d6db start_thread at ??:0
@ 0x7f53bcf2361f clone at ??:0
W20260807 10:39:32.319259 4024 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:39:32.319530 4024 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:39:32.319628 4024 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:39:32.326453 4024 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:39:32.326557 4024 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:39:32.326749 4024 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.171.65
I20260807 10:39:32.335880 4024 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.171.84:41719
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.65.keytab
--principal=kudu/127.20.171.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.171.65:43563
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.171.65
--webserver_port=34755
--tserver_master_addrs=127.20.171.126:38675
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.171.65
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:39:32.337196 4024 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:39:32.338577 4024 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:39:32.351172 4066 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:39:32.351251 4065 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:39:32.351143 4068 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:39:32.357429 4024 server_base.cc:1034] running on GCE node
I20260807 10:39:32.358031 4024 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:39:32.358880 4024 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:39:32.360097 4024 hybrid_clock.cc:648] HybridClock initialized: now 1786099172360062 us; error 46 us; skew 500 ppm
I20260807 10:39:32.360459 4024 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:39:32 dist-test-slave-0b58 krb5kdc[2856](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099172, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:39:32.363418 4024 init.cc:377] Logged in from keytab as kudu/127.20.171.65@KRBTEST.COM (short username kudu)
I20260807 10:39:32.364836 4024 webserver.cc:460] Webserver started at http://127.20.171.65:34755/ using document root <none> and password file <none>
I20260807 10:39:32.365434 4024 fs_manager.cc:359] Metadata directory not provided
I20260807 10:39:32.365526 4024 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:39:32.370621 4024 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.005s sys 0.000s
I20260807 10:39:32.373100 4075 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:39:32.374364 4024 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 10:39:32.374508 4024 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/ts-0/wal
uuid: "ffa4ec639b714cbc810bdfee1a63fdc9"
format_stamp: "Formatted at 2026-08-07 10:39:26 on dist-test-slave-0b58"
server_key: "21fc6ec42a108cbe7a15c46e78fadb74"
server_key_iv: "fd445e37302689812ecdcdc462417275"
server_key_version: "encryptionkey@0"
I20260807 10:39:32.375375 4024 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:39:32.398687 4024 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:39:32.402480 4024 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:39:32.402684 4024 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:39:32.403527 4024 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:39:32.404762 4024 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:39:32.404843 4024 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:39:32.404914 4024 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:39:32.404965 4024 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:39:32.439023 4024 rpc_server.cc:307] RPC server started. Bound to: 127.20.171.65:43563
I20260807 10:39:32.439116 4189 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.171.65:43563 every 8 connection(s)
I20260807 10:39:32.440562 4024 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/ts-0/data/info.pb
I20260807 10:39:32.445307 4192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:32.443461 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:38675 (local address 127.20.171.65:35497)
0807 10:39:32.444117 (+ 656us) negotiation.cc:107] Waiting for socket to connect
0807 10:39:32.444476 (+ 359us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.126:38675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":434,"thread_start_us":250,"threads_started":1}
W20260807 10:39:32.445953 4190 heartbeater.cc:644] Failed to heartbeat to 127.20.171.126:38675 (0 consecutive failures): Network error: Failed to ping master at 127.20.171.126:38675: Client connection negotiation failed: client connection to 127.20.171.126:38675: connect: Connection refused (error 111)
I20260807 10:39:32.446761 4192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:32.446467 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:38675 (local address 127.20.171.65:41875)
0807 10:39:32.446594 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0807 10:39:32.446657 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.126:38675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
I20260807 10:39:32.447497 4192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:32.447209 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:38675 (local address 127.20.171.65:46003)
0807 10:39:32.447325 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0807 10:39:32.447395 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.126:38675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260807 10:39:32.447767 4190 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260807 10:39:32.448767 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 4024
I20260807 10:39:32.449478 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.171.66:46259
--local_ip_for_outbound_sockets=127.20.171.66
--tserver_master_addrs=127.20.171.126:38675
--webserver_port=46167
--webserver_interface=127.20.171.66
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.66.keytab
--principal=kudu/127.20.171.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.171.84:41719
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:39:32.782033 4193 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:39:32.782318 4193 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:39:32.782414 4193 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:39:32.789335 4193 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:39:32.789434 4193 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:39:32.789539 4193 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.171.66
I20260807 10:39:32.798833 4193 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.171.84:41719
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.66.keytab
--principal=kudu/127.20.171.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.171.66:46259
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.171.66
--webserver_port=46167
--tserver_master_addrs=127.20.171.126:38675
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.171.66
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:39:32.800063 4193 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:39:32.801414 4193 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:39:32.814081 4198 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:39:32.814270 4199 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:39:32.814277 4201 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:39:32.815186 4193 server_base.cc:1034] running on GCE node
I20260807 10:39:32.815771 4193 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:39:32.816737 4193 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:39:32.817986 4193 hybrid_clock.cc:648] HybridClock initialized: now 1786099172817919 us; error 52 us; skew 500 ppm
I20260807 10:39:32.818320 4193 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:39:32 dist-test-slave-0b58 krb5kdc[2856](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099172, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:39:32.821542 4193 init.cc:377] Logged in from keytab as kudu/127.20.171.66@KRBTEST.COM (short username kudu)
I20260807 10:39:32.822921 4193 webserver.cc:460] Webserver started at http://127.20.171.66:46167/ using document root <none> and password file <none>
I20260807 10:39:32.823520 4193 fs_manager.cc:359] Metadata directory not provided
I20260807 10:39:32.823617 4193 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:39:32.828723 4193 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260807 10:39:32.831228 4209 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:39:32.832553 4193 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 10:39:32.832728 4193 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/ts-1/wal
uuid: "04bb6b53e9584b818b9c9d9ee43f3e17"
format_stamp: "Formatted at 2026-08-07 10:39:26 on dist-test-slave-0b58"
server_key: "85e9c8aadebb3f3ac976eaae312b33df"
server_key_iv: "5224412a58919bc5e1b20c8f7b885ea8"
server_key_version: "encryptionkey@0"
I20260807 10:39:32.833679 4193 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:39:32.857684 4193 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:39:32.861907 4193 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:39:32.862197 4193 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:39:32.863260 4193 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:39:32.864676 4193 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:39:32.864801 4193 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:39:32.864938 4193 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:39:32.865046 4193 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:39:32.899034 4193 rpc_server.cc:307] RPC server started. Bound to: 127.20.171.66:46259
I20260807 10:39:32.899163 4323 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.171.66:46259 every 8 connection(s)
I20260807 10:39:32.900461 4193 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/ts-1/data/info.pb
I20260807 10:39:32.905222 4326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:32.903297 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:38675 (local address 127.20.171.66:37407)
0807 10:39:32.904074 (+ 777us) negotiation.cc:107] Waiting for socket to connect
0807 10:39:32.904435 (+ 361us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.126:38675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":500,"thread_start_us":294,"threads_started":1}
W20260807 10:39:32.905867 4324 heartbeater.cc:644] Failed to heartbeat to 127.20.171.126:38675 (0 consecutive failures): Network error: Failed to ping master at 127.20.171.126:38675: Client connection negotiation failed: client connection to 127.20.171.126:38675: connect: Connection refused (error 111)
I20260807 10:39:32.906662 4326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:32.906349 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:38675 (local address 127.20.171.66:47825)
0807 10:39:32.906486 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0807 10:39:32.906558 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.126:38675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
I20260807 10:39:32.907469 4326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:32.907162 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:38675 (local address 127.20.171.66:39797)
0807 10:39:32.907288 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0807 10:39:32.907360 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.126:38675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260807 10:39:32.907716 4324 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260807 10:39:32.908589 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 4193
I20260807 10:39:32.909180 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.171.67:37957
--local_ip_for_outbound_sockets=127.20.171.67
--tserver_master_addrs=127.20.171.126:38675
--webserver_port=42841
--webserver_interface=127.20.171.67
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.67.keytab
--principal=kudu/127.20.171.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.171.84:41719
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:39:33.237994 4327 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:39:33.238269 4327 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:39:33.238466 4327 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:39:33.245450 4327 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:39:33.245543 4327 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:39:33.245750 4327 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.171.67
I20260807 10:39:33.255054 4327 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.171.84:41719
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.67.keytab
--principal=kudu/127.20.171.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.171.67:37957
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.171.67
--webserver_port=42841
--tserver_master_addrs=127.20.171.126:38675
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.171.67
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:39:33.256345 4327 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:39:33.257668 4327 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:39:33.270576 4333 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:39:33.270604 4336 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:39:33.270736 4334 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:39:33.271767 4327 server_base.cc:1034] running on GCE node
I20260807 10:39:33.272364 4327 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:39:33.273193 4327 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:39:33.274387 4327 hybrid_clock.cc:648] HybridClock initialized: now 1786099173274359 us; error 28 us; skew 500 ppm
I20260807 10:39:33.274634 4327 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:39:33 dist-test-slave-0b58 krb5kdc[2856](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099173, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:39:33.277541 4327 init.cc:377] Logged in from keytab as kudu/127.20.171.67@KRBTEST.COM (short username kudu)
I20260807 10:39:33.278952 4327 webserver.cc:460] Webserver started at http://127.20.171.67:42841/ using document root <none> and password file <none>
I20260807 10:39:33.279623 4327 fs_manager.cc:359] Metadata directory not provided
I20260807 10:39:33.279717 4327 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:39:33.284716 4327 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.001s
I20260807 10:39:33.287118 4343 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:39:33.288446 4327 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 10:39:33.288612 4327 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/ts-2/wal
uuid: "1c127bab40a54ba6a8b7f42f14e3b068"
format_stamp: "Formatted at 2026-08-07 10:39:27 on dist-test-slave-0b58"
server_key: "87e2eb06cff63793f2dcbcefb62ed4e7"
server_key_iv: "80693a3894185807f903c6cb97842d90"
server_key_version: "encryptionkey@0"
I20260807 10:39:33.289536 4327 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:39:33.307051 4327 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:39:33.311080 4327 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:39:33.311367 4327 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:39:33.312302 4327 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:39:33.313510 4327 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:39:33.313630 4327 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:39:33.313767 4327 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:39:33.313856 4327 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:39:33.345614 4327 rpc_server.cc:307] RPC server started. Bound to: 127.20.171.67:37957
I20260807 10:39:33.345698 4457 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.171.67:37957 every 8 connection(s)
I20260807 10:39:33.347069 4327 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786098956060137-21165-0/minicluster-data/ts-2/data/info.pb
I20260807 10:39:33.348698 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 4327
I20260807 10:39:33.351876 4461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:33.350037 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:38675 (local address 127.20.171.67:41565)
0807 10:39:33.350867 (+ 830us) negotiation.cc:107] Waiting for socket to connect
0807 10:39:33.351063 (+ 196us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.126:38675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":600,"thread_start_us":399,"threads_started":1}
W20260807 10:39:33.352473 4458 heartbeater.cc:644] Failed to heartbeat to 127.20.171.126:38675 (0 consecutive failures): Network error: Failed to ping master at 127.20.171.126:38675: Client connection negotiation failed: client connection to 127.20.171.126:38675: connect: Connection refused (error 111)
I20260807 10:39:33.353221 4461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:33.352903 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:38675 (local address 127.20.171.67:48191)
0807 10:39:33.353037 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0807 10:39:33.353105 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.126:38675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
I20260807 10:39:33.353953 4461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:33.353678 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:38675 (local address 127.20.171.67:37605)
0807 10:39:33.353794 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0807 10:39:33.353859 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.126:38675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260807 10:39:33.354185 4458 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260807 10:39:33.449301 4462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:33.448426 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:38675 (local address 127.20.171.65:35533)
0807 10:39:33.448960 (+ 534us) negotiation.cc:107] Waiting for socket to connect
0807 10:39:33.449073 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.126:38675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":419,"thread_start_us":266,"threads_started":1}
I20260807 10:39:33.909091 4463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:33.908332 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:38675 (local address 127.20.171.66:58537)
0807 10:39:33.908766 (+ 434us) negotiation.cc:107] Waiting for socket to connect
0807 10:39:33.908875 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.126:38675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":331,"thread_start_us":205,"threads_started":1}
I20260807 10:39:34.355495 4464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:34.354618 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:38675 (local address 127.20.171.67:39175)
0807 10:39:34.355102 (+ 484us) negotiation.cc:107] Waiting for socket to connect
0807 10:39:34.355256 (+ 154us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.126:38675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":381,"thread_start_us":258,"threads_started":1}
I20260807 10:39:34.450822 4465 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:34.450149 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:38675 (local address 127.20.171.65:40579)
0807 10:39:34.450571 (+ 422us) negotiation.cc:107] Waiting for socket to connect
0807 10:39:34.450650 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.126:38675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":330,"thread_start_us":212,"threads_started":1}
I20260807 10:39:34.910652 4466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:34.909935 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:38675 (local address 127.20.171.66:37109)
0807 10:39:34.910417 (+ 482us) negotiation.cc:107] Waiting for socket to connect
0807 10:39:34.910495 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.126:38675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":390,"thread_start_us":237,"threads_started":1}
I20260807 10:39:35.357151 4467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:35.356464 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:38675 (local address 127.20.171.67:59255)
0807 10:39:35.356910 (+ 446us) negotiation.cc:107] Waiting for socket to connect
0807 10:39:35.356988 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.126:38675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":354,"thread_start_us":232,"threads_started":1}
I20260807 10:39:35.452198 4468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:35.451589 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:38675 (local address 127.20.171.65:60993)
0807 10:39:35.451959 (+ 370us) negotiation.cc:107] Waiting for socket to connect
0807 10:39:35.452030 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.126:38675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":288,"thread_start_us":197,"threads_started":1}
I20260807 10:39:35.912122 4469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:35.911490 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:38675 (local address 127.20.171.66:50807)
0807 10:39:35.911882 (+ 392us) negotiation.cc:107] Waiting for socket to connect
0807 10:39:35.911956 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.126:38675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":307,"thread_start_us":208,"threads_started":1}
I20260807 10:39:36.358631 4470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:36.357977 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:38675 (local address 127.20.171.67:50527)
0807 10:39:36.358384 (+ 407us) negotiation.cc:107] Waiting for socket to connect
0807 10:39:36.358461 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.126:38675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":317,"thread_start_us":218,"threads_started":1}
I20260807 10:39:36.453889 4471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:36.453081 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:38675 (local address 127.20.171.65:39861)
0807 10:39:36.453628 (+ 547us) negotiation.cc:107] Waiting for socket to connect
0807 10:39:36.453707 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.126:38675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":430,"thread_start_us":312,"threads_started":1}
I20260807 10:39:36.913772 4472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:36.913004 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:38675 (local address 127.20.171.66:54653)
0807 10:39:36.913475 (+ 471us) negotiation.cc:107] Waiting for socket to connect
0807 10:39:36.913554 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.126:38675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":374,"thread_start_us":246,"threads_started":1}
I20260807 10:39:37.360452 4473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:37.359578 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:38675 (local address 127.20.171.67:53679)
0807 10:39:37.360090 (+ 512us) negotiation.cc:107] Waiting for socket to connect
0807 10:39:37.360196 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.126:38675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":407,"thread_start_us":280,"threads_started":1}
I20260807 10:39:37.455564 4474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:37.454852 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:38675 (local address 127.20.171.65:39083)
0807 10:39:37.455309 (+ 457us) negotiation.cc:107] Waiting for socket to connect
0807 10:39:37.455391 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.126:38675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":360,"thread_start_us":230,"threads_started":1}
I20260807 10:39:37.915374 4475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:37.914643 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:38675 (local address 127.20.171.66:36291)
0807 10:39:37.915119 (+ 476us) negotiation.cc:107] Waiting for socket to connect
0807 10:39:37.915208 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.126:38675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":377,"thread_start_us":244,"threads_started":1}
I20260807 10:39:38.362066 4476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:38.361346 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:38675 (local address 127.20.171.67:60957)
0807 10:39:38.361822 (+ 476us) negotiation.cc:107] Waiting for socket to connect
0807 10:39:38.361904 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.126:38675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":380,"thread_start_us":249,"threads_started":1}
I20260807 10:39:38.457113 4477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:38.456442 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:38675 (local address 127.20.171.65:40037)
0807 10:39:38.456867 (+ 425us) negotiation.cc:107] Waiting for socket to connect
0807 10:39:38.456957 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.126:38675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":326,"thread_start_us":216,"threads_started":1}
I20260807 10:39:38.917024 4478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:38.916301 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:38675 (local address 127.20.171.66:50677)
0807 10:39:38.916760 (+ 459us) negotiation.cc:107] Waiting for socket to connect
0807 10:39:38.916865 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.126:38675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":361,"thread_start_us":235,"threads_started":1}
I20260807 10:39:39.363811 4479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:39.363014 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:38675 (local address 127.20.171.67:58037)
0807 10:39:39.363535 (+ 521us) negotiation.cc:107] Waiting for socket to connect
0807 10:39:39.363630 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.126:38675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":380,"thread_start_us":261,"threads_started":1}
I20260807 10:39:39.458896 4480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:39.458049 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:38675 (local address 127.20.171.65:48725)
0807 10:39:39.458578 (+ 529us) negotiation.cc:107] Waiting for socket to connect
0807 10:39:39.458666 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.126:38675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":423,"thread_start_us":258,"threads_started":1}
I20260807 10:39:39.918772 4481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:39.917923 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:38675 (local address 127.20.171.66:56979)
0807 10:39:39.918446 (+ 523us) negotiation.cc:107] Waiting for socket to connect
0807 10:39:39.918526 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.126:38675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":415,"thread_start_us":234,"threads_started":1}
I20260807 10:39:40.365646 4482 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:40.364797 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:38675 (local address 127.20.171.67:48863)
0807 10:39:40.365254 (+ 457us) negotiation.cc:107] Waiting for socket to connect
0807 10:39:40.365330 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.126:38675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":354,"thread_start_us":199,"threads_started":1}
I20260807 10:39:40.460721 4483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:40.459789 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:38675 (local address 127.20.171.65:38341)
0807 10:39:40.460390 (+ 601us) negotiation.cc:107] Waiting for socket to connect
0807 10:39:40.460513 (+ 123us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.126:38675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":439,"thread_start_us":274,"threads_started":1}
I20260807 10:39:40.920523 4484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:40.919699 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:38675 (local address 127.20.171.66:36217)
0807 10:39:40.920231 (+ 532us) negotiation.cc:107] Waiting for socket to connect
0807 10:39:40.920366 (+ 135us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.126:38675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":436,"thread_start_us":276,"threads_started":1}
I20260807 10:39:41.367200 4485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:41.366562 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:38675 (local address 127.20.171.67:48027)
0807 10:39:41.366965 (+ 403us) negotiation.cc:107] Waiting for socket to connect
0807 10:39:41.367043 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.126:38675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":316,"thread_start_us":209,"threads_started":1}
I20260807 10:39:41.462349 4486 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:41.461623 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:38675 (local address 127.20.171.65:37345)
0807 10:39:41.462093 (+ 470us) negotiation.cc:107] Waiting for socket to connect
0807 10:39:41.462176 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.126:38675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":371,"thread_start_us":222,"threads_started":1}
I20260807 10:39:41.921989 4487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:41.921294 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:38675 (local address 127.20.171.66:39731)
0807 10:39:41.921756 (+ 462us) negotiation.cc:107] Waiting for socket to connect
0807 10:39:41.921828 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.126:38675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":370,"thread_start_us":228,"threads_started":1}
I20260807 10:39:42.368924 4488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:42.368092 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:38675 (local address 127.20.171.67:35415)
0807 10:39:42.368660 (+ 568us) negotiation.cc:107] Waiting for socket to connect
0807 10:39:42.368752 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.126:38675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":468,"thread_start_us":303,"threads_started":1}
I20260807 10:39:42.463899 4489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:42.463253 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:38675 (local address 127.20.171.65:51137)
0807 10:39:42.463672 (+ 419us) negotiation.cc:107] Waiting for socket to connect
0807 10:39:42.463749 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.126:38675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":334,"thread_start_us":242,"threads_started":1}
I20260807 10:39:42.923619 4490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:42.922800 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:38675 (local address 127.20.171.66:46387)
0807 10:39:42.923313 (+ 513us) negotiation.cc:107] Waiting for socket to connect
0807 10:39:42.923391 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.126:38675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":407,"thread_start_us":305,"threads_started":1}
I20260807 10:39:43.370441 4491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:43.369757 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:38675 (local address 127.20.171.67:59025)
0807 10:39:43.370212 (+ 455us) negotiation.cc:107] Waiting for socket to connect
0807 10:39:43.370290 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.126:38675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":362,"thread_start_us":265,"threads_started":1}
I20260807 10:39:43.465517 4492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:43.464780 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:38675 (local address 127.20.171.65:42603)
0807 10:39:43.465238 (+ 458us) negotiation.cc:107] Waiting for socket to connect
0807 10:39:43.465333 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.126:38675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":348,"thread_start_us":226,"threads_started":1}
I20260807 10:39:43.925218 4493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:43.924548 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:38675 (local address 127.20.171.66:51639)
0807 10:39:43.924956 (+ 408us) negotiation.cc:107] Waiting for socket to connect
0807 10:39:43.925043 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.126:38675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":322,"thread_start_us":209,"threads_started":1}
I20260807 10:39:44.371951 4494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:44.371247 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:38675 (local address 127.20.171.67:45163)
0807 10:39:44.371697 (+ 450us) negotiation.cc:107] Waiting for socket to connect
0807 10:39:44.371783 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.126:38675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":357,"thread_start_us":253,"threads_started":1}
I20260807 10:39:44.467270 4495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:44.466585 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:38675 (local address 127.20.171.65:36797)
0807 10:39:44.467031 (+ 446us) negotiation.cc:107] Waiting for socket to connect
0807 10:39:44.467111 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.126:38675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":343,"thread_start_us":242,"threads_started":1}
I20260807 10:39:44.926862 4496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:44.926181 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:38675 (local address 127.20.171.66:47947)
0807 10:39:44.926621 (+ 440us) negotiation.cc:107] Waiting for socket to connect
0807 10:39:44.926709 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.126:38675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":320,"thread_start_us":212,"threads_started":1}
I20260807 10:39:45.373497 4497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:45.372811 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:38675 (local address 127.20.171.67:41081)
0807 10:39:45.373260 (+ 449us) negotiation.cc:107] Waiting for socket to connect
0807 10:39:45.373339 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.126:38675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":345,"thread_start_us":237,"threads_started":1}
I20260807 10:39:45.468957 4498 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:45.468172 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:38675 (local address 127.20.171.65:43051)
0807 10:39:45.468672 (+ 500us) negotiation.cc:107] Waiting for socket to connect
0807 10:39:45.468764 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.126:38675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":404,"thread_start_us":251,"threads_started":1}
I20260807 10:39:45.928634 4499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:45.927798 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:38675 (local address 127.20.171.66:33015)
0807 10:39:45.928347 (+ 549us) negotiation.cc:107] Waiting for socket to connect
0807 10:39:45.928443 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.126:38675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":387,"thread_start_us":226,"threads_started":1}
I20260807 10:39:46.375123 4500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:46.374323 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:38675 (local address 127.20.171.67:45797)
0807 10:39:46.374845 (+ 522us) negotiation.cc:107] Waiting for socket to connect
0807 10:39:46.374933 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.126:38675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":431,"thread_start_us":296,"threads_started":1}
I20260807 10:39:46.470527 4501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:46.469830 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:38675 (local address 127.20.171.65:50301)
0807 10:39:46.470259 (+ 429us) negotiation.cc:107] Waiting for socket to connect
0807 10:39:46.470349 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.126:38675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":324,"thread_start_us":207,"threads_started":1}
I20260807 10:39:46.930214 4502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:46.929531 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:38675 (local address 127.20.171.66:42127)
0807 10:39:46.929946 (+ 415us) negotiation.cc:107] Waiting for socket to connect
0807 10:39:46.930022 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.126:38675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":295,"thread_start_us":197,"threads_started":1}
I20260807 10:39:47.376808 4503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:47.375988 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:38675 (local address 127.20.171.67:35781)
0807 10:39:47.376549 (+ 561us) negotiation.cc:107] Waiting for socket to connect
0807 10:39:47.376629 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.126:38675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":461,"thread_start_us":330,"threads_started":1}
I20260807 10:39:47.472353 4504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:47.471554 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:38675 (local address 127.20.171.65:48613)
0807 10:39:47.471992 (+ 438us) negotiation.cc:107] Waiting for socket to connect
0807 10:39:47.472100 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.126:38675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":338,"thread_start_us":236,"threads_started":1}
I20260807 10:39:47.931950 4505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:47.931214 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:38675 (local address 127.20.171.66:50453)
0807 10:39:47.931651 (+ 437us) negotiation.cc:107] Waiting for socket to connect
0807 10:39:47.931767 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.126:38675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":340,"thread_start_us":221,"threads_started":1}
I20260807 10:39:48.349911 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 4024
I20260807 10:39:48.373474 4506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:48.351035 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57636 (local address 127.20.171.65:43563)
0807 10:39:48.351708 (+ 673us) server_negotiation.cc:206] Beginning negotiation
0807 10:39:48.351725 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0807 10:39:48.351768 (+ 43us) server_negotiation.cc:407] Connection header received
0807 10:39:48.353894 (+ 2126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:39:48.353904 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:39:48.354355 (+ 451us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:39:48.354632 (+ 277us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:39:48.355907 (+ 1275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:48.357143 (+ 1236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:48.358426 (+ 1283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:48.359082 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:48.359231 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:39:48.366725 (+ 7494us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:39:48.366734 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:39:48.366750 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:39:48.366795 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:39:48.370108 (+ 3313us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:39:48.370842 (+ 734us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:39:48.370851 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:39:48.370866 (+ 15us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:39:48.371048 (+ 182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:39:48.371442 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:39:48.371447 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:39:48.371450 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:39:48.371967 (+ 517us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:39:48.372309 (+ 342us) server_negotiation.cc:1035] Waiting for connection context
0807 10:39:48.372787 (+ 478us) server_negotiation.cc:299] Negotiation successful
0807 10:39:48.373204 (+ 417us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":463,"thread_start_us":317,"threads_started":1}
I20260807 10:39:48.374842 4185 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:39:48.388952 4508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:48.378010 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:38675 (local address 127.20.171.67:36265)
0807 10:39:48.388667 (+ 10657us) negotiation.cc:107] Waiting for socket to connect
0807 10:39:48.388769 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.126:38675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":10531,"thread_start_us":10439,"threads_started":1}
I20260807 10:39:48.461229 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 4024
I20260807 10:39:48.482475 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 4193
I20260807 10:39:48.500378 4509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:48.483447 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52660 (local address 127.20.171.66:46259)
0807 10:39:48.484045 (+ 598us) server_negotiation.cc:206] Beginning negotiation
0807 10:39:48.484059 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0807 10:39:48.484096 (+ 37us) server_negotiation.cc:407] Connection header received
0807 10:39:48.485723 (+ 1627us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:39:48.485732 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:39:48.486156 (+ 424us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:39:48.486517 (+ 361us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:39:48.488023 (+ 1506us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:48.489373 (+ 1350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:48.490613 (+ 1240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:48.491268 (+ 655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:48.491459 (+ 191us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:39:48.494140 (+ 2681us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:39:48.494154 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:39:48.494168 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:39:48.494208 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:39:48.497016 (+ 2808us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:39:48.497725 (+ 709us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:39:48.497732 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:39:48.497738 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:39:48.497907 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:39:48.498283 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:39:48.498288 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:39:48.498291 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:39:48.498802 (+ 511us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:39:48.499130 (+ 328us) server_negotiation.cc:1035] Waiting for connection context
0807 10:39:48.499588 (+ 458us) server_negotiation.cc:299] Negotiation successful
0807 10:39:48.500015 (+ 427us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":420,"thread_start_us":296,"threads_started":1}
I20260807 10:39:48.501801 4319 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:39:48.584740 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 4193
I20260807 10:39:48.607957 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 4327
I20260807 10:39:48.625082 4511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:48.608961 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33792 (local address 127.20.171.67:37957)
0807 10:39:48.609588 (+ 627us) server_negotiation.cc:206] Beginning negotiation
0807 10:39:48.609601 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 10:39:48.609644 (+ 43us) server_negotiation.cc:407] Connection header received
0807 10:39:48.611248 (+ 1604us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:39:48.611258 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:39:48.611659 (+ 401us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:39:48.611946 (+ 287us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:39:48.613544 (+ 1598us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:48.614755 (+ 1211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:48.616022 (+ 1267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:48.616728 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:48.616858 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:39:48.619421 (+ 2563us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:39:48.619428 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:39:48.619442 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:39:48.619488 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:39:48.622280 (+ 2792us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:39:48.622912 (+ 632us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:39:48.622918 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:39:48.622924 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:39:48.623087 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:39:48.623406 (+ 319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:39:48.623409 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:39:48.623411 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:39:48.623869 (+ 458us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:39:48.624101 (+ 232us) server_negotiation.cc:1035] Waiting for connection context
0807 10:39:48.624446 (+ 345us) server_negotiation.cc:299] Negotiation successful
0807 10:39:48.624761 (+ 315us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":442,"thread_start_us":304,"threads_started":1}
I20260807 10:39:48.626511 4453 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:39:48.708057 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 4327
2026-08-07T10:39:48Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (25003 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 10:39:48 dist-test-slave-0b58 krb5kdc[4515](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 10:39:48 dist-test-slave-0b58 krb5kdc[4515](info): set up 2 sockets
Aug 07 10:39:48 dist-test-slave-0b58 krb5kdc[4515](info): commencing operation
krb5kdc: starting...
W20260807 10:39:49.830828 21165 mini_kdc.cc:121] Time spent starting KDC: real 1.079s user 0.000s sys 0.042s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/krb5kdc/test-user.keytab.
Aug 07 10:39:50 dist-test-slave-0b58 krb5kdc[4515](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099190, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T10:39:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T10:39:50Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.171.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.171.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.171.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.126.keytab.
Entry for principal kudu/127.20.171.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.126.keytab.
I20260807 10:39:50.140666 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.171.126:44373
--webserver_interface=127.20.171.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.126.keytab
--principal=kudu/127.20.171.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.171.84:36941
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.171.126:44373
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:39:50.503818 4528 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:39:50.504105 4528 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:39:50.504339 4528 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:39:50.511865 4528 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260807 10:39:50.511981 4528 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260807 10:39:50.512051 4528 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260807 10:39:50.512130 4528 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 10:39:50.512228 4528 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:39:50.512374 4528 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:39:50.512466 4528 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 10:39:50.512544 4528 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 10:39:50.522887 4528 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.171.84:36941
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.20.171.126:44373
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.126.keytab
--principal=kudu/127.20.171.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.171.126:44373
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.171.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:39:50.524179 4528 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:39:50.525550 4528 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:39:50.537843 4535 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:39:50.537894 4537 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:39:50.537962 4534 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:39:50.538674 4528 server_base.cc:1034] running on GCE node
I20260807 10:39:50.539451 4528 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:39:50.540946 4528 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:39:50.542164 4528 hybrid_clock.cc:648] HybridClock initialized: now 1786099190542085 us; error 49 us; skew 500 ppm
I20260807 10:39:50.542531 4528 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:39:50 dist-test-slave-0b58 krb5kdc[4515](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099190, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:39:50.545902 4528 init.cc:377] Logged in from keytab as kudu/127.20.171.126@KRBTEST.COM (short username kudu)
I20260807 10:39:50.547459 4528 webserver.cc:460] Webserver started at http://127.20.171.126:38647/ using document root <none> and password file <none>
I20260807 10:39:50.548164 4528 fs_manager.cc:359] Metadata directory not provided
I20260807 10:39:50.548334 4528 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:39:50.548704 4528 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:39:50.551820 4528 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/master-0/data/instance:
uuid: "3338383b9f1e48f99d0d1a2579e10d22"
format_stamp: "Formatted at 2026-08-07 10:39:50 on dist-test-slave-0b58"
server_key: "bcbb2ad5895e8174f3b0b740110d88a3"
server_key_iv: "30f6d338e7bcc11da236c446c51cf3e1"
server_key_version: "encryptionkey@0"
I20260807 10:39:50.552666 4528 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/master-0/wal/instance:
uuid: "3338383b9f1e48f99d0d1a2579e10d22"
format_stamp: "Formatted at 2026-08-07 10:39:50 on dist-test-slave-0b58"
server_key: "bcbb2ad5895e8174f3b0b740110d88a3"
server_key_iv: "30f6d338e7bcc11da236c446c51cf3e1"
server_key_version: "encryptionkey@0"
I20260807 10:39:50.557946 4528 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.001s
I20260807 10:39:50.561420 4544 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:39:50.562706 4528 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.004s
I20260807 10:39:50.562884 4528 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/master-0/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/master-0/wal
uuid: "3338383b9f1e48f99d0d1a2579e10d22"
format_stamp: "Formatted at 2026-08-07 10:39:50 on dist-test-slave-0b58"
server_key: "bcbb2ad5895e8174f3b0b740110d88a3"
server_key_iv: "30f6d338e7bcc11da236c446c51cf3e1"
server_key_version: "encryptionkey@0"
I20260807 10:39:50.563119 4528 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:39:50.595785 4528 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:39:50.600469 4528 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:39:50.600764 4528 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:39:50.620719 4528 rpc_server.cc:307] RPC server started. Bound to: 127.20.171.126:44373
I20260807 10:39:50.620740 4597 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.171.126:44373 every 8 connection(s)
I20260807 10:39:50.622179 4528 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
I20260807 10:39:50.624193 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 4528
I20260807 10:39:50.624455 21165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/master-0/wal/instance
I20260807 10:39:50.625156 21165 external_mini_cluster.cc:1428] Setting key 969100ffa374ab5ed99a9d6a3b27a289
I20260807 10:39:50.626116 4598 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 07 10:39:50 dist-test-slave-0b58 krb5kdc[4515](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099190, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.171.126@KRBTEST.COM
I20260807 10:39:50.641300 4598 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3338383b9f1e48f99d0d1a2579e10d22: Bootstrap starting.
I20260807 10:39:50.644483 4598 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3338383b9f1e48f99d0d1a2579e10d22: Neither blocks nor log segments found. Creating new log.
I20260807 10:39:50.645529 4598 log.cc:824] T 00000000000000000000000000000000 P 3338383b9f1e48f99d0d1a2579e10d22: Log is configured to *not* fsync() on all Append() calls
I20260807 10:39:50.648506 4598 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3338383b9f1e48f99d0d1a2579e10d22: No bootstrap required, opened a new log
I20260807 10:39:50.649205 4601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:50.627221 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56550 (local address 127.20.171.126:44373)
0807 10:39:50.628065 (+ 844us) server_negotiation.cc:206] Beginning negotiation
0807 10:39:50.628076 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 10:39:50.628122 (+ 46us) server_negotiation.cc:407] Connection header received
0807 10:39:50.629755 (+ 1633us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:39:50.629776 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:39:50.630155 (+ 379us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:39:50.630488 (+ 333us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:39:50.632385 (+ 1897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:50.633785 (+ 1400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:50.635655 (+ 1870us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:50.636404 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:50.636539 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:39:50.641553 (+ 5014us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:39:50.641561 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:39:50.641574 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:39:50.641610 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:39:50.644924 (+ 3314us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:39:50.645641 (+ 717us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:39:50.645668 (+ 27us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:39:50.645678 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:39:50.645875 (+ 197us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:39:50.646300 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:39:50.646307 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:39:50.646315 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:39:50.646856 (+ 541us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:39:50.647165 (+ 309us) server_negotiation.cc:1035] Waiting for connection context
0807 10:39:50.647620 (+ 455us) server_negotiation.cc:299] Negotiation successful
0807 10:39:50.648077 (+ 457us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":629,"thread_start_us":410,"threads_started":1}
I20260807 10:39:50.656755 4598 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3338383b9f1e48f99d0d1a2579e10d22 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3338383b9f1e48f99d0d1a2579e10d22" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 44373 } }
I20260807 10:39:50.657135 4598 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3338383b9f1e48f99d0d1a2579e10d22 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:39:50.657270 4598 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3338383b9f1e48f99d0d1a2579e10d22 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3338383b9f1e48f99d0d1a2579e10d22, State: Initialized, Role: FOLLOWER
I20260807 10:39:50.657800 4598 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3338383b9f1e48f99d0d1a2579e10d22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3338383b9f1e48f99d0d1a2579e10d22" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 44373 } }
I20260807 10:39:50.658041 4598 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3338383b9f1e48f99d0d1a2579e10d22 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 10:39:50.658195 4598 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3338383b9f1e48f99d0d1a2579e10d22 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 10:39:50.658366 4598 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3338383b9f1e48f99d0d1a2579e10d22 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:39:50.660687 4598 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3338383b9f1e48f99d0d1a2579e10d22 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3338383b9f1e48f99d0d1a2579e10d22" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 44373 } }
I20260807 10:39:50.661175 4598 leader_election.cc:302] T 00000000000000000000000000000000 P 3338383b9f1e48f99d0d1a2579e10d22 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3338383b9f1e48f99d0d1a2579e10d22; no voters:
I20260807 10:39:50.661800 4598 leader_election.cc:288] T 00000000000000000000000000000000 P 3338383b9f1e48f99d0d1a2579e10d22 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 10:39:50.661926 4603 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3338383b9f1e48f99d0d1a2579e10d22 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:39:50.663172 4603 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3338383b9f1e48f99d0d1a2579e10d22 [term 1 LEADER]: Becoming Leader. State: Replica: 3338383b9f1e48f99d0d1a2579e10d22, State: Running, Role: LEADER
I20260807 10:39:50.663878 4603 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3338383b9f1e48f99d0d1a2579e10d22 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3338383b9f1e48f99d0d1a2579e10d22" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 44373 } }
I20260807 10:39:50.664402 4598 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3338383b9f1e48f99d0d1a2579e10d22 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 10:39:50.666528 4605 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3338383b9f1e48f99d0d1a2579e10d22 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3338383b9f1e48f99d0d1a2579e10d22. Latest consensus state: current_term: 1 leader_uuid: "3338383b9f1e48f99d0d1a2579e10d22" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3338383b9f1e48f99d0d1a2579e10d22" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 44373 } } }
I20260807 10:39:50.666910 4605 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3338383b9f1e48f99d0d1a2579e10d22 [sys.catalog]: This master's current role is: LEADER
I20260807 10:39:50.667614 4604 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3338383b9f1e48f99d0d1a2579e10d22 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3338383b9f1e48f99d0d1a2579e10d22" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3338383b9f1e48f99d0d1a2579e10d22" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 44373 } } }
I20260807 10:39:50.667919 4604 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3338383b9f1e48f99d0d1a2579e10d22 [sys.catalog]: This master's current role is: LEADER
I20260807 10:39:50.668157 4609 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 10:39:50.674361 4609 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 10:39:50.683174 4609 catalog_manager.cc:1347] Generated new cluster ID: 1914920cfa7240e7b1e07df6302271ff
I20260807 10:39:50.683354 4609 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 10:39:50.705389 4609 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 10:39:50.706758 4609 catalog_manager.cc:1504] Loading token signing keys...
I20260807 10:39:50.714908 4609 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3338383b9f1e48f99d0d1a2579e10d22: Generated new TSK 0
I20260807 10:39:50.715718 4609 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.171.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.171.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.171.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.65.keytab.
Entry for principal kudu/127.20.171.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.65.keytab.
I20260807 10:39:50.791288 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.171.65:0
--local_ip_for_outbound_sockets=127.20.171.65
--webserver_interface=127.20.171.65
--webserver_port=0
--tserver_master_addrs=127.20.171.126:44373
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.65.keytab
--principal=kudu/127.20.171.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.171.84:36941
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:39:51.134841 4624 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:39:51.135089 4624 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:39:51.135187 4624 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:39:51.142406 4624 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:39:51.142521 4624 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:39:51.142629 4624 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.171.65
I20260807 10:39:51.152016 4624 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.171.84:36941
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.65.keytab
--principal=kudu/127.20.171.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.171.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.171.65
--webserver_port=0
--tserver_master_addrs=127.20.171.126:44373
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.171.65
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:39:51.153198 4624 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:39:51.154418 4624 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:39:51.167137 4632 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:39:51.167261 4630 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:39:51.167261 4629 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:39:51.168118 4624 server_base.cc:1034] running on GCE node
I20260807 10:39:51.168889 4624 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:39:51.169858 4624 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:39:51.171079 4624 hybrid_clock.cc:648] HybridClock initialized: now 1786099191171022 us; error 48 us; skew 500 ppm
I20260807 10:39:51.171424 4624 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:39:51 dist-test-slave-0b58 krb5kdc[4515](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099191, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:39:51.174466 4624 init.cc:377] Logged in from keytab as kudu/127.20.171.65@KRBTEST.COM (short username kudu)
I20260807 10:39:51.175817 4624 webserver.cc:460] Webserver started at http://127.20.171.65:32977/ using document root <none> and password file <none>
I20260807 10:39:51.176522 4624 fs_manager.cc:359] Metadata directory not provided
I20260807 10:39:51.176630 4624 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:39:51.176906 4624 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:39:51.179706 4624 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/ts-0/data/instance:
uuid: "497ad307b555407f8ed1c7b48256fe79"
format_stamp: "Formatted at 2026-08-07 10:39:51 on dist-test-slave-0b58"
server_key: "8dee52968cbfeedc9beb0888eaab2de6"
server_key_iv: "0baa5d515e7ae209c016724f50842663"
server_key_version: "encryptionkey@0"
I20260807 10:39:51.180476 4624 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/ts-0/wal/instance:
uuid: "497ad307b555407f8ed1c7b48256fe79"
format_stamp: "Formatted at 2026-08-07 10:39:51 on dist-test-slave-0b58"
server_key: "8dee52968cbfeedc9beb0888eaab2de6"
server_key_iv: "0baa5d515e7ae209c016724f50842663"
server_key_version: "encryptionkey@0"
I20260807 10:39:51.185750 4624 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.003s
I20260807 10:39:51.189092 4639 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:39:51.190392 4624 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260807 10:39:51.190569 4624 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/ts-0/wal
uuid: "497ad307b555407f8ed1c7b48256fe79"
format_stamp: "Formatted at 2026-08-07 10:39:51 on dist-test-slave-0b58"
server_key: "8dee52968cbfeedc9beb0888eaab2de6"
server_key_iv: "0baa5d515e7ae209c016724f50842663"
server_key_version: "encryptionkey@0"
I20260807 10:39:51.190789 4624 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:39:51.209946 4624 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:39:51.214254 4624 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:39:51.214560 4624 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:39:51.215499 4624 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:39:51.216913 4624 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:39:51.217008 4624 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:39:51.217151 4624 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:39:51.217244 4624 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:39:51.250579 4624 rpc_server.cc:307] RPC server started. Bound to: 127.20.171.65:40835
I20260807 10:39:51.250627 4753 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.171.65:40835 every 8 connection(s)
I20260807 10:39:51.251883 4624 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/ts-0/data/info.pb
I20260807 10:39:51.252573 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 4624
I20260807 10:39:51.252808 21165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/ts-0/wal/instance
I20260807 10:39:51.253680 21165 external_mini_cluster.cc:1428] Setting key a7c478bca695c4f6b1c122a2c08107cc
Aug 07 10:39:51 dist-test-slave-0b58 krb5kdc[4515](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099191, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.65@KRBTEST.COM for kudu/127.20.171.126@KRBTEST.COM
I20260807 10:39:51.274021 4756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:51.254992 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.65:60085 (local address 127.20.171.126:44373)
0807 10:39:51.255457 (+ 465us) server_negotiation.cc:206] Beginning negotiation
0807 10:39:51.255461 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 10:39:51.256672 (+ 1211us) server_negotiation.cc:407] Connection header received
0807 10:39:51.258484 (+ 1812us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:39:51.258493 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:39:51.258590 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:39:51.258705 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:39:51.260145 (+ 1440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:51.261255 (+ 1110us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:51.262781 (+ 1526us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:51.263467 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:51.263611 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:39:51.267388 (+ 3777us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:39:51.267397 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:39:51.267404 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:39:51.267447 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:39:51.270799 (+ 3352us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:39:51.271758 (+ 959us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:39:51.271762 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:39:51.271764 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:39:51.271879 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:39:51.272363 (+ 484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:39:51.272366 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:39:51.272368 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:39:51.272614 (+ 246us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:39:51.272734 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0807 10:39:51.273575 (+ 841us) server_negotiation.cc:299] Negotiation successful
0807 10:39:51.273759 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":362,"thread_start_us":265,"threads_started":1}
I20260807 10:39:51.275554 4757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:51.255626 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:44373 (local address 127.20.171.65:60085)
0807 10:39:51.256505 (+ 879us) negotiation.cc:107] Waiting for socket to connect
0807 10:39:51.256560 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0807 10:39:51.258200 (+ 1640us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:39:51.258896 (+ 696us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:39:51.258903 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:39:51.259435 (+ 532us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:39:51.259972 (+ 537us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:39:51.259989 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:39:51.261413 (+ 1424us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:39:51.261417 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:39:51.262619 (+ 1202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:39:51.262631 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:39:51.263684 (+ 1053us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:39:51.263689 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:39:51.263884 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:39:51.264669 (+ 785us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:39:51.264696 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:39:51.267161 (+ 2465us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:39:51.270958 (+ 3797us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:39:51.270969 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:39:51.270986 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:39:51.271631 (+ 645us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:39:51.271988 (+ 357us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:39:51.271996 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:39:51.272002 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:39:51.272247 (+ 245us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:39:51.272739 (+ 492us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:39:51.272750 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:39:51.273184 (+ 434us) client_negotiation.cc:769] Sending connection context
0807 10:39:51.273496 (+ 312us) client_negotiation.cc:240] Negotiation successful
0807 10:39:51.274081 (+ 585us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":574,"thread_start_us":353,"threads_started":1}
I20260807 10:39:51.277218 4754 heartbeater.cc:347] Connected to a master server at 127.20.171.126:44373
I20260807 10:39:51.277588 4754 heartbeater.cc:464] Registering TS with master...
I20260807 10:39:51.278290 4754 heartbeater.cc:511] Master 127.20.171.126:44373 requested a full tablet report, sending...
I20260807 10:39:51.280341 4562 ts_manager.cc:194] Registered new tserver with Master: 497ad307b555407f8ed1c7b48256fe79 (127.20.171.65:40835)
I20260807 10:39:51.281723 4562 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.171.65@KRBTEST.COM'} at 127.20.171.65:60085
WARNING: no policy specified for kudu/127.20.171.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.171.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.171.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.66.keytab.
Entry for principal kudu/127.20.171.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.66.keytab.
I20260807 10:39:51.323487 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.171.66:0
--local_ip_for_outbound_sockets=127.20.171.66
--webserver_interface=127.20.171.66
--webserver_port=0
--tserver_master_addrs=127.20.171.126:44373
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.66.keytab
--principal=kudu/127.20.171.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.171.84:36941
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:39:51.663216 4760 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:39:51.663538 4760 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:39:51.663709 4760 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:39:51.671412 4760 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:39:51.671563 4760 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:39:51.671744 4760 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.171.66
I20260807 10:39:51.681718 4760 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.171.84:36941
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.66.keytab
--principal=kudu/127.20.171.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.171.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.171.66
--webserver_port=0
--tserver_master_addrs=127.20.171.126:44373
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.171.66
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:39:51.683001 4760 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:39:51.684325 4760 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:39:51.697752 4765 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:39:51.697748 4768 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:39:51.697789 4766 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:39:51.698603 4760 server_base.cc:1034] running on GCE node
I20260807 10:39:51.699182 4760 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:39:51.700084 4760 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:39:51.701342 4760 hybrid_clock.cc:648] HybridClock initialized: now 1786099191701277 us; error 61 us; skew 500 ppm
I20260807 10:39:51.701656 4760 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:39:51 dist-test-slave-0b58 krb5kdc[4515](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099191, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:39:51.704711 4760 init.cc:377] Logged in from keytab as kudu/127.20.171.66@KRBTEST.COM (short username kudu)
I20260807 10:39:51.706130 4760 webserver.cc:460] Webserver started at http://127.20.171.66:33451/ using document root <none> and password file <none>
I20260807 10:39:51.706825 4760 fs_manager.cc:359] Metadata directory not provided
I20260807 10:39:51.706970 4760 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:39:51.707278 4760 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:39:51.710135 4760 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/ts-1/data/instance:
uuid: "c39cf82dec1e4b8eb3c756f619b896f6"
format_stamp: "Formatted at 2026-08-07 10:39:51 on dist-test-slave-0b58"
server_key: "b861a30f41e48b30e6da31e0a09f9399"
server_key_iv: "0c30bb09e6851267d19c78277053b0e5"
server_key_version: "encryptionkey@0"
I20260807 10:39:51.710887 4760 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/ts-1/wal/instance:
uuid: "c39cf82dec1e4b8eb3c756f619b896f6"
format_stamp: "Formatted at 2026-08-07 10:39:51 on dist-test-slave-0b58"
server_key: "b861a30f41e48b30e6da31e0a09f9399"
server_key_iv: "0c30bb09e6851267d19c78277053b0e5"
server_key_version: "encryptionkey@0"
I20260807 10:39:51.715916 4760 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260807 10:39:51.719291 4776 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:39:51.720688 4760 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260807 10:39:51.720878 4760 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/ts-1/wal
uuid: "c39cf82dec1e4b8eb3c756f619b896f6"
format_stamp: "Formatted at 2026-08-07 10:39:51 on dist-test-slave-0b58"
server_key: "b861a30f41e48b30e6da31e0a09f9399"
server_key_iv: "0c30bb09e6851267d19c78277053b0e5"
server_key_version: "encryptionkey@0"
I20260807 10:39:51.721104 4760 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:39:51.745496 4760 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:39:51.749570 4760 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:39:51.749871 4760 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:39:51.750834 4760 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:39:51.752151 4760 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:39:51.752260 4760 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:39:51.752421 4760 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:39:51.752494 4760 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:39:51.787319 4760 rpc_server.cc:307] RPC server started. Bound to: 127.20.171.66:44645
I20260807 10:39:51.787371 4890 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.171.66:44645 every 8 connection(s)
I20260807 10:39:51.788688 4760 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/ts-1/data/info.pb
I20260807 10:39:51.796746 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 4760
I20260807 10:39:51.796967 21165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/ts-1/wal/instance
I20260807 10:39:51.797557 21165 external_mini_cluster.cc:1428] Setting key 924b89256bcea11accf01bca8ab5b9b3
Aug 07 10:39:51 dist-test-slave-0b58 krb5kdc[4515](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099191, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.66@KRBTEST.COM for kudu/127.20.171.126@KRBTEST.COM
I20260807 10:39:51.809505 4893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:51.791168 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.66:47869 (local address 127.20.171.126:44373)
0807 10:39:51.791639 (+ 471us) server_negotiation.cc:206] Beginning negotiation
0807 10:39:51.791643 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 10:39:51.792463 (+ 820us) server_negotiation.cc:407] Connection header received
0807 10:39:51.794296 (+ 1833us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:39:51.794302 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:39:51.794397 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:39:51.794517 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:39:51.796036 (+ 1519us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:51.796840 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:51.798846 (+ 2006us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:51.799536 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:51.799672 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:39:51.803824 (+ 4152us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:39:51.803829 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:39:51.803832 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:39:51.803864 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:39:51.806460 (+ 2596us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:39:51.807166 (+ 706us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:39:51.807173 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:39:51.807176 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:39:51.807314 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:39:51.807747 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:39:51.807752 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:39:51.807755 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:39:51.808017 (+ 262us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:39:51.808172 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0807 10:39:51.808894 (+ 722us) server_negotiation.cc:299] Negotiation successful
0807 10:39:51.809110 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":372,"thread_start_us":255,"threads_started":1}
I20260807 10:39:51.810452 4894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:51.791583 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:44373 (local address 127.20.171.66:47869)
0807 10:39:51.792313 (+ 730us) negotiation.cc:107] Waiting for socket to connect
0807 10:39:51.792358 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0807 10:39:51.794003 (+ 1645us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:39:51.794750 (+ 747us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:39:51.794758 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:39:51.795319 (+ 561us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:39:51.795866 (+ 547us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:39:51.795884 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:39:51.797025 (+ 1141us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:39:51.797032 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:39:51.798704 (+ 1672us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:39:51.798717 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:39:51.799785 (+ 1068us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:39:51.799794 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:39:51.800073 (+ 279us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:39:51.800805 (+ 732us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:39:51.800837 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:39:51.803606 (+ 2769us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:39:51.806611 (+ 3005us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:39:51.806620 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:39:51.806634 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:39:51.807045 (+ 411us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:39:51.807429 (+ 384us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:39:51.807434 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:39:51.807438 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:39:51.807619 (+ 181us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:39:51.808153 (+ 534us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:39:51.808160 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:39:51.808518 (+ 358us) client_negotiation.cc:769] Sending connection context
0807 10:39:51.808799 (+ 281us) client_negotiation.cc:240] Negotiation successful
0807 10:39:51.809295 (+ 496us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":471,"thread_start_us":267,"threads_started":1}
I20260807 10:39:51.811949 4891 heartbeater.cc:347] Connected to a master server at 127.20.171.126:44373
I20260807 10:39:51.812314 4891 heartbeater.cc:464] Registering TS with master...
I20260807 10:39:51.812970 4891 heartbeater.cc:511] Master 127.20.171.126:44373 requested a full tablet report, sending...
I20260807 10:39:51.814347 4562 ts_manager.cc:194] Registered new tserver with Master: c39cf82dec1e4b8eb3c756f619b896f6 (127.20.171.66:44645)
I20260807 10:39:51.815157 4562 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.171.66@KRBTEST.COM'} at 127.20.171.66:47869
WARNING: no policy specified for kudu/127.20.171.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.171.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.171.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.67.keytab.
Entry for principal kudu/127.20.171.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.67.keytab.
I20260807 10:39:51.863860 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.171.67:0
--local_ip_for_outbound_sockets=127.20.171.67
--webserver_interface=127.20.171.67
--webserver_port=0
--tserver_master_addrs=127.20.171.126:44373
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.67.keytab
--principal=kudu/127.20.171.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.171.84:36941
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:39:52.193832 4897 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:39:52.194129 4897 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:39:52.194298 4897 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:39:52.202399 4897 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:39:52.202527 4897 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:39:52.202695 4897 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.171.67
I20260807 10:39:52.212157 4897 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.171.84:36941
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.67.keytab
--principal=kudu/127.20.171.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.171.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.171.67
--webserver_port=0
--tserver_master_addrs=127.20.171.126:44373
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.171.67
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:39:52.213335 4897 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:39:52.214589 4897 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:39:52.227581 4903 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:39:52.228317 4902 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:39:52.229380 4905 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:39:52.230252 4897 server_base.cc:1034] running on GCE node
I20260807 10:39:52.231052 4897 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:39:52.232283 4897 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:39:52.233520 4897 hybrid_clock.cc:648] HybridClock initialized: now 1786099192233425 us; error 88 us; skew 500 ppm
I20260807 10:39:52.233831 4897 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:39:52 dist-test-slave-0b58 krb5kdc[4515](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099192, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:39:52.237154 4897 init.cc:377] Logged in from keytab as kudu/127.20.171.67@KRBTEST.COM (short username kudu)
I20260807 10:39:52.238633 4897 webserver.cc:460] Webserver started at http://127.20.171.67:41259/ using document root <none> and password file <none>
I20260807 10:39:52.239334 4897 fs_manager.cc:359] Metadata directory not provided
I20260807 10:39:52.239480 4897 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:39:52.239790 4897 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:39:52.242621 4897 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/ts-2/data/instance:
uuid: "8c1a9160f3ff4ab29e1f11faa34ad73a"
format_stamp: "Formatted at 2026-08-07 10:39:52 on dist-test-slave-0b58"
server_key: "43ba2d768895660a34d9b199d0eacd63"
server_key_iv: "483b44cd939a548398a4fc5cf5726bb4"
server_key_version: "encryptionkey@0"
I20260807 10:39:52.243384 4897 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/ts-2/wal/instance:
uuid: "8c1a9160f3ff4ab29e1f11faa34ad73a"
format_stamp: "Formatted at 2026-08-07 10:39:52 on dist-test-slave-0b58"
server_key: "43ba2d768895660a34d9b199d0eacd63"
server_key_iv: "483b44cd939a548398a4fc5cf5726bb4"
server_key_version: "encryptionkey@0"
I20260807 10:39:52.248391 4897 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260807 10:39:52.251890 4912 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:39:52.253324 4897 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 10:39:52.253487 4897 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/ts-2/wal
uuid: "8c1a9160f3ff4ab29e1f11faa34ad73a"
format_stamp: "Formatted at 2026-08-07 10:39:52 on dist-test-slave-0b58"
server_key: "43ba2d768895660a34d9b199d0eacd63"
server_key_iv: "483b44cd939a548398a4fc5cf5726bb4"
server_key_version: "encryptionkey@0"
I20260807 10:39:52.253661 4897 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:39:52.280875 4897 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:39:52.284538 4754 heartbeater.cc:503] Master 127.20.171.126:44373 was elected leader, sending a full tablet report...
I20260807 10:39:52.285575 4897 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:39:52.285866 4897 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:39:52.286985 4897 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:39:52.288371 4897 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:39:52.288476 4897 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:39:52.288643 4897 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:39:52.288722 4897 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:39:52.322175 4897 rpc_server.cc:307] RPC server started. Bound to: 127.20.171.67:32991
I20260807 10:39:52.322268 5028 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.171.67:32991 every 8 connection(s)
I20260807 10:39:52.323446 4897 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/ts-2/data/info.pb
I20260807 10:39:52.331943 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 4897
I20260807 10:39:52.332187 21165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/ts-2/wal/instance
I20260807 10:39:52.332803 21165 external_mini_cluster.cc:1428] Setting key 6990075ca2bf4c201ef39bb3fac0e749
Aug 07 10:39:52 dist-test-slave-0b58 krb5kdc[4515](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099192, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.67@KRBTEST.COM for kudu/127.20.171.126@KRBTEST.COM
I20260807 10:39:52.343776 5032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:52.325940 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.67:43903 (local address 127.20.171.126:44373)
0807 10:39:52.326475 (+ 535us) server_negotiation.cc:206] Beginning negotiation
0807 10:39:52.326484 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 10:39:52.327376 (+ 892us) server_negotiation.cc:407] Connection header received
0807 10:39:52.329252 (+ 1876us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:39:52.329257 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:39:52.329332 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:39:52.329428 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:39:52.330907 (+ 1479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:52.331665 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:52.333956 (+ 2291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:52.334552 (+ 596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:52.334706 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:39:52.338306 (+ 3600us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:39:52.338311 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:39:52.338314 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:39:52.338347 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:39:52.340889 (+ 2542us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:39:52.341592 (+ 703us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:39:52.341601 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:39:52.341603 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:39:52.341726 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:39:52.342156 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:39:52.342160 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:39:52.342163 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:39:52.342420 (+ 257us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:39:52.342580 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0807 10:39:52.343209 (+ 629us) server_negotiation.cc:299] Negotiation successful
0807 10:39:52.343414 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":409,"thread_start_us":248,"threads_started":1}
I20260807 10:39:52.344954 5033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:52.326524 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:44373 (local address 127.20.171.67:43903)
0807 10:39:52.327220 (+ 696us) negotiation.cc:107] Waiting for socket to connect
0807 10:39:52.327256 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0807 10:39:52.328994 (+ 1738us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:39:52.329668 (+ 674us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:39:52.329675 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:39:52.330202 (+ 527us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:39:52.330761 (+ 559us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:39:52.330777 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:39:52.331833 (+ 1056us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:39:52.331839 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:39:52.333752 (+ 1913us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:39:52.333772 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:39:52.334796 (+ 1024us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:39:52.334805 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:39:52.335038 (+ 233us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:39:52.335810 (+ 772us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:39:52.335845 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:39:52.338088 (+ 2243us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:39:52.341019 (+ 2931us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:39:52.341027 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:39:52.341041 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:39:52.341462 (+ 421us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:39:52.341839 (+ 377us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:39:52.341844 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:39:52.341847 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:39:52.342035 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:39:52.342547 (+ 512us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:39:52.342554 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:39:52.342849 (+ 295us) client_negotiation.cc:769] Sending connection context
0807 10:39:52.343097 (+ 248us) client_negotiation.cc:240] Negotiation successful
0807 10:39:52.343589 (+ 492us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":458,"thread_start_us":263,"threads_started":1}
I20260807 10:39:52.346297 5029 heartbeater.cc:347] Connected to a master server at 127.20.171.126:44373
I20260807 10:39:52.346619 5029 heartbeater.cc:464] Registering TS with master...
I20260807 10:39:52.347469 5029 heartbeater.cc:511] Master 127.20.171.126:44373 requested a full tablet report, sending...
I20260807 10:39:52.349000 4562 ts_manager.cc:194] Registered new tserver with Master: 8c1a9160f3ff4ab29e1f11faa34ad73a (127.20.171.67:32991)
I20260807 10:39:52.349817 4562 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.171.67@KRBTEST.COM'} at 127.20.171.67:43903
I20260807 10:39:52.360548 21165 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 10:39:52.376986 5032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:52.365042 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56560 (local address 127.20.171.126:44373)
0807 10:39:52.365255 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0807 10:39:52.365264 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 10:39:52.365628 (+ 364us) server_negotiation.cc:407] Connection header received
0807 10:39:52.365748 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:39:52.365751 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:39:52.365809 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:39:52.365883 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:39:52.367423 (+ 1540us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:52.368304 (+ 881us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:52.369674 (+ 1370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:52.370145 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:52.370236 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:39:52.372574 (+ 2338us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:39:52.372578 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:39:52.372581 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:39:52.372608 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:39:52.374804 (+ 2196us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:39:52.375388 (+ 584us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:39:52.375391 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:39:52.375393 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:39:52.375498 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:39:52.375795 (+ 297us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:39:52.375798 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:39:52.375800 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:39:52.376072 (+ 272us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:39:52.376248 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0807 10:39:52.376545 (+ 297us) server_negotiation.cc:299] Negotiation successful
0807 10:39:52.376726 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260807 10:39:52.380950 4562 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56560:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 10:39:52.387723 4562 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 10:39:52.421963 5045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:52.399762 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.66:44645 (local address 127.0.0.1:56356)
0807 10:39:52.412910 (+ 13148us) negotiation.cc:107] Waiting for socket to connect
0807 10:39:52.412927 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 10:39:52.413076 (+ 149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:39:52.413652 (+ 576us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:39:52.413656 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:39:52.413680 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:39:52.414054 (+ 374us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:39:52.414064 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:39:52.416167 (+ 2103us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:39:52.416174 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:39:52.419172 (+ 2998us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:39:52.419185 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:39:52.421083 (+ 1898us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:39:52.421089 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:39:52.421276 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:39:52.421329 (+ 53us) client_negotiation.cc:769] Sending connection context
0807 10:39:52.421463 (+ 134us) client_negotiation.cc:240] Negotiation successful
0807 10:39:52.421652 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13033,"mutex_wait_us":41,"spinlock_wait_cycles":4864,"thread_start_us":12888,"threads_started":1}
I20260807 10:39:52.422021 5046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:52.399991 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56356 (local address 127.20.171.66:44645)
0807 10:39:52.412259 (+ 12268us) server_negotiation.cc:206] Beginning negotiation
0807 10:39:52.412268 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 10:39:52.413209 (+ 941us) server_negotiation.cc:407] Connection header received
0807 10:39:52.413306 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:39:52.413311 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:39:52.413469 (+ 158us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:39:52.413661 (+ 192us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:39:52.414233 (+ 572us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:52.415980 (+ 1747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:52.419333 (+ 3353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:52.420807 (+ 1474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:52.420967 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:39:52.421160 (+ 193us) server_negotiation.cc:1035] Waiting for connection context
0807 10:39:52.421547 (+ 387us) server_negotiation.cc:299] Negotiation successful
0807 10:39:52.421732 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12056,"thread_start_us":12296,"threads_started":1}
I20260807 10:39:52.423108 5044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:52.399439 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59602 (local address 127.20.171.67:32991)
0807 10:39:52.411522 (+ 12083us) server_negotiation.cc:206] Beginning negotiation
0807 10:39:52.411533 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 10:39:52.412336 (+ 803us) server_negotiation.cc:407] Connection header received
0807 10:39:52.412447 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:39:52.412456 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:39:52.412732 (+ 276us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:39:52.413835 (+ 1103us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:39:52.414207 (+ 372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:52.416040 (+ 1833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:52.419094 (+ 3054us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:52.420446 (+ 1352us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:52.420559 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:39:52.420792 (+ 233us) server_negotiation.cc:1035] Waiting for connection context
0807 10:39:52.422660 (+ 1868us) server_negotiation.cc:299] Negotiation successful
0807 10:39:52.422802 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11898,"thread_start_us":11736,"threads_started":1}
I20260807 10:39:52.423120 5043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:52.399083 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.67:32991 (local address 127.0.0.1:59602)
0807 10:39:52.411869 (+ 12786us) negotiation.cc:107] Waiting for socket to connect
0807 10:39:52.411916 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0807 10:39:52.412094 (+ 178us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:39:52.412984 (+ 890us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:39:52.413014 (+ 30us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:39:52.413100 (+ 86us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:39:52.413579 (+ 479us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:39:52.413597 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:39:52.416207 (+ 2610us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:39:52.416214 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:39:52.418921 (+ 2707us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:39:52.418939 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:39:52.420777 (+ 1838us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:39:52.420783 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:39:52.422452 (+ 1669us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:39:52.422519 (+ 67us) client_negotiation.cc:769] Sending connection context
0807 10:39:52.422619 (+ 100us) client_negotiation.cc:240] Negotiation successful
0807 10:39:52.422739 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12554,"mutex_wait_us":1498,"spinlock_wait_cycles":19712,"thread_start_us":12469,"threads_started":1}
I20260807 10:39:52.425454 5048 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:52.414368 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.65:40835 (local address 127.0.0.1:33778)
0807 10:39:52.417106 (+ 2738us) negotiation.cc:107] Waiting for socket to connect
0807 10:39:52.417125 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 10:39:52.417243 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:39:52.418015 (+ 772us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:39:52.418019 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:39:52.418045 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:39:52.418515 (+ 470us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:39:52.418526 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:39:52.420446 (+ 1920us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:39:52.420451 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:39:52.422497 (+ 2046us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:39:52.422511 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:39:52.424652 (+ 2141us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:39:52.424658 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:39:52.424842 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:39:52.424879 (+ 37us) client_negotiation.cc:769] Sending connection context
0807 10:39:52.424970 (+ 91us) client_negotiation.cc:240] Negotiation successful
0807 10:39:52.425081 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2617,"mutex_wait_us":1,"thread_start_us":2446,"threads_started":1}
I20260807 10:39:52.425601 5047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:52.412722 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33778 (local address 127.20.171.65:40835)
0807 10:39:52.417428 (+ 4706us) server_negotiation.cc:206] Beginning negotiation
0807 10:39:52.417435 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:39:52.417460 (+ 25us) server_negotiation.cc:407] Connection header received
0807 10:39:52.417552 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:39:52.417558 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:39:52.417800 (+ 242us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:39:52.417988 (+ 188us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:39:52.418691 (+ 703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:52.420248 (+ 1557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:52.422685 (+ 2437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:52.424144 (+ 1459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:52.424297 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:39:52.424521 (+ 224us) server_negotiation.cc:1035] Waiting for connection context
0807 10:39:52.425055 (+ 534us) server_negotiation.cc:299] Negotiation successful
0807 10:39:52.425214 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4537,"thread_start_us":4399,"threads_started":1}
I20260807 10:39:52.425956 4826 tablet_service.cc:1467] Processing CreateTablet for tablet 0dbbf3b966fc41edb12e90a7650ca49d (DEFAULT_TABLE table=test-table [id=303667041c9044879ab6cd583d39333c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:39:52.426530 4963 tablet_service.cc:1467] Processing CreateTablet for tablet 0dbbf3b966fc41edb12e90a7650ca49d (DEFAULT_TABLE table=test-table [id=303667041c9044879ab6cd583d39333c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:39:52.427476 4826 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0dbbf3b966fc41edb12e90a7650ca49d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:39:52.427996 4963 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0dbbf3b966fc41edb12e90a7650ca49d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:39:52.429400 4689 tablet_service.cc:1467] Processing CreateTablet for tablet 0dbbf3b966fc41edb12e90a7650ca49d (DEFAULT_TABLE table=test-table [id=303667041c9044879ab6cd583d39333c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:39:52.430732 4689 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0dbbf3b966fc41edb12e90a7650ca49d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:39:52.438766 5049 tablet_bootstrap.cc:492] T 0dbbf3b966fc41edb12e90a7650ca49d P c39cf82dec1e4b8eb3c756f619b896f6: Bootstrap starting.
I20260807 10:39:52.442534 5049 tablet_bootstrap.cc:654] T 0dbbf3b966fc41edb12e90a7650ca49d P c39cf82dec1e4b8eb3c756f619b896f6: Neither blocks nor log segments found. Creating new log.
I20260807 10:39:52.442762 5050 tablet_bootstrap.cc:492] T 0dbbf3b966fc41edb12e90a7650ca49d P 8c1a9160f3ff4ab29e1f11faa34ad73a: Bootstrap starting.
I20260807 10:39:52.443836 5049 log.cc:824] T 0dbbf3b966fc41edb12e90a7650ca49d P c39cf82dec1e4b8eb3c756f619b896f6: Log is configured to *not* fsync() on all Append() calls
I20260807 10:39:52.444124 5052 tablet_bootstrap.cc:492] T 0dbbf3b966fc41edb12e90a7650ca49d P 497ad307b555407f8ed1c7b48256fe79: Bootstrap starting.
I20260807 10:39:52.446662 5050 tablet_bootstrap.cc:654] T 0dbbf3b966fc41edb12e90a7650ca49d P 8c1a9160f3ff4ab29e1f11faa34ad73a: Neither blocks nor log segments found. Creating new log.
I20260807 10:39:52.446923 5052 tablet_bootstrap.cc:654] T 0dbbf3b966fc41edb12e90a7650ca49d P 497ad307b555407f8ed1c7b48256fe79: Neither blocks nor log segments found. Creating new log.
I20260807 10:39:52.447810 5050 log.cc:824] T 0dbbf3b966fc41edb12e90a7650ca49d P 8c1a9160f3ff4ab29e1f11faa34ad73a: Log is configured to *not* fsync() on all Append() calls
I20260807 10:39:52.448167 5052 log.cc:824] T 0dbbf3b966fc41edb12e90a7650ca49d P 497ad307b555407f8ed1c7b48256fe79: Log is configured to *not* fsync() on all Append() calls
I20260807 10:39:52.449672 5049 tablet_bootstrap.cc:492] T 0dbbf3b966fc41edb12e90a7650ca49d P c39cf82dec1e4b8eb3c756f619b896f6: No bootstrap required, opened a new log
I20260807 10:39:52.449947 5049 ts_tablet_manager.cc:1397] T 0dbbf3b966fc41edb12e90a7650ca49d P c39cf82dec1e4b8eb3c756f619b896f6: Time spent bootstrapping tablet: real 0.011s user 0.009s sys 0.000s
I20260807 10:39:52.451148 5052 tablet_bootstrap.cc:492] T 0dbbf3b966fc41edb12e90a7650ca49d P 497ad307b555407f8ed1c7b48256fe79: No bootstrap required, opened a new log
I20260807 10:39:52.451269 5050 tablet_bootstrap.cc:492] T 0dbbf3b966fc41edb12e90a7650ca49d P 8c1a9160f3ff4ab29e1f11faa34ad73a: No bootstrap required, opened a new log
I20260807 10:39:52.451431 5052 ts_tablet_manager.cc:1397] T 0dbbf3b966fc41edb12e90a7650ca49d P 497ad307b555407f8ed1c7b48256fe79: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.003s
I20260807 10:39:52.451543 5050 ts_tablet_manager.cc:1397] T 0dbbf3b966fc41edb12e90a7650ca49d P 8c1a9160f3ff4ab29e1f11faa34ad73a: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.008s
I20260807 10:39:52.458619 5050 raft_consensus.cc:348] T 0dbbf3b966fc41edb12e90a7650ca49d P 8c1a9160f3ff4ab29e1f11faa34ad73a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c1a9160f3ff4ab29e1f11faa34ad73a" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 32991 } } peers { permanent_uuid: "497ad307b555407f8ed1c7b48256fe79" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 40835 } } peers { permanent_uuid: "c39cf82dec1e4b8eb3c756f619b896f6" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 44645 } }
I20260807 10:39:52.458968 5050 raft_consensus.cc:374] T 0dbbf3b966fc41edb12e90a7650ca49d P 8c1a9160f3ff4ab29e1f11faa34ad73a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:39:52.459087 5050 raft_consensus.cc:729] T 0dbbf3b966fc41edb12e90a7650ca49d P 8c1a9160f3ff4ab29e1f11faa34ad73a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c1a9160f3ff4ab29e1f11faa34ad73a, State: Initialized, Role: FOLLOWER
I20260807 10:39:52.459678 5050 consensus_queue.cc:260] T 0dbbf3b966fc41edb12e90a7650ca49d P 8c1a9160f3ff4ab29e1f11faa34ad73a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c1a9160f3ff4ab29e1f11faa34ad73a" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 32991 } } peers { permanent_uuid: "497ad307b555407f8ed1c7b48256fe79" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 40835 } } peers { permanent_uuid: "c39cf82dec1e4b8eb3c756f619b896f6" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 44645 } }
I20260807 10:39:52.460763 5049 raft_consensus.cc:348] T 0dbbf3b966fc41edb12e90a7650ca49d P c39cf82dec1e4b8eb3c756f619b896f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c1a9160f3ff4ab29e1f11faa34ad73a" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 32991 } } peers { permanent_uuid: "497ad307b555407f8ed1c7b48256fe79" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 40835 } } peers { permanent_uuid: "c39cf82dec1e4b8eb3c756f619b896f6" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 44645 } }
I20260807 10:39:52.461268 5049 raft_consensus.cc:374] T 0dbbf3b966fc41edb12e90a7650ca49d P c39cf82dec1e4b8eb3c756f619b896f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:39:52.461422 5049 raft_consensus.cc:729] T 0dbbf3b966fc41edb12e90a7650ca49d P c39cf82dec1e4b8eb3c756f619b896f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c39cf82dec1e4b8eb3c756f619b896f6, State: Initialized, Role: FOLLOWER
I20260807 10:39:52.461512 5050 ts_tablet_manager.cc:1428] T 0dbbf3b966fc41edb12e90a7650ca49d P 8c1a9160f3ff4ab29e1f11faa34ad73a: Time spent starting tablet: real 0.010s user 0.009s sys 0.000s
I20260807 10:39:52.461987 5029 heartbeater.cc:503] Master 127.20.171.126:44373 was elected leader, sending a full tablet report...
I20260807 10:39:52.462064 5052 raft_consensus.cc:348] T 0dbbf3b966fc41edb12e90a7650ca49d P 497ad307b555407f8ed1c7b48256fe79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c1a9160f3ff4ab29e1f11faa34ad73a" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 32991 } } peers { permanent_uuid: "497ad307b555407f8ed1c7b48256fe79" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 40835 } } peers { permanent_uuid: "c39cf82dec1e4b8eb3c756f619b896f6" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 44645 } }
I20260807 10:39:52.462203 5049 consensus_queue.cc:260] T 0dbbf3b966fc41edb12e90a7650ca49d P c39cf82dec1e4b8eb3c756f619b896f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c1a9160f3ff4ab29e1f11faa34ad73a" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 32991 } } peers { permanent_uuid: "497ad307b555407f8ed1c7b48256fe79" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 40835 } } peers { permanent_uuid: "c39cf82dec1e4b8eb3c756f619b896f6" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 44645 } }
I20260807 10:39:52.462538 5052 raft_consensus.cc:374] T 0dbbf3b966fc41edb12e90a7650ca49d P 497ad307b555407f8ed1c7b48256fe79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:39:52.462661 5052 raft_consensus.cc:729] T 0dbbf3b966fc41edb12e90a7650ca49d P 497ad307b555407f8ed1c7b48256fe79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 497ad307b555407f8ed1c7b48256fe79, State: Initialized, Role: FOLLOWER
I20260807 10:39:52.463328 4891 heartbeater.cc:503] Master 127.20.171.126:44373 was elected leader, sending a full tablet report...
I20260807 10:39:52.463379 5052 consensus_queue.cc:260] T 0dbbf3b966fc41edb12e90a7650ca49d P 497ad307b555407f8ed1c7b48256fe79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c1a9160f3ff4ab29e1f11faa34ad73a" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 32991 } } peers { permanent_uuid: "497ad307b555407f8ed1c7b48256fe79" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 40835 } } peers { permanent_uuid: "c39cf82dec1e4b8eb3c756f619b896f6" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 44645 } }
I20260807 10:39:52.465493 5049 ts_tablet_manager.cc:1428] T 0dbbf3b966fc41edb12e90a7650ca49d P c39cf82dec1e4b8eb3c756f619b896f6: Time spent starting tablet: real 0.015s user 0.012s sys 0.001s
I20260807 10:39:52.467185 5052 ts_tablet_manager.cc:1428] T 0dbbf3b966fc41edb12e90a7650ca49d P 497ad307b555407f8ed1c7b48256fe79: Time spent starting tablet: real 0.016s user 0.016s sys 0.001s
W20260807 10:39:52.504364 4755 tablet.cc:2369] T 0dbbf3b966fc41edb12e90a7650ca49d P 497ad307b555407f8ed1c7b48256fe79: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 10:39:52.540673 4892 tablet.cc:2369] T 0dbbf3b966fc41edb12e90a7650ca49d P c39cf82dec1e4b8eb3c756f619b896f6: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 10:39:52.575035 5030 tablet.cc:2369] T 0dbbf3b966fc41edb12e90a7650ca49d P 8c1a9160f3ff4ab29e1f11faa34ad73a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 10:39:52.585268 5057 raft_consensus.cc:482] T 0dbbf3b966fc41edb12e90a7650ca49d P 8c1a9160f3ff4ab29e1f11faa34ad73a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 10:39:52.585520 5057 raft_consensus.cc:504] T 0dbbf3b966fc41edb12e90a7650ca49d P 8c1a9160f3ff4ab29e1f11faa34ad73a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c1a9160f3ff4ab29e1f11faa34ad73a" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 32991 } } peers { permanent_uuid: "497ad307b555407f8ed1c7b48256fe79" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 40835 } } peers { permanent_uuid: "c39cf82dec1e4b8eb3c756f619b896f6" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 44645 } }
I20260807 10:39:52.587133 5057 leader_election.cc:288] T 0dbbf3b966fc41edb12e90a7650ca49d P 8c1a9160f3ff4ab29e1f11faa34ad73a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 497ad307b555407f8ed1c7b48256fe79 (127.20.171.65:40835), c39cf82dec1e4b8eb3c756f619b896f6 (127.20.171.66:44645)
I20260807 10:39:52.593402 5047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:52.587710 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.67:48897 (local address 127.20.171.65:40835)
0807 10:39:52.587918 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0807 10:39:52.587923 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:39:52.587943 (+ 20us) server_negotiation.cc:407] Connection header received
0807 10:39:52.588021 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:39:52.588028 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:39:52.588113 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:39:52.588209 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:39:52.588747 (+ 538us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:52.589778 (+ 1031us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:52.591584 (+ 1806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:52.592664 (+ 1080us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:52.592778 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:39:52.592825 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0807 10:39:52.593133 (+ 308us) server_negotiation.cc:299] Negotiation successful
0807 10:39:52.593213 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260807 10:39:52.593523 5033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:52.587413 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.65:40835 (local address 127.20.171.67:48897)
0807 10:39:52.587755 (+ 342us) negotiation.cc:107] Waiting for socket to connect
0807 10:39:52.587776 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0807 10:39:52.587898 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:39:52.588284 (+ 386us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:39:52.588289 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:39:52.588324 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:39:52.588529 (+ 205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:39:52.588539 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:39:52.589903 (+ 1364us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:39:52.589908 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:39:52.591432 (+ 1524us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:39:52.591443 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:39:52.592798 (+ 1355us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:39:52.592803 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:39:52.592980 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:39:52.593016 (+ 36us) client_negotiation.cc:769] Sending connection context
0807 10:39:52.593112 (+ 96us) client_negotiation.cc:240] Negotiation successful
0807 10:39:52.593237 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":192}
I20260807 10:39:52.594244 5046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:52.587670 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.67:49959 (local address 127.20.171.66:44645)
0807 10:39:52.587953 (+ 283us) server_negotiation.cc:206] Beginning negotiation
0807 10:39:52.587962 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 10:39:52.588614 (+ 652us) server_negotiation.cc:407] Connection header received
0807 10:39:52.588790 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:39:52.588793 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:39:52.588853 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:39:52.588924 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:39:52.589511 (+ 587us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:52.590451 (+ 940us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:52.592361 (+ 1910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:52.593329 (+ 968us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:52.593458 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:39:52.593523 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0807 10:39:52.593901 (+ 378us) server_negotiation.cc:299] Negotiation successful
0807 10:39:52.594018 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":107}
I20260807 10:39:52.594342 5060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:52.587413 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.66:44645 (local address 127.20.171.67:49959)
0807 10:39:52.588506 (+ 1093us) negotiation.cc:107] Waiting for socket to connect
0807 10:39:52.588519 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 10:39:52.588614 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:39:52.588974 (+ 360us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:39:52.588978 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:39:52.589004 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:39:52.589363 (+ 359us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:39:52.589374 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:39:52.590603 (+ 1229us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:39:52.590607 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:39:52.592172 (+ 1565us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:39:52.592187 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:39:52.593534 (+ 1347us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:39:52.593542 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:39:52.593700 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:39:52.593727 (+ 27us) client_negotiation.cc:769] Sending connection context
0807 10:39:52.593872 (+ 145us) client_negotiation.cc:240] Negotiation successful
0807 10:39:52.593998 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":992,"mutex_wait_us":63,"thread_start_us":601,"threads_started":1}
I20260807 10:39:52.594517 4709 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0dbbf3b966fc41edb12e90a7650ca49d" candidate_uuid: "8c1a9160f3ff4ab29e1f11faa34ad73a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "497ad307b555407f8ed1c7b48256fe79" is_pre_election: true
I20260807 10:39:52.595088 4709 raft_consensus.cc:2454] T 0dbbf3b966fc41edb12e90a7650ca49d P 497ad307b555407f8ed1c7b48256fe79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c1a9160f3ff4ab29e1f11faa34ad73a in term 0.
I20260807 10:39:52.595285 4846 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0dbbf3b966fc41edb12e90a7650ca49d" candidate_uuid: "8c1a9160f3ff4ab29e1f11faa34ad73a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c39cf82dec1e4b8eb3c756f619b896f6" is_pre_election: true
I20260807 10:39:52.595752 4915 leader_election.cc:302] T 0dbbf3b966fc41edb12e90a7650ca49d P 8c1a9160f3ff4ab29e1f11faa34ad73a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 497ad307b555407f8ed1c7b48256fe79, 8c1a9160f3ff4ab29e1f11faa34ad73a; no voters:
I20260807 10:39:52.595746 4846 raft_consensus.cc:2454] T 0dbbf3b966fc41edb12e90a7650ca49d P c39cf82dec1e4b8eb3c756f619b896f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c1a9160f3ff4ab29e1f11faa34ad73a in term 0.
I20260807 10:39:52.596082 5057 raft_consensus.cc:2781] T 0dbbf3b966fc41edb12e90a7650ca49d P 8c1a9160f3ff4ab29e1f11faa34ad73a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 10:39:52.596243 5057 raft_consensus.cc:482] T 0dbbf3b966fc41edb12e90a7650ca49d P 8c1a9160f3ff4ab29e1f11faa34ad73a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 10:39:52.596366 5057 raft_consensus.cc:3037] T 0dbbf3b966fc41edb12e90a7650ca49d P 8c1a9160f3ff4ab29e1f11faa34ad73a [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:39:52.598523 5057 raft_consensus.cc:504] T 0dbbf3b966fc41edb12e90a7650ca49d P 8c1a9160f3ff4ab29e1f11faa34ad73a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c1a9160f3ff4ab29e1f11faa34ad73a" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 32991 } } peers { permanent_uuid: "497ad307b555407f8ed1c7b48256fe79" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 40835 } } peers { permanent_uuid: "c39cf82dec1e4b8eb3c756f619b896f6" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 44645 } }
I20260807 10:39:52.599236 5057 leader_election.cc:288] T 0dbbf3b966fc41edb12e90a7650ca49d P 8c1a9160f3ff4ab29e1f11faa34ad73a [CANDIDATE]: Term 1 election: Requested vote from peers 497ad307b555407f8ed1c7b48256fe79 (127.20.171.65:40835), c39cf82dec1e4b8eb3c756f619b896f6 (127.20.171.66:44645)
I20260807 10:39:52.599648 4709 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0dbbf3b966fc41edb12e90a7650ca49d" candidate_uuid: "8c1a9160f3ff4ab29e1f11faa34ad73a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "497ad307b555407f8ed1c7b48256fe79"
I20260807 10:39:52.599716 4846 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0dbbf3b966fc41edb12e90a7650ca49d" candidate_uuid: "8c1a9160f3ff4ab29e1f11faa34ad73a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c39cf82dec1e4b8eb3c756f619b896f6"
I20260807 10:39:52.599864 4709 raft_consensus.cc:3037] T 0dbbf3b966fc41edb12e90a7650ca49d P 497ad307b555407f8ed1c7b48256fe79 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:39:52.599929 4846 raft_consensus.cc:3037] T 0dbbf3b966fc41edb12e90a7650ca49d P c39cf82dec1e4b8eb3c756f619b896f6 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:39:52.602185 4709 raft_consensus.cc:2454] T 0dbbf3b966fc41edb12e90a7650ca49d P 497ad307b555407f8ed1c7b48256fe79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c1a9160f3ff4ab29e1f11faa34ad73a in term 1.
I20260807 10:39:52.602238 4846 raft_consensus.cc:2454] T 0dbbf3b966fc41edb12e90a7650ca49d P c39cf82dec1e4b8eb3c756f619b896f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c1a9160f3ff4ab29e1f11faa34ad73a in term 1.
I20260807 10:39:52.602538 4915 leader_election.cc:302] T 0dbbf3b966fc41edb12e90a7650ca49d P 8c1a9160f3ff4ab29e1f11faa34ad73a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 497ad307b555407f8ed1c7b48256fe79, 8c1a9160f3ff4ab29e1f11faa34ad73a; no voters:
I20260807 10:39:52.602836 5057 raft_consensus.cc:2781] T 0dbbf3b966fc41edb12e90a7650ca49d P 8c1a9160f3ff4ab29e1f11faa34ad73a [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:39:52.603268 5057 raft_consensus.cc:686] T 0dbbf3b966fc41edb12e90a7650ca49d P 8c1a9160f3ff4ab29e1f11faa34ad73a [term 1 LEADER]: Becoming Leader. State: Replica: 8c1a9160f3ff4ab29e1f11faa34ad73a, State: Running, Role: LEADER
I20260807 10:39:52.603756 5057 consensus_queue.cc:237] T 0dbbf3b966fc41edb12e90a7650ca49d P 8c1a9160f3ff4ab29e1f11faa34ad73a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c1a9160f3ff4ab29e1f11faa34ad73a" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 32991 } } peers { permanent_uuid: "497ad307b555407f8ed1c7b48256fe79" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 40835 } } peers { permanent_uuid: "c39cf82dec1e4b8eb3c756f619b896f6" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 44645 } }
I20260807 10:39:52.608028 4560 catalog_manager.cc:5495] T 0dbbf3b966fc41edb12e90a7650ca49d P 8c1a9160f3ff4ab29e1f11faa34ad73a reported cstate change: term changed from 0 to 1, leader changed from <none> to 8c1a9160f3ff4ab29e1f11faa34ad73a (127.20.171.67). New cstate: current_term: 1 leader_uuid: "8c1a9160f3ff4ab29e1f11faa34ad73a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c1a9160f3ff4ab29e1f11faa34ad73a" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 32991 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "497ad307b555407f8ed1c7b48256fe79" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 40835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c39cf82dec1e4b8eb3c756f619b896f6" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 44645 } health_report { overall_health: UNKNOWN } } }
I20260807 10:39:52.658656 5044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:52.653530 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59608 (local address 127.20.171.67:32991)
0807 10:39:52.653710 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0807 10:39:52.653720 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 10:39:52.653737 (+ 17us) server_negotiation.cc:407] Connection header received
0807 10:39:52.653869 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:39:52.653873 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:39:52.653948 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:39:52.654066 (+ 118us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 10:39:52.654432 (+ 366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:52.655155 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:52.656537 (+ 1382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:52.657016 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:52.657110 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:39:52.657571 (+ 461us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 10:39:52.658138 (+ 567us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 10:39:52.658243 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0807 10:39:52.658381 (+ 138us) server_negotiation.cc:299] Negotiation successful
0807 10:39:52.658451 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260807 10:39:52.667047 4709 raft_consensus.cc:1261] T 0dbbf3b966fc41edb12e90a7650ca49d P 497ad307b555407f8ed1c7b48256fe79 [term 1 FOLLOWER]: Refusing update from remote peer 8c1a9160f3ff4ab29e1f11faa34ad73a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 10:39:52.667048 4846 raft_consensus.cc:1261] T 0dbbf3b966fc41edb12e90a7650ca49d P c39cf82dec1e4b8eb3c756f619b896f6 [term 1 FOLLOWER]: Refusing update from remote peer 8c1a9160f3ff4ab29e1f11faa34ad73a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 10:39:52.668073 5057 consensus_queue.cc:1035] T 0dbbf3b966fc41edb12e90a7650ca49d P 8c1a9160f3ff4ab29e1f11faa34ad73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "497ad307b555407f8ed1c7b48256fe79" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 40835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 10:39:52.668387 5061 consensus_queue.cc:1035] T 0dbbf3b966fc41edb12e90a7650ca49d P 8c1a9160f3ff4ab29e1f11faa34ad73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c39cf82dec1e4b8eb3c756f619b896f6" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 44645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 10:39:52.681106 5066 mvcc.cc:205] Tried to move back new op lower bound from 7315862293153374208 to 7315862292908572672. Current Snapshot: MvccSnapshot[applied={T|T < 7315862293153374208}]
I20260807 10:39:52.681416 5064 mvcc.cc:205] Tried to move back new op lower bound from 7315862293153374208 to 7315862292908572672. Current Snapshot: MvccSnapshot[applied={T|T < 7315862293153374208}]
I20260807 10:39:52.685170 5065 mvcc.cc:205] Tried to move back new op lower bound from 7315862293153374208 to 7315862292908572672. Current Snapshot: MvccSnapshot[applied={T|T < 7315862293153374208}]
I20260807 10:39:52.693586 4560 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56560:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 10:39:52.693988 4560 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56560:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 10:39:52.697431 4560 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3338383b9f1e48f99d0d1a2579e10d22: Sending DeleteTablet for 3 replicas of tablet 0dbbf3b966fc41edb12e90a7650ca49d
I20260807 10:39:52.698632 4963 tablet_service.cc:1514] Processing DeleteTablet for tablet 0dbbf3b966fc41edb12e90a7650ca49d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:39:52 UTC) from {username='kudu', principal='kudu/127.20.171.126@KRBTEST.COM'} at 127.0.0.1:59602
I20260807 10:39:52.698657 4826 tablet_service.cc:1514] Processing DeleteTablet for tablet 0dbbf3b966fc41edb12e90a7650ca49d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:39:52 UTC) from {username='kudu', principal='kudu/127.20.171.126@KRBTEST.COM'} at 127.0.0.1:56356
I20260807 10:39:52.698666 4689 tablet_service.cc:1514] Processing DeleteTablet for tablet 0dbbf3b966fc41edb12e90a7650ca49d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:39:52 UTC) from {username='kudu', principal='kudu/127.20.171.126@KRBTEST.COM'} at 127.0.0.1:33778
I20260807 10:39:52.699759 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 4624
I20260807 10:39:52.710986 5076 tablet_replica.cc:330] T 0dbbf3b966fc41edb12e90a7650ca49d P c39cf82dec1e4b8eb3c756f619b896f6: stopping tablet replica
I20260807 10:39:52.711707 5075 tablet_replica.cc:330] T 0dbbf3b966fc41edb12e90a7650ca49d P 8c1a9160f3ff4ab29e1f11faa34ad73a: stopping tablet replica
I20260807 10:39:52.712720 5075 raft_consensus.cc:2229] T 0dbbf3b966fc41edb12e90a7650ca49d P 8c1a9160f3ff4ab29e1f11faa34ad73a [term 1 LEADER]: Raft consensus shutting down.
I20260807 10:39:52.712828 5076 raft_consensus.cc:2229] T 0dbbf3b966fc41edb12e90a7650ca49d P c39cf82dec1e4b8eb3c756f619b896f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 10:39:52.713357 5076 raft_consensus.cc:2258] T 0dbbf3b966fc41edb12e90a7650ca49d P c39cf82dec1e4b8eb3c756f619b896f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:39:52.713680 5075 raft_consensus.cc:2258] T 0dbbf3b966fc41edb12e90a7650ca49d P 8c1a9160f3ff4ab29e1f11faa34ad73a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:39:52.716379 5075 ts_tablet_manager.cc:1905] T 0dbbf3b966fc41edb12e90a7650ca49d P 8c1a9160f3ff4ab29e1f11faa34ad73a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 10:39:52.716512 5074 tablet_replica.cc:330] T 0dbbf3b966fc41edb12e90a7650ca49d P 497ad307b555407f8ed1c7b48256fe79: stopping tablet replica
I20260807 10:39:52.716907 5074 raft_consensus.cc:2229] T 0dbbf3b966fc41edb12e90a7650ca49d P 497ad307b555407f8ed1c7b48256fe79 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 10:39:52.717418 5074 raft_consensus.cc:2258] T 0dbbf3b966fc41edb12e90a7650ca49d P 497ad307b555407f8ed1c7b48256fe79 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:39:52.719554 5074 ts_tablet_manager.cc:1905] T 0dbbf3b966fc41edb12e90a7650ca49d P 497ad307b555407f8ed1c7b48256fe79: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 10:39:52.720049 5076 ts_tablet_manager.cc:1905] T 0dbbf3b966fc41edb12e90a7650ca49d P c39cf82dec1e4b8eb3c756f619b896f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 10:39:52.723917 5075 ts_tablet_manager.cc:1918] T 0dbbf3b966fc41edb12e90a7650ca49d P 8c1a9160f3ff4ab29e1f11faa34ad73a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 10:39:52.724138 5075 log.cc:1196] T 0dbbf3b966fc41edb12e90a7650ca49d P 8c1a9160f3ff4ab29e1f11faa34ad73a: Deleting WAL directory at /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/ts-2/wal/wals/0dbbf3b966fc41edb12e90a7650ca49d
I20260807 10:39:52.724792 5075 ts_tablet_manager.cc:1939] T 0dbbf3b966fc41edb12e90a7650ca49d P 8c1a9160f3ff4ab29e1f11faa34ad73a: Deleting consensus metadata
I20260807 10:39:52.726634 5074 ts_tablet_manager.cc:1918] T 0dbbf3b966fc41edb12e90a7650ca49d P 497ad307b555407f8ed1c7b48256fe79: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 10:39:52.726631 4546 catalog_manager.cc:4841] TS 8c1a9160f3ff4ab29e1f11faa34ad73a (127.20.171.67:32991): tablet 0dbbf3b966fc41edb12e90a7650ca49d (table test-table [id=303667041c9044879ab6cd583d39333c]) successfully deleted
I20260807 10:39:52.726835 5074 log.cc:1196] T 0dbbf3b966fc41edb12e90a7650ca49d P 497ad307b555407f8ed1c7b48256fe79: Deleting WAL directory at /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/ts-0/wal/wals/0dbbf3b966fc41edb12e90a7650ca49d
I20260807 10:39:52.727059 5076 ts_tablet_manager.cc:1918] T 0dbbf3b966fc41edb12e90a7650ca49d P c39cf82dec1e4b8eb3c756f619b896f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 10:39:52.727276 5076 log.cc:1196] T 0dbbf3b966fc41edb12e90a7650ca49d P c39cf82dec1e4b8eb3c756f619b896f6: Deleting WAL directory at /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/ts-1/wal/wals/0dbbf3b966fc41edb12e90a7650ca49d
I20260807 10:39:52.727380 5074 ts_tablet_manager.cc:1939] T 0dbbf3b966fc41edb12e90a7650ca49d P 497ad307b555407f8ed1c7b48256fe79: Deleting consensus metadata
Aug 07 10:39:52 dist-test-slave-0b58 krb5kdc[4515](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099190, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.171.65@KRBTEST.COM
I20260807 10:39:52.728899 5076 ts_tablet_manager.cc:1939] T 0dbbf3b966fc41edb12e90a7650ca49d P c39cf82dec1e4b8eb3c756f619b896f6: Deleting consensus metadata
I20260807 10:39:52.728973 4546 catalog_manager.cc:4841] TS 497ad307b555407f8ed1c7b48256fe79 (127.20.171.65:40835): tablet 0dbbf3b966fc41edb12e90a7650ca49d (table test-table [id=303667041c9044879ab6cd583d39333c]) successfully deleted
I20260807 10:39:52.730731 4545 catalog_manager.cc:4841] TS c39cf82dec1e4b8eb3c756f619b896f6 (127.20.171.66:44645): tablet 0dbbf3b966fc41edb12e90a7650ca49d (table test-table [id=303667041c9044879ab6cd583d39333c]) successfully deleted
I20260807 10:39:52.735769 5047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:52.701240 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33782 (local address 127.20.171.65:40835)
0807 10:39:52.701425 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0807 10:39:52.701431 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:39:52.711983 (+ 10552us) server_negotiation.cc:407] Connection header received
0807 10:39:52.712342 (+ 359us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:39:52.712349 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:39:52.712440 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:39:52.712517 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:39:52.714515 (+ 1998us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:52.715636 (+ 1121us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:52.717752 (+ 2116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:52.718458 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:52.718558 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:39:52.729420 (+ 10862us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:39:52.729436 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:39:52.729455 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:39:52.729498 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:39:52.732766 (+ 3268us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:39:52.733644 (+ 878us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:39:52.733650 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:39:52.733652 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:39:52.733780 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:39:52.734265 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:39:52.734269 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:39:52.734271 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:39:52.734621 (+ 350us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:39:52.734864 (+ 243us) server_negotiation.cc:1035] Waiting for connection context
0807 10:39:52.735267 (+ 403us) server_negotiation.cc:299] Negotiation successful
0807 10:39:52.735422 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260807 10:39:52.736630 4749 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:39:52.877516 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 4624
I20260807 10:39:52.898940 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 4760
Aug 07 10:39:52 dist-test-slave-0b58 krb5kdc[4515](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099190, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.171.66@KRBTEST.COM
I20260807 10:39:52.915611 5046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:52.899839 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56368 (local address 127.20.171.66:44645)
0807 10:39:52.900036 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0807 10:39:52.900042 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:39:52.900062 (+ 20us) server_negotiation.cc:407] Connection header received
0807 10:39:52.900278 (+ 216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:39:52.900283 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:39:52.900360 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:39:52.900460 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:39:52.901701 (+ 1241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:52.902777 (+ 1076us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:52.904136 (+ 1359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:52.904826 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:52.904946 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:39:52.909386 (+ 4440us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:39:52.909405 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:39:52.909424 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:39:52.909473 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:39:52.913014 (+ 3541us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:39:52.913648 (+ 634us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:39:52.913657 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:39:52.913660 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:39:52.913815 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:39:52.914150 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:39:52.914154 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:39:52.914157 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:39:52.914585 (+ 428us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:39:52.914862 (+ 277us) server_negotiation.cc:1035] Waiting for connection context
0807 10:39:52.915079 (+ 217us) server_negotiation.cc:299] Negotiation successful
0807 10:39:52.915273 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260807 10:39:52.916363 4886 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:39:53.004878 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 4760
I20260807 10:39:53.024430 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 4897
Aug 07 10:39:53 dist-test-slave-0b58 krb5kdc[4515](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099190, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.171.67@KRBTEST.COM
I20260807 10:39:53.040743 5044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:39:53.025211 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59616 (local address 127.20.171.67:32991)
0807 10:39:53.025403 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0807 10:39:53.025411 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 10:39:53.025504 (+ 93us) server_negotiation.cc:407] Connection header received
0807 10:39:53.025726 (+ 222us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:39:53.025731 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:39:53.025803 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:39:53.025904 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:39:53.027281 (+ 1377us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:53.028110 (+ 829us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:53.029456 (+ 1346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:39:53.029936 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:39:53.030088 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:39:53.034586 (+ 4498us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:39:53.034598 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:39:53.034613 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:39:53.034652 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:39:53.037659 (+ 3007us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:39:53.038408 (+ 749us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:39:53.038419 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:39:53.038421 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:39:53.038573 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:39:53.038990 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:39:53.038996 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:39:53.038999 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:39:53.039362 (+ 363us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:39:53.039771 (+ 409us) server_negotiation.cc:1035] Waiting for connection context
0807 10:39:53.040024 (+ 253us) server_negotiation.cc:299] Negotiation successful
0807 10:39:53.040251 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260807 10:39:53.041458 5024 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:39:53.161027 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 4897
I20260807 10:39:53.185559 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 4528
I20260807 10:39:53.186766 4593 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:39:53.298337 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 4528
I20260807 10:40:13.324440 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.171.126:44373
--webserver_interface=127.20.171.126
--webserver_port=38647
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.126.keytab
--principal=kudu/127.20.171.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.171.84:36941
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.171.126:44373
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:40:13.676769 5082 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:40:13.677098 5082 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:40:13.677273 5082 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:40:13.684580 5082 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260807 10:40:13.684706 5082 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260807 10:40:13.684824 5082 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260807 10:40:13.684919 5082 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 10:40:13.685021 5082 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:40:13.685137 5082 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:40:13.685228 5082 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 10:40:13.685312 5082 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 10:40:13.695277 5082 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.171.84:36941
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.20.171.126:44373
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.126.keytab
--principal=kudu/127.20.171.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.171.126:44373
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.171.126
--webserver_port=38647
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:40:13.696713 5082 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:40:13.698074 5082 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:40:13.725376 5088 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:40:13.725457 5092 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:40:13.725418 5090 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:40:13.726280 5082 server_base.cc:1034] running on GCE node
I20260807 10:40:13.727165 5082 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:40:13.728854 5082 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:40:13.730116 5082 hybrid_clock.cc:648] HybridClock initialized: now 1786099213730050 us; error 40 us; skew 500 ppm
I20260807 10:40:13.730520 5082 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:40:13 dist-test-slave-0b58 krb5kdc[4515](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099213, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:40:13.734488 5082 init.cc:377] Logged in from keytab as kudu/127.20.171.126@KRBTEST.COM (short username kudu)
I20260807 10:40:13.736294 5082 webserver.cc:460] Webserver started at http://127.20.171.126:38647/ using document root <none> and password file <none>
I20260807 10:40:13.737112 5082 fs_manager.cc:359] Metadata directory not provided
I20260807 10:40:13.737274 5082 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:40:13.743460 5082 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.006s sys 0.000s
I20260807 10:40:13.746577 5099 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:40:13.747929 5082 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 10:40:13.748124 5082 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/master-0/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/master-0/wal
uuid: "3338383b9f1e48f99d0d1a2579e10d22"
format_stamp: "Formatted at 2026-08-07 10:39:50 on dist-test-slave-0b58"
server_key: "bcbb2ad5895e8174f3b0b740110d88a3"
server_key_iv: "30f6d338e7bcc11da236c446c51cf3e1"
server_key_version: "encryptionkey@0"
I20260807 10:40:13.749269 5082 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:40:13.801453 5082 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:40:13.806322 5082 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:40:13.806651 5082 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:40:13.826963 5082 rpc_server.cc:307] RPC server started. Bound to: 127.20.171.126:44373
I20260807 10:40:13.827003 5152 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.171.126:44373 every 8 connection(s)
I20260807 10:40:13.828593 5082 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
I20260807 10:40:13.831279 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 5082
I20260807 10:40:13.832114 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.171.65:40835
--local_ip_for_outbound_sockets=127.20.171.65
--tserver_master_addrs=127.20.171.126:44373
--webserver_port=32977
--webserver_interface=127.20.171.65
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.65.keytab
--principal=kudu/127.20.171.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.171.84:36941
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 10:40:13.836378 5153 sys_catalog.cc:263] Verifying existing consensus state
I20260807 10:40:13.839727 5153 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3338383b9f1e48f99d0d1a2579e10d22: Bootstrap starting.
I20260807 10:40:13.866058 5153 log.cc:824] T 00000000000000000000000000000000 P 3338383b9f1e48f99d0d1a2579e10d22: Log is configured to *not* fsync() on all Append() calls
I20260807 10:40:13.883253 5153 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3338383b9f1e48f99d0d1a2579e10d22: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 10:40:13.883940 5153 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3338383b9f1e48f99d0d1a2579e10d22: Bootstrap complete.
I20260807 10:40:13.897799 5153 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3338383b9f1e48f99d0d1a2579e10d22 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3338383b9f1e48f99d0d1a2579e10d22" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 44373 } }
I20260807 10:40:13.899029 5153 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3338383b9f1e48f99d0d1a2579e10d22 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3338383b9f1e48f99d0d1a2579e10d22, State: Initialized, Role: FOLLOWER
I20260807 10:40:13.899789 5153 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3338383b9f1e48f99d0d1a2579e10d22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3338383b9f1e48f99d0d1a2579e10d22" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 44373 } }
I20260807 10:40:13.900139 5153 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3338383b9f1e48f99d0d1a2579e10d22 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 10:40:13.900301 5153 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3338383b9f1e48f99d0d1a2579e10d22 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 10:40:13.900513 5153 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3338383b9f1e48f99d0d1a2579e10d22 [term 1 FOLLOWER]: Advancing to term 2
I20260807 10:40:13.906723 5153 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3338383b9f1e48f99d0d1a2579e10d22 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3338383b9f1e48f99d0d1a2579e10d22" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 44373 } }
I20260807 10:40:13.907410 5153 leader_election.cc:302] T 00000000000000000000000000000000 P 3338383b9f1e48f99d0d1a2579e10d22 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3338383b9f1e48f99d0d1a2579e10d22; no voters:
I20260807 10:40:13.908097 5153 leader_election.cc:288] T 00000000000000000000000000000000 P 3338383b9f1e48f99d0d1a2579e10d22 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260807 10:40:13.908280 5157 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3338383b9f1e48f99d0d1a2579e10d22 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 10:40:13.909677 5157 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3338383b9f1e48f99d0d1a2579e10d22 [term 2 LEADER]: Becoming Leader. State: Replica: 3338383b9f1e48f99d0d1a2579e10d22, State: Running, Role: LEADER
I20260807 10:40:13.910403 5153 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3338383b9f1e48f99d0d1a2579e10d22 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 10:40:13.910311 5157 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3338383b9f1e48f99d0d1a2579e10d22 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3338383b9f1e48f99d0d1a2579e10d22" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 44373 } }
I20260807 10:40:13.912700 5159 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3338383b9f1e48f99d0d1a2579e10d22 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3338383b9f1e48f99d0d1a2579e10d22. Latest consensus state: current_term: 2 leader_uuid: "3338383b9f1e48f99d0d1a2579e10d22" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3338383b9f1e48f99d0d1a2579e10d22" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 44373 } } }
I20260807 10:40:13.913146 5159 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3338383b9f1e48f99d0d1a2579e10d22 [sys.catalog]: This master's current role is: LEADER
I20260807 10:40:13.913249 5158 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3338383b9f1e48f99d0d1a2579e10d22 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "3338383b9f1e48f99d0d1a2579e10d22" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3338383b9f1e48f99d0d1a2579e10d22" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 44373 } } }
I20260807 10:40:13.914399 5158 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3338383b9f1e48f99d0d1a2579e10d22 [sys.catalog]: This master's current role is: LEADER
I20260807 10:40:13.922381 5163 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 10:40:13.931648 5163 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 10:40:13.933156 5163 catalog_manager.cc:1259] Loaded cluster ID: 1914920cfa7240e7b1e07df6302271ff
I20260807 10:40:13.933328 5163 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 10:40:13.937552 5163 catalog_manager.cc:1504] Loading token signing keys...
I20260807 10:40:13.939131 5163 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 3338383b9f1e48f99d0d1a2579e10d22: Loaded TSK: 0
I20260807 10:40:13.980639 5163 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3338383b9f1e48f99d0d1a2579e10d22: Generated new TSK 1
I20260807 10:40:13.981179 5163 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260807 10:40:14.248034 5155 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:40:14.248409 5155 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:40:14.248625 5155 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:40:14.256487 5155 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:40:14.256587 5155 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:40:14.256784 5155 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.171.65
I20260807 10:40:14.267035 5155 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.171.84:36941
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.65.keytab
--principal=kudu/127.20.171.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.171.65:40835
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.171.65
--webserver_port=32977
--tserver_master_addrs=127.20.171.126:44373
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.171.65
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:40:14.268489 5155 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:40:14.269829 5155 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:40:14.286829 5182 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:40:14.287072 5181 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:40:14.286794 5184 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:40:14.288600 5155 server_base.cc:1034] running on GCE node
I20260807 10:40:14.289248 5155 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:40:14.290232 5155 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:40:14.291474 5155 hybrid_clock.cc:648] HybridClock initialized: now 1786099214291412 us; error 47 us; skew 500 ppm
I20260807 10:40:14.291808 5155 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:40:14 dist-test-slave-0b58 krb5kdc[4515](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099214, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:40:14.295456 5155 init.cc:377] Logged in from keytab as kudu/127.20.171.65@KRBTEST.COM (short username kudu)
I20260807 10:40:14.297060 5155 webserver.cc:460] Webserver started at http://127.20.171.65:32977/ using document root <none> and password file <none>
I20260807 10:40:14.297791 5155 fs_manager.cc:359] Metadata directory not provided
I20260807 10:40:14.297957 5155 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:40:14.303486 5155 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.005s sys 0.000s
I20260807 10:40:14.306437 5192 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:40:14.307849 5155 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 10:40:14.308040 5155 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/ts-0/wal
uuid: "497ad307b555407f8ed1c7b48256fe79"
format_stamp: "Formatted at 2026-08-07 10:39:51 on dist-test-slave-0b58"
server_key: "8dee52968cbfeedc9beb0888eaab2de6"
server_key_iv: "0baa5d515e7ae209c016724f50842663"
server_key_version: "encryptionkey@0"
I20260807 10:40:14.309132 5155 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:40:14.334894 5155 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:40:14.339340 5155 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:40:14.339629 5155 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:40:14.340744 5155 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:40:14.342141 5155 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:40:14.342283 5155 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:40:14.342425 5155 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:40:14.342525 5155 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:40:14.378157 5155 rpc_server.cc:307] RPC server started. Bound to: 127.20.171.65:40835
I20260807 10:40:14.378223 5306 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.171.65:40835 every 8 connection(s)
I20260807 10:40:14.379678 5155 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/ts-0/data/info.pb
I20260807 10:40:14.385560 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 5155
I20260807 10:40:14.386256 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.171.66:44645
--local_ip_for_outbound_sockets=127.20.171.66
--tserver_master_addrs=127.20.171.126:44373
--webserver_port=33451
--webserver_interface=127.20.171.66
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.66.keytab
--principal=kudu/127.20.171.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.171.84:36941
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 10:40:14 dist-test-slave-0b58 krb5kdc[4515](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099214, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.65@KRBTEST.COM for kudu/127.20.171.126@KRBTEST.COM
I20260807 10:40:14.403462 5310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:40:14.382565 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.65:54669 (local address 127.20.171.126:44373)
0807 10:40:14.383085 (+ 520us) server_negotiation.cc:206] Beginning negotiation
0807 10:40:14.383096 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 10:40:14.383772 (+ 676us) server_negotiation.cc:407] Connection header received
0807 10:40:14.385935 (+ 2163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:40:14.385946 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:40:14.386245 (+ 299us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:40:14.386600 (+ 355us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:40:14.388131 (+ 1531us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:40:14.389436 (+ 1305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:40:14.390956 (+ 1520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:40:14.391557 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:40:14.391760 (+ 203us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:40:14.395243 (+ 3483us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:40:14.395251 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:40:14.395264 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:40:14.395297 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:40:14.398405 (+ 3108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:40:14.399487 (+ 1082us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:40:14.399493 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:40:14.399499 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:40:14.399670 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:40:14.400140 (+ 470us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:40:14.400146 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:40:14.400150 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:40:14.400716 (+ 566us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:40:14.400929 (+ 213us) server_negotiation.cc:1035] Waiting for connection context
0807 10:40:14.401707 (+ 778us) server_negotiation.cc:299] Negotiation successful
0807 10:40:14.402115 (+ 408us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":339,"thread_start_us":222,"threads_started":1}
I20260807 10:40:14.403467 5311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:40:14.382853 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:44373 (local address 127.20.171.65:54669)
0807 10:40:14.383594 (+ 741us) negotiation.cc:107] Waiting for socket to connect
0807 10:40:14.383630 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0807 10:40:14.385414 (+ 1784us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:40:14.386793 (+ 1379us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:40:14.386806 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:40:14.387394 (+ 588us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:40:14.387903 (+ 509us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:40:14.387920 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:40:14.389605 (+ 1685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:40:14.389617 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:40:14.390811 (+ 1194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:40:14.390823 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:40:14.391788 (+ 965us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:40:14.391795 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:40:14.392058 (+ 263us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:40:14.392826 (+ 768us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:40:14.392847 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:40:14.394975 (+ 2128us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:40:14.398573 (+ 3598us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:40:14.398585 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:40:14.398602 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:40:14.399308 (+ 706us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:40:14.399809 (+ 501us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:40:14.399813 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:40:14.399818 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:40:14.400018 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:40:14.400869 (+ 851us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:40:14.400877 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:40:14.401207 (+ 330us) client_negotiation.cc:769] Sending connection context
0807 10:40:14.401488 (+ 281us) client_negotiation.cc:240] Negotiation successful
0807 10:40:14.402115 (+ 627us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":502,"thread_start_us":305,"threads_started":1}
I20260807 10:40:14.406669 5308 heartbeater.cc:347] Connected to a master server at 127.20.171.126:44373
I20260807 10:40:14.407016 5308 heartbeater.cc:464] Registering TS with master...
I20260807 10:40:14.407979 5308 heartbeater.cc:511] Master 127.20.171.126:44373 requested a full tablet report, sending...
I20260807 10:40:14.410682 5117 ts_manager.cc:194] Registered new tserver with Master: 497ad307b555407f8ed1c7b48256fe79 (127.20.171.65:40835)
I20260807 10:40:14.413130 5117 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.171.65@KRBTEST.COM'} at 127.20.171.65:54669
W20260807 10:40:14.737161 5312 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:40:14.737490 5312 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:40:14.737670 5312 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:40:14.745203 5312 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:40:14.745324 5312 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:40:14.745504 5312 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.171.66
I20260807 10:40:14.755417 5312 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.171.84:36941
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.66.keytab
--principal=kudu/127.20.171.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.171.66:44645
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.171.66
--webserver_port=33451
--tserver_master_addrs=127.20.171.126:44373
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.171.66
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:40:14.756778 5312 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:40:14.758059 5312 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:40:14.771629 5318 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:40:14.771627 5319 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:40:14.772007 5321 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:40:14.772799 5312 server_base.cc:1034] running on GCE node
I20260807 10:40:14.773494 5312 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:40:14.774436 5312 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:40:14.775668 5312 hybrid_clock.cc:648] HybridClock initialized: now 1786099214775613 us; error 63 us; skew 500 ppm
I20260807 10:40:14.775990 5312 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:40:14 dist-test-slave-0b58 krb5kdc[4515](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099214, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:40:14.779235 5312 init.cc:377] Logged in from keytab as kudu/127.20.171.66@KRBTEST.COM (short username kudu)
I20260807 10:40:14.780700 5312 webserver.cc:460] Webserver started at http://127.20.171.66:33451/ using document root <none> and password file <none>
I20260807 10:40:14.781404 5312 fs_manager.cc:359] Metadata directory not provided
I20260807 10:40:14.781565 5312 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:40:14.786782 5312 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.005s sys 0.000s
I20260807 10:40:14.789364 5328 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:40:14.790588 5312 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260807 10:40:14.790771 5312 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/ts-1/wal
uuid: "c39cf82dec1e4b8eb3c756f619b896f6"
format_stamp: "Formatted at 2026-08-07 10:39:51 on dist-test-slave-0b58"
server_key: "b861a30f41e48b30e6da31e0a09f9399"
server_key_iv: "0c30bb09e6851267d19c78277053b0e5"
server_key_version: "encryptionkey@0"
I20260807 10:40:14.791771 5312 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:40:14.818423 5312 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:40:14.823165 5312 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:40:14.823483 5312 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:40:14.824613 5312 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:40:14.826150 5312 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:40:14.826288 5312 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:40:14.826395 5312 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:40:14.826524 5312 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.001s sys 0.000s
I20260807 10:40:14.867655 5312 rpc_server.cc:307] RPC server started. Bound to: 127.20.171.66:44645
I20260807 10:40:14.867726 5443 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.171.66:44645 every 8 connection(s)
I20260807 10:40:14.869190 5312 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/ts-1/data/info.pb
I20260807 10:40:14.873485 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 5312
I20260807 10:40:14.874140 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.171.67:32991
--local_ip_for_outbound_sockets=127.20.171.67
--tserver_master_addrs=127.20.171.126:44373
--webserver_port=41259
--webserver_interface=127.20.171.67
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.67.keytab
--principal=kudu/127.20.171.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.171.84:36941
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 10:40:14 dist-test-slave-0b58 krb5kdc[4515](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099214, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.66@KRBTEST.COM for kudu/127.20.171.126@KRBTEST.COM
I20260807 10:40:14.890374 5310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:40:14.871997 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.66:40247 (local address 127.20.171.126:44373)
0807 10:40:14.872193 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0807 10:40:14.872203 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 10:40:14.873318 (+ 1115us) server_negotiation.cc:407] Connection header received
0807 10:40:14.875398 (+ 2080us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:40:14.875404 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:40:14.875519 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:40:14.875635 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:40:14.877254 (+ 1619us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:40:14.877958 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:40:14.879539 (+ 1581us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:40:14.879980 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:40:14.880123 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:40:14.884072 (+ 3949us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:40:14.884078 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:40:14.884081 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:40:14.884116 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:40:14.886768 (+ 2652us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:40:14.887824 (+ 1056us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:40:14.887828 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:40:14.887831 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:40:14.887979 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:40:14.888558 (+ 579us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:40:14.888562 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:40:14.888564 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:40:14.888871 (+ 307us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:40:14.888987 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0807 10:40:14.889932 (+ 945us) server_negotiation.cc:299] Negotiation successful
0807 10:40:14.890117 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260807 10:40:14.892153 5446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:40:14.872451 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:44373 (local address 127.20.171.66:40247)
0807 10:40:14.873152 (+ 701us) negotiation.cc:107] Waiting for socket to connect
0807 10:40:14.873190 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0807 10:40:14.875122 (+ 1932us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:40:14.875885 (+ 763us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:40:14.875893 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:40:14.876487 (+ 594us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:40:14.877060 (+ 573us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:40:14.877078 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:40:14.878135 (+ 1057us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:40:14.878139 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:40:14.879390 (+ 1251us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:40:14.879401 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:40:14.880227 (+ 826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:40:14.880235 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:40:14.880520 (+ 285us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:40:14.881320 (+ 800us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:40:14.881355 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:40:14.883809 (+ 2454us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:40:14.886921 (+ 3112us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:40:14.886930 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:40:14.886949 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:40:14.887653 (+ 704us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:40:14.888101 (+ 448us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:40:14.888108 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:40:14.888114 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:40:14.888433 (+ 319us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:40:14.889033 (+ 600us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:40:14.889044 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:40:14.889522 (+ 478us) client_negotiation.cc:769] Sending connection context
0807 10:40:14.889844 (+ 322us) client_negotiation.cc:240] Negotiation successful
0807 10:40:14.890453 (+ 609us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":464,"thread_start_us":278,"threads_started":1}
I20260807 10:40:14.893743 5444 heartbeater.cc:347] Connected to a master server at 127.20.171.126:44373
I20260807 10:40:14.894060 5444 heartbeater.cc:464] Registering TS with master...
I20260807 10:40:14.894827 5444 heartbeater.cc:511] Master 127.20.171.126:44373 requested a full tablet report, sending...
I20260807 10:40:14.896593 5117 ts_manager.cc:194] Registered new tserver with Master: c39cf82dec1e4b8eb3c756f619b896f6 (127.20.171.66:44645)
I20260807 10:40:14.897403 5117 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.171.66@KRBTEST.COM'} at 127.20.171.66:40247
W20260807 10:40:15.217339 5447 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:40:15.217675 5447 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:40:15.217857 5447 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:40:15.225051 5447 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:40:15.225214 5447 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:40:15.225412 5447 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.171.67
I20260807 10:40:15.234799 5447 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.171.84:36941
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.67.keytab
--principal=kudu/127.20.171.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.171.67:32991
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.171.67
--webserver_port=41259
--tserver_master_addrs=127.20.171.126:44373
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.171.67
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:40:15.236181 5447 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:40:15.237501 5447 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:40:15.250365 5453 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:40:15.250463 5452 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:40:15.250506 5456 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:40:15.251350 5447 server_base.cc:1034] running on GCE node
I20260807 10:40:15.251968 5447 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:40:15.252952 5447 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:40:15.254139 5447 hybrid_clock.cc:648] HybridClock initialized: now 1786099215254063 us; error 72 us; skew 500 ppm
I20260807 10:40:15.254462 5447 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:40:15 dist-test-slave-0b58 krb5kdc[4515](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099215, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:40:15.257606 5447 init.cc:377] Logged in from keytab as kudu/127.20.171.67@KRBTEST.COM (short username kudu)
I20260807 10:40:15.258878 5447 webserver.cc:460] Webserver started at http://127.20.171.67:41259/ using document root <none> and password file <none>
I20260807 10:40:15.259488 5447 fs_manager.cc:359] Metadata directory not provided
I20260807 10:40:15.259605 5447 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:40:15.265048 5447 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.004s sys 0.000s
I20260807 10:40:15.267633 5463 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:40:15.269012 5447 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 10:40:15.269201 5447 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/ts-2/wal
uuid: "8c1a9160f3ff4ab29e1f11faa34ad73a"
format_stamp: "Formatted at 2026-08-07 10:39:52 on dist-test-slave-0b58"
server_key: "43ba2d768895660a34d9b199d0eacd63"
server_key_iv: "483b44cd939a548398a4fc5cf5726bb4"
server_key_version: "encryptionkey@0"
I20260807 10:40:15.270192 5447 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:40:15.284324 5447 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:40:15.288719 5447 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:40:15.289049 5447 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:40:15.289907 5447 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:40:15.291118 5447 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:40:15.291205 5447 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:40:15.291283 5447 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:40:15.291339 5447 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:40:15.324797 5447 rpc_server.cc:307] RPC server started. Bound to: 127.20.171.67:32991
I20260807 10:40:15.324888 5576 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.171.67:32991 every 8 connection(s)
I20260807 10:40:15.326262 5447 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/ts-2/data/info.pb
I20260807 10:40:15.328549 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 5447
Aug 07 10:40:15 dist-test-slave-0b58 krb5kdc[4515](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099215, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.67@KRBTEST.COM for kudu/127.20.171.126@KRBTEST.COM
I20260807 10:40:15.348915 5579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:40:15.329505 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59136 (local address 127.20.171.126:44373)
0807 10:40:15.329954 (+ 449us) server_negotiation.cc:206] Beginning negotiation
0807 10:40:15.329958 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 10:40:15.332878 (+ 2920us) server_negotiation.cc:407] Connection header received
0807 10:40:15.333085 (+ 207us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:40:15.333091 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:40:15.333181 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:40:15.333305 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:40:15.335450 (+ 2145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:40:15.336585 (+ 1135us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:40:15.338425 (+ 1840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:40:15.339197 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:40:15.339280 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:40:15.342764 (+ 3484us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:40:15.342768 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:40:15.342771 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:40:15.342801 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:40:15.345973 (+ 3172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:40:15.346842 (+ 869us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:40:15.346846 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:40:15.346848 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:40:15.346991 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:40:15.347433 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:40:15.347436 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:40:15.347438 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:40:15.347743 (+ 305us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:40:15.347952 (+ 209us) server_negotiation.cc:1035] Waiting for connection context
0807 10:40:15.348368 (+ 416us) server_negotiation.cc:299] Negotiation successful
0807 10:40:15.348546 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":4,"server-negotiator.queue_time_us":368,"thread_start_us":255,"threads_started":1}
I20260807 10:40:15.352084 5310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:40:15.328820 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.67:48015 (local address 127.20.171.126:44373)
0807 10:40:15.329047 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0807 10:40:15.329053 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:40:15.333041 (+ 3988us) server_negotiation.cc:407] Connection header received
0807 10:40:15.335781 (+ 2740us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:40:15.335788 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:40:15.335863 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:40:15.335966 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:40:15.337882 (+ 1916us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:40:15.338919 (+ 1037us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:40:15.341171 (+ 2252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:40:15.341555 (+ 384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:40:15.341646 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:40:15.345589 (+ 3943us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:40:15.345594 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:40:15.345597 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:40:15.345642 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:40:15.348907 (+ 3265us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:40:15.349826 (+ 919us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:40:15.349833 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:40:15.349835 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:40:15.349977 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:40:15.350481 (+ 504us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:40:15.350486 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:40:15.350490 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:40:15.350828 (+ 338us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:40:15.350963 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0807 10:40:15.351698 (+ 735us) server_negotiation.cc:299] Negotiation successful
0807 10:40:15.351851 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260807 10:40:15.353219 5580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:40:15.329385 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:44373 (local address 127.20.171.67:48015)
0807 10:40:15.332891 (+ 3506us) negotiation.cc:107] Waiting for socket to connect
0807 10:40:15.332947 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0807 10:40:15.335511 (+ 2564us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:40:15.336169 (+ 658us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:40:15.336176 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:40:15.336952 (+ 776us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:40:15.337709 (+ 757us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:40:15.337744 (+ 35us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:40:15.339083 (+ 1339us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:40:15.339087 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:40:15.341024 (+ 1937us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:40:15.341039 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:40:15.341822 (+ 783us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:40:15.341831 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:40:15.342127 (+ 296us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:40:15.342812 (+ 685us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:40:15.342834 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:40:15.345377 (+ 2543us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:40:15.349039 (+ 3662us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:40:15.349048 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:40:15.349070 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:40:15.349646 (+ 576us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:40:15.350091 (+ 445us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:40:15.350096 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:40:15.350101 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:40:15.350351 (+ 250us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:40:15.350954 (+ 603us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:40:15.350959 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:40:15.351268 (+ 309us) client_negotiation.cc:769] Sending connection context
0807 10:40:15.351557 (+ 289us) client_negotiation.cc:240] Negotiation successful
0807 10:40:15.352043 (+ 486us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3191,"thread_start_us":2970,"threads_started":1}
I20260807 10:40:15.354555 5577 heartbeater.cc:347] Connected to a master server at 127.20.171.126:44373
I20260807 10:40:15.354856 5577 heartbeater.cc:464] Registering TS with master...
I20260807 10:40:15.355566 5577 heartbeater.cc:511] Master 127.20.171.126:44373 requested a full tablet report, sending...
I20260807 10:40:15.356938 5117 ts_manager.cc:194] Registered new tserver with Master: 8c1a9160f3ff4ab29e1f11faa34ad73a (127.20.171.67:32991)
I20260807 10:40:15.357733 5117 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.171.67@KRBTEST.COM'} at 127.20.171.67:48015
I20260807 10:40:15.364033 21165 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 10:40:15.370329 5310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:40:15.365050 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59144 (local address 127.20.171.126:44373)
0807 10:40:15.365214 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0807 10:40:15.365218 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 10:40:15.365597 (+ 379us) server_negotiation.cc:407] Connection header received
0807 10:40:15.365762 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:40:15.365766 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:40:15.365890 (+ 124us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:40:15.366006 (+ 116us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 10:40:15.366485 (+ 479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:40:15.367240 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:40:15.368729 (+ 1489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:40:15.369118 (+ 389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:40:15.369230 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:40:15.369637 (+ 407us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 10:40:15.369874 (+ 237us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0807 10:40:15.370139 (+ 265us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:59144: token expired
Metrics: {"server-negotiator.queue_time_us":55}
W20260807 10:40:15.370452 5310 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:59144: token expired
W20260807 10:40:15.371059 5035 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.20.171.126:44373)
I20260807 10:40:15.384830 5310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:40:15.371495 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59148 (local address 127.20.171.126:44373)
0807 10:40:15.371634 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0807 10:40:15.371638 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 10:40:15.371702 (+ 64us) server_negotiation.cc:407] Connection header received
0807 10:40:15.371813 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:40:15.371816 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:40:15.371868 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:40:15.371942 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:40:15.373502 (+ 1560us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:40:15.374239 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:40:15.375662 (+ 1423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:40:15.376066 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:40:15.376170 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:40:15.379525 (+ 3355us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:40:15.379529 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:40:15.379532 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:40:15.379559 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:40:15.382307 (+ 2748us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:40:15.383115 (+ 808us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:40:15.383119 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:40:15.383121 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:40:15.383252 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:40:15.383649 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:40:15.383652 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:40:15.383653 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:40:15.383934 (+ 281us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:40:15.384114 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0807 10:40:15.384467 (+ 353us) server_negotiation.cc:299] Negotiation successful
0807 10:40:15.384618 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260807 10:40:15.388010 5117 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59148:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 10:40:15.395453 5117 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 10:40:15.417755 5308 heartbeater.cc:503] Master 127.20.171.126:44373 was elected leader, sending a full tablet report...
I20260807 10:40:15.418434 5587 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:40:15.407167 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.66:44645 (local address 127.0.0.1:51060)
0807 10:40:15.409225 (+ 2058us) negotiation.cc:107] Waiting for socket to connect
0807 10:40:15.409243 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 10:40:15.409353 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:40:15.410740 (+ 1387us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:40:15.410748 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:40:15.410786 (+ 38us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:40:15.411272 (+ 486us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:40:15.411288 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:40:15.413333 (+ 2045us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:40:15.413338 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:40:15.415742 (+ 2404us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:40:15.415757 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:40:15.417445 (+ 1688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:40:15.417451 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:40:15.417631 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:40:15.417698 (+ 67us) client_negotiation.cc:769] Sending connection context
0807 10:40:15.417810 (+ 112us) client_negotiation.cc:240] Negotiation successful
0807 10:40:15.417982 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1926,"mutex_wait_us":10,"thread_start_us":756,"threads_started":1}
I20260807 10:40:15.418990 5588 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:40:15.407008 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.67:32991 (local address 127.0.0.1:56132)
0807 10:40:15.407980 (+ 972us) negotiation.cc:107] Waiting for socket to connect
0807 10:40:15.408017 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0807 10:40:15.408177 (+ 160us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:40:15.409551 (+ 1374us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:40:15.409561 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:40:15.409600 (+ 39us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:40:15.410018 (+ 418us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:40:15.410031 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:40:15.413051 (+ 3020us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:40:15.413055 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:40:15.415747 (+ 2692us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:40:15.415757 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:40:15.417337 (+ 1580us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:40:15.417344 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:40:15.418137 (+ 793us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:40:15.418175 (+ 38us) client_negotiation.cc:769] Sending connection context
0807 10:40:15.418279 (+ 104us) client_negotiation.cc:240] Negotiation successful
0807 10:40:15.418412 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":711,"mutex_wait_us":18,"thread_start_us":1945,"threads_started":1}
I20260807 10:40:15.419809 5592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:40:15.409351 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.65:40835 (local address 127.0.0.1:55094)
0807 10:40:15.410575 (+ 1224us) negotiation.cc:107] Waiting for socket to connect
0807 10:40:15.410593 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 10:40:15.410700 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:40:15.412481 (+ 1781us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:40:15.412485 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:40:15.412509 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:40:15.412930 (+ 421us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:40:15.412940 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:40:15.414409 (+ 1469us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:40:15.414415 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:40:15.416584 (+ 2169us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:40:15.416598 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:40:15.418843 (+ 2245us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:40:15.418850 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:40:15.419054 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:40:15.419210 (+ 156us) client_negotiation.cc:769] Sending connection context
0807 10:40:15.419289 (+ 79us) client_negotiation.cc:240] Negotiation successful
0807 10:40:15.419406 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1090,"mutex_wait_us":24,"thread_start_us":934,"threads_started":1}
I20260807 10:40:15.420013 5591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:40:15.407743 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51060 (local address 127.20.171.66:44645)
0807 10:40:15.410055 (+ 2312us) server_negotiation.cc:206] Beginning negotiation
0807 10:40:15.410062 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:40:15.410091 (+ 29us) server_negotiation.cc:407] Connection header received
0807 10:40:15.410195 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:40:15.410218 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:40:15.410456 (+ 238us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:40:15.411268 (+ 812us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:40:15.411537 (+ 269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:40:15.413192 (+ 1655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:40:15.415956 (+ 2764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:40:15.417145 (+ 1189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:40:15.419229 (+ 2084us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:40:15.419425 (+ 196us) server_negotiation.cc:1035] Waiting for connection context
0807 10:40:15.419506 (+ 81us) server_negotiation.cc:299] Negotiation successful
0807 10:40:15.419673 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2152,"thread_start_us":2037,"threads_started":1}
I20260807 10:40:15.420125 5589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:40:15.407246 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56132 (local address 127.20.171.67:32991)
0807 10:40:15.408859 (+ 1613us) server_negotiation.cc:206] Beginning negotiation
0807 10:40:15.408867 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 10:40:15.408902 (+ 35us) server_negotiation.cc:407] Connection header received
0807 10:40:15.409015 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:40:15.409024 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:40:15.409261 (+ 237us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:40:15.410040 (+ 779us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:40:15.410370 (+ 330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:40:15.412920 (+ 2550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:40:15.415896 (+ 2976us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:40:15.417111 (+ 1215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:40:15.417273 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:40:15.417528 (+ 255us) server_negotiation.cc:1035] Waiting for connection context
0807 10:40:15.419629 (+ 2101us) server_negotiation.cc:299] Negotiation successful
0807 10:40:15.419790 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1425,"thread_start_us":1264,"threads_started":1}
I20260807 10:40:15.420998 5593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:40:15.409967 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55094 (local address 127.20.171.65:40835)
0807 10:40:15.411893 (+ 1926us) server_negotiation.cc:206] Beginning negotiation
0807 10:40:15.411898 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:40:15.411918 (+ 20us) server_negotiation.cc:407] Connection header received
0807 10:40:15.412023 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:40:15.412033 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:40:15.412287 (+ 254us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:40:15.412493 (+ 206us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:40:15.413117 (+ 624us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:40:15.414282 (+ 1165us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:40:15.416761 (+ 2479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:40:15.418309 (+ 1548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:40:15.418453 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:40:15.418674 (+ 221us) server_negotiation.cc:1035] Waiting for connection context
0807 10:40:15.420360 (+ 1686us) server_negotiation.cc:299] Negotiation successful
0807 10:40:15.420536 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1769,"thread_start_us":1642,"threads_started":1}
I20260807 10:40:15.423440 5377 tablet_service.cc:1467] Processing CreateTablet for tablet da99764375bc476798c1f10b093473fa (DEFAULT_TABLE table=test-table [id=20eddbc8913a479abf8761e2c2d40af5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:40:15.423782 5240 tablet_service.cc:1467] Processing CreateTablet for tablet da99764375bc476798c1f10b093473fa (DEFAULT_TABLE table=test-table [id=20eddbc8913a479abf8761e2c2d40af5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:40:15.424817 5377 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet da99764375bc476798c1f10b093473fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:40:15.425230 5240 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet da99764375bc476798c1f10b093473fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:40:15.426553 5512 tablet_service.cc:1467] Processing CreateTablet for tablet da99764375bc476798c1f10b093473fa (DEFAULT_TABLE table=test-table [id=20eddbc8913a479abf8761e2c2d40af5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:40:15.427848 5512 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet da99764375bc476798c1f10b093473fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:40:15.437986 5594 tablet_bootstrap.cc:492] T da99764375bc476798c1f10b093473fa P c39cf82dec1e4b8eb3c756f619b896f6: Bootstrap starting.
I20260807 10:40:15.440481 5595 tablet_bootstrap.cc:492] T da99764375bc476798c1f10b093473fa P 497ad307b555407f8ed1c7b48256fe79: Bootstrap starting.
I20260807 10:40:15.442022 5594 tablet_bootstrap.cc:654] T da99764375bc476798c1f10b093473fa P c39cf82dec1e4b8eb3c756f619b896f6: Neither blocks nor log segments found. Creating new log.
I20260807 10:40:15.442543 5596 tablet_bootstrap.cc:492] T da99764375bc476798c1f10b093473fa P 8c1a9160f3ff4ab29e1f11faa34ad73a: Bootstrap starting.
I20260807 10:40:15.443517 5594 log.cc:824] T da99764375bc476798c1f10b093473fa P c39cf82dec1e4b8eb3c756f619b896f6: Log is configured to *not* fsync() on all Append() calls
I20260807 10:40:15.444028 5595 tablet_bootstrap.cc:654] T da99764375bc476798c1f10b093473fa P 497ad307b555407f8ed1c7b48256fe79: Neither blocks nor log segments found. Creating new log.
I20260807 10:40:15.445410 5595 log.cc:824] T da99764375bc476798c1f10b093473fa P 497ad307b555407f8ed1c7b48256fe79: Log is configured to *not* fsync() on all Append() calls
I20260807 10:40:15.446193 5596 tablet_bootstrap.cc:654] T da99764375bc476798c1f10b093473fa P 8c1a9160f3ff4ab29e1f11faa34ad73a: Neither blocks nor log segments found. Creating new log.
I20260807 10:40:15.447429 5596 log.cc:824] T da99764375bc476798c1f10b093473fa P 8c1a9160f3ff4ab29e1f11faa34ad73a: Log is configured to *not* fsync() on all Append() calls
I20260807 10:40:15.447707 5594 tablet_bootstrap.cc:492] T da99764375bc476798c1f10b093473fa P c39cf82dec1e4b8eb3c756f619b896f6: No bootstrap required, opened a new log
I20260807 10:40:15.448007 5594 ts_tablet_manager.cc:1397] T da99764375bc476798c1f10b093473fa P c39cf82dec1e4b8eb3c756f619b896f6: Time spent bootstrapping tablet: real 0.011s user 0.001s sys 0.006s
I20260807 10:40:15.448482 5595 tablet_bootstrap.cc:492] T da99764375bc476798c1f10b093473fa P 497ad307b555407f8ed1c7b48256fe79: No bootstrap required, opened a new log
I20260807 10:40:15.448743 5595 ts_tablet_manager.cc:1397] T da99764375bc476798c1f10b093473fa P 497ad307b555407f8ed1c7b48256fe79: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.002s
I20260807 10:40:15.450431 5596 tablet_bootstrap.cc:492] T da99764375bc476798c1f10b093473fa P 8c1a9160f3ff4ab29e1f11faa34ad73a: No bootstrap required, opened a new log
I20260807 10:40:15.450690 5596 ts_tablet_manager.cc:1397] T da99764375bc476798c1f10b093473fa P 8c1a9160f3ff4ab29e1f11faa34ad73a: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20260807 10:40:15.456032 5595 raft_consensus.cc:348] T da99764375bc476798c1f10b093473fa P 497ad307b555407f8ed1c7b48256fe79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c1a9160f3ff4ab29e1f11faa34ad73a" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 32991 } } peers { permanent_uuid: "c39cf82dec1e4b8eb3c756f619b896f6" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 44645 } } peers { permanent_uuid: "497ad307b555407f8ed1c7b48256fe79" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 40835 } }
I20260807 10:40:15.456485 5595 raft_consensus.cc:374] T da99764375bc476798c1f10b093473fa P 497ad307b555407f8ed1c7b48256fe79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:40:15.456617 5595 raft_consensus.cc:729] T da99764375bc476798c1f10b093473fa P 497ad307b555407f8ed1c7b48256fe79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 497ad307b555407f8ed1c7b48256fe79, State: Initialized, Role: FOLLOWER
I20260807 10:40:15.457278 5595 consensus_queue.cc:260] T da99764375bc476798c1f10b093473fa P 497ad307b555407f8ed1c7b48256fe79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c1a9160f3ff4ab29e1f11faa34ad73a" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 32991 } } peers { permanent_uuid: "c39cf82dec1e4b8eb3c756f619b896f6" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 44645 } } peers { permanent_uuid: "497ad307b555407f8ed1c7b48256fe79" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 40835 } }
I20260807 10:40:15.459033 5594 raft_consensus.cc:348] T da99764375bc476798c1f10b093473fa P c39cf82dec1e4b8eb3c756f619b896f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c1a9160f3ff4ab29e1f11faa34ad73a" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 32991 } } peers { permanent_uuid: "c39cf82dec1e4b8eb3c756f619b896f6" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 44645 } } peers { permanent_uuid: "497ad307b555407f8ed1c7b48256fe79" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 40835 } }
I20260807 10:40:15.459355 5595 ts_tablet_manager.cc:1428] T da99764375bc476798c1f10b093473fa P 497ad307b555407f8ed1c7b48256fe79: Time spent starting tablet: real 0.010s user 0.009s sys 0.002s
I20260807 10:40:15.459438 5594 raft_consensus.cc:374] T da99764375bc476798c1f10b093473fa P c39cf82dec1e4b8eb3c756f619b896f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:40:15.459529 5594 raft_consensus.cc:729] T da99764375bc476798c1f10b093473fa P c39cf82dec1e4b8eb3c756f619b896f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c39cf82dec1e4b8eb3c756f619b896f6, State: Initialized, Role: FOLLOWER
I20260807 10:40:15.460099 5594 consensus_queue.cc:260] T da99764375bc476798c1f10b093473fa P c39cf82dec1e4b8eb3c756f619b896f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c1a9160f3ff4ab29e1f11faa34ad73a" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 32991 } } peers { permanent_uuid: "c39cf82dec1e4b8eb3c756f619b896f6" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 44645 } } peers { permanent_uuid: "497ad307b555407f8ed1c7b48256fe79" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 40835 } }
I20260807 10:40:15.461225 5444 heartbeater.cc:503] Master 127.20.171.126:44373 was elected leader, sending a full tablet report...
I20260807 10:40:15.461519 5596 raft_consensus.cc:348] T da99764375bc476798c1f10b093473fa P 8c1a9160f3ff4ab29e1f11faa34ad73a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c1a9160f3ff4ab29e1f11faa34ad73a" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 32991 } } peers { permanent_uuid: "c39cf82dec1e4b8eb3c756f619b896f6" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 44645 } } peers { permanent_uuid: "497ad307b555407f8ed1c7b48256fe79" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 40835 } }
I20260807 10:40:15.461931 5596 raft_consensus.cc:374] T da99764375bc476798c1f10b093473fa P 8c1a9160f3ff4ab29e1f11faa34ad73a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:40:15.462037 5596 raft_consensus.cc:729] T da99764375bc476798c1f10b093473fa P 8c1a9160f3ff4ab29e1f11faa34ad73a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c1a9160f3ff4ab29e1f11faa34ad73a, State: Initialized, Role: FOLLOWER
I20260807 10:40:15.462723 5596 consensus_queue.cc:260] T da99764375bc476798c1f10b093473fa P 8c1a9160f3ff4ab29e1f11faa34ad73a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c1a9160f3ff4ab29e1f11faa34ad73a" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 32991 } } peers { permanent_uuid: "c39cf82dec1e4b8eb3c756f619b896f6" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 44645 } } peers { permanent_uuid: "497ad307b555407f8ed1c7b48256fe79" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 40835 } }
I20260807 10:40:15.463086 5594 ts_tablet_manager.cc:1428] T da99764375bc476798c1f10b093473fa P c39cf82dec1e4b8eb3c756f619b896f6: Time spent starting tablet: real 0.015s user 0.007s sys 0.009s
I20260807 10:40:15.464066 5577 heartbeater.cc:503] Master 127.20.171.126:44373 was elected leader, sending a full tablet report...
I20260807 10:40:15.464766 5596 ts_tablet_manager.cc:1428] T da99764375bc476798c1f10b093473fa P 8c1a9160f3ff4ab29e1f11faa34ad73a: Time spent starting tablet: real 0.014s user 0.014s sys 0.001s
W20260807 10:40:15.577873 5578 tablet.cc:2369] T da99764375bc476798c1f10b093473fa P 8c1a9160f3ff4ab29e1f11faa34ad73a: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 10:40:15.621148 5445 tablet.cc:2369] T da99764375bc476798c1f10b093473fa P c39cf82dec1e4b8eb3c756f619b896f6: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 10:40:15.629822 5601 raft_consensus.cc:482] T da99764375bc476798c1f10b093473fa P c39cf82dec1e4b8eb3c756f619b896f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 10:40:15.630118 5601 raft_consensus.cc:504] T da99764375bc476798c1f10b093473fa P c39cf82dec1e4b8eb3c756f619b896f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c1a9160f3ff4ab29e1f11faa34ad73a" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 32991 } } peers { permanent_uuid: "c39cf82dec1e4b8eb3c756f619b896f6" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 44645 } } peers { permanent_uuid: "497ad307b555407f8ed1c7b48256fe79" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 40835 } }
I20260807 10:40:15.631817 5601 leader_election.cc:288] T da99764375bc476798c1f10b093473fa P c39cf82dec1e4b8eb3c756f619b896f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8c1a9160f3ff4ab29e1f11faa34ad73a (127.20.171.67:32991), 497ad307b555407f8ed1c7b48256fe79 (127.20.171.65:40835)
W20260807 10:40:15.632053 5309 tablet.cc:2369] T da99764375bc476798c1f10b093473fa P 497ad307b555407f8ed1c7b48256fe79: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 10:40:15.639142 5603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:40:15.632048 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.67:32991 (local address 127.20.171.66:46577)
0807 10:40:15.632803 (+ 755us) negotiation.cc:107] Waiting for socket to connect
0807 10:40:15.632825 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0807 10:40:15.633050 (+ 225us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:40:15.633457 (+ 407us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:40:15.633462 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:40:15.633489 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:40:15.633874 (+ 385us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:40:15.633887 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:40:15.635177 (+ 1290us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:40:15.635183 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:40:15.637002 (+ 1819us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:40:15.637015 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:40:15.638367 (+ 1352us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:40:15.638373 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:40:15.638556 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:40:15.638593 (+ 37us) client_negotiation.cc:769] Sending connection context
0807 10:40:15.638703 (+ 110us) client_negotiation.cc:240] Negotiation successful
0807 10:40:15.638842 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":597,"thread_start_us":392,"threads_started":1}
I20260807 10:40:15.639192 5589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:40:15.632156 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.66:46577 (local address 127.20.171.67:32991)
0807 10:40:15.632446 (+ 290us) server_negotiation.cc:206] Beginning negotiation
0807 10:40:15.632455 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 10:40:15.632925 (+ 470us) server_negotiation.cc:407] Connection header received
0807 10:40:15.633208 (+ 283us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:40:15.633215 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:40:15.633296 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:40:15.633386 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:40:15.634065 (+ 679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:40:15.635042 (+ 977us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:40:15.637176 (+ 2134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:40:15.638146 (+ 970us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:40:15.638266 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:40:15.638320 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0807 10:40:15.638769 (+ 449us) server_negotiation.cc:299] Negotiation successful
0807 10:40:15.638905 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":112}
I20260807 10:40:15.639606 5604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:40:15.632852 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.65:40835 (local address 127.20.171.66:42075)
0807 10:40:15.633644 (+ 792us) negotiation.cc:107] Waiting for socket to connect
0807 10:40:15.633661 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 10:40:15.633770 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:40:15.634084 (+ 314us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:40:15.634088 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:40:15.634112 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:40:15.634544 (+ 432us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:40:15.634556 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:40:15.635764 (+ 1208us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:40:15.635767 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:40:15.637531 (+ 1764us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:40:15.637546 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:40:15.638853 (+ 1307us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:40:15.638859 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:40:15.639052 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:40:15.639084 (+ 32us) client_negotiation.cc:769] Sending connection context
0807 10:40:15.639193 (+ 109us) client_negotiation.cc:240] Negotiation successful
0807 10:40:15.639336 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":664,"thread_start_us":480,"threads_started":1}
I20260807 10:40:15.639622 5593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:40:15.633103 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.66:42075 (local address 127.20.171.65:40835)
0807 10:40:15.633351 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0807 10:40:15.633358 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:40:15.633754 (+ 396us) server_negotiation.cc:407] Connection header received
0807 10:40:15.633877 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:40:15.633882 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:40:15.633966 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:40:15.634055 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:40:15.634689 (+ 634us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:40:15.635635 (+ 946us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:40:15.637690 (+ 2055us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:40:15.638638 (+ 948us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:40:15.638800 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:40:15.638867 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0807 10:40:15.639235 (+ 368us) server_negotiation.cc:299] Negotiation successful
0807 10:40:15.639400 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
I20260807 10:40:15.640599 5532 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "da99764375bc476798c1f10b093473fa" candidate_uuid: "c39cf82dec1e4b8eb3c756f619b896f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c1a9160f3ff4ab29e1f11faa34ad73a" is_pre_election: true
I20260807 10:40:15.640662 5260 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "da99764375bc476798c1f10b093473fa" candidate_uuid: "c39cf82dec1e4b8eb3c756f619b896f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "497ad307b555407f8ed1c7b48256fe79" is_pre_election: true
I20260807 10:40:15.641136 5532 raft_consensus.cc:2454] T da99764375bc476798c1f10b093473fa P 8c1a9160f3ff4ab29e1f11faa34ad73a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c39cf82dec1e4b8eb3c756f619b896f6 in term 0.
I20260807 10:40:15.641191 5260 raft_consensus.cc:2454] T da99764375bc476798c1f10b093473fa P 497ad307b555407f8ed1c7b48256fe79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c39cf82dec1e4b8eb3c756f619b896f6 in term 0.
I20260807 10:40:15.641914 5330 leader_election.cc:302] T da99764375bc476798c1f10b093473fa P c39cf82dec1e4b8eb3c756f619b896f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c1a9160f3ff4ab29e1f11faa34ad73a, c39cf82dec1e4b8eb3c756f619b896f6; no voters:
I20260807 10:40:15.642305 5601 raft_consensus.cc:2781] T da99764375bc476798c1f10b093473fa P c39cf82dec1e4b8eb3c756f619b896f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 10:40:15.642463 5601 raft_consensus.cc:482] T da99764375bc476798c1f10b093473fa P c39cf82dec1e4b8eb3c756f619b896f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 10:40:15.642581 5601 raft_consensus.cc:3037] T da99764375bc476798c1f10b093473fa P c39cf82dec1e4b8eb3c756f619b896f6 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:40:15.645231 5601 raft_consensus.cc:504] T da99764375bc476798c1f10b093473fa P c39cf82dec1e4b8eb3c756f619b896f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c1a9160f3ff4ab29e1f11faa34ad73a" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 32991 } } peers { permanent_uuid: "c39cf82dec1e4b8eb3c756f619b896f6" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 44645 } } peers { permanent_uuid: "497ad307b555407f8ed1c7b48256fe79" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 40835 } }
I20260807 10:40:15.645861 5601 leader_election.cc:288] T da99764375bc476798c1f10b093473fa P c39cf82dec1e4b8eb3c756f619b896f6 [CANDIDATE]: Term 1 election: Requested vote from peers 8c1a9160f3ff4ab29e1f11faa34ad73a (127.20.171.67:32991), 497ad307b555407f8ed1c7b48256fe79 (127.20.171.65:40835)
I20260807 10:40:15.646265 5532 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "da99764375bc476798c1f10b093473fa" candidate_uuid: "c39cf82dec1e4b8eb3c756f619b896f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c1a9160f3ff4ab29e1f11faa34ad73a"
I20260807 10:40:15.646338 5260 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "da99764375bc476798c1f10b093473fa" candidate_uuid: "c39cf82dec1e4b8eb3c756f619b896f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "497ad307b555407f8ed1c7b48256fe79"
I20260807 10:40:15.646456 5532 raft_consensus.cc:3037] T da99764375bc476798c1f10b093473fa P 8c1a9160f3ff4ab29e1f11faa34ad73a [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:40:15.646590 5260 raft_consensus.cc:3037] T da99764375bc476798c1f10b093473fa P 497ad307b555407f8ed1c7b48256fe79 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:40:15.648818 5532 raft_consensus.cc:2454] T da99764375bc476798c1f10b093473fa P 8c1a9160f3ff4ab29e1f11faa34ad73a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c39cf82dec1e4b8eb3c756f619b896f6 in term 1.
I20260807 10:40:15.648943 5260 raft_consensus.cc:2454] T da99764375bc476798c1f10b093473fa P 497ad307b555407f8ed1c7b48256fe79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c39cf82dec1e4b8eb3c756f619b896f6 in term 1.
I20260807 10:40:15.649237 5330 leader_election.cc:302] T da99764375bc476798c1f10b093473fa P c39cf82dec1e4b8eb3c756f619b896f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c1a9160f3ff4ab29e1f11faa34ad73a, c39cf82dec1e4b8eb3c756f619b896f6; no voters:
I20260807 10:40:15.649541 5601 raft_consensus.cc:2781] T da99764375bc476798c1f10b093473fa P c39cf82dec1e4b8eb3c756f619b896f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:40:15.650008 5601 raft_consensus.cc:686] T da99764375bc476798c1f10b093473fa P c39cf82dec1e4b8eb3c756f619b896f6 [term 1 LEADER]: Becoming Leader. State: Replica: c39cf82dec1e4b8eb3c756f619b896f6, State: Running, Role: LEADER
I20260807 10:40:15.650491 5601 consensus_queue.cc:237] T da99764375bc476798c1f10b093473fa P c39cf82dec1e4b8eb3c756f619b896f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c1a9160f3ff4ab29e1f11faa34ad73a" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 32991 } } peers { permanent_uuid: "c39cf82dec1e4b8eb3c756f619b896f6" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 44645 } } peers { permanent_uuid: "497ad307b555407f8ed1c7b48256fe79" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 40835 } }
I20260807 10:40:15.655297 5117 catalog_manager.cc:5495] T da99764375bc476798c1f10b093473fa P c39cf82dec1e4b8eb3c756f619b896f6 reported cstate change: term changed from 0 to 1, leader changed from <none> to c39cf82dec1e4b8eb3c756f619b896f6 (127.20.171.66). New cstate: current_term: 1 leader_uuid: "c39cf82dec1e4b8eb3c756f619b896f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c1a9160f3ff4ab29e1f11faa34ad73a" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 32991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c39cf82dec1e4b8eb3c756f619b896f6" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 44645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "497ad307b555407f8ed1c7b48256fe79" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 40835 } health_report { overall_health: UNKNOWN } } }
I20260807 10:40:15.712920 5591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:40:15.707591 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51076 (local address 127.20.171.66:44645)
0807 10:40:15.707792 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0807 10:40:15.707796 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 10:40:15.707838 (+ 42us) server_negotiation.cc:407] Connection header received
0807 10:40:15.708030 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:40:15.708034 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:40:15.708115 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:40:15.708273 (+ 158us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 10:40:15.708636 (+ 363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:40:15.709363 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:40:15.710842 (+ 1479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:40:15.711239 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:40:15.711330 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:40:15.711829 (+ 499us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 10:40:15.712380 (+ 551us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 10:40:15.712486 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0807 10:40:15.712630 (+ 144us) server_negotiation.cc:299] Negotiation successful
0807 10:40:15.712709 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260807 10:40:15.720968 5260 raft_consensus.cc:1261] T da99764375bc476798c1f10b093473fa P 497ad307b555407f8ed1c7b48256fe79 [term 1 FOLLOWER]: Refusing update from remote peer c39cf82dec1e4b8eb3c756f619b896f6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 10:40:15.721000 5532 raft_consensus.cc:1261] T da99764375bc476798c1f10b093473fa P 8c1a9160f3ff4ab29e1f11faa34ad73a [term 1 FOLLOWER]: Refusing update from remote peer c39cf82dec1e4b8eb3c756f619b896f6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 10:40:15.721961 5605 consensus_queue.cc:1035] T da99764375bc476798c1f10b093473fa P c39cf82dec1e4b8eb3c756f619b896f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c1a9160f3ff4ab29e1f11faa34ad73a" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 32991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 10:40:15.722361 5601 consensus_queue.cc:1035] T da99764375bc476798c1f10b093473fa P c39cf82dec1e4b8eb3c756f619b896f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "497ad307b555407f8ed1c7b48256fe79" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 40835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 10:40:15.742779 5609 mvcc.cc:205] Tried to move back new op lower bound from 7315862387583279104 to 7315862387308302336. Current Snapshot: MvccSnapshot[applied={T|T < 7315862387583279104}]
I20260807 10:40:15.746074 5117 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59148:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 10:40:15.746429 5117 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59148:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 10:40:15.750921 5117 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3338383b9f1e48f99d0d1a2579e10d22: Sending DeleteTablet for 3 replicas of tablet da99764375bc476798c1f10b093473fa
I20260807 10:40:15.752245 5377 tablet_service.cc:1514] Processing DeleteTablet for tablet da99764375bc476798c1f10b093473fa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:40:15 UTC) from {username='kudu', principal='kudu/127.20.171.126@KRBTEST.COM'} at 127.0.0.1:51060
I20260807 10:40:15.752249 5240 tablet_service.cc:1514] Processing DeleteTablet for tablet da99764375bc476798c1f10b093473fa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:40:15 UTC) from {username='kudu', principal='kudu/127.20.171.126@KRBTEST.COM'} at 127.0.0.1:55094
I20260807 10:40:15.752365 5239 tablet_service.cc:1514] Processing DeleteTablet for tablet da99764375bc476798c1f10b093473fa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:40:15 UTC) from {username='kudu', principal='kudu/127.20.171.126@KRBTEST.COM'} at 127.0.0.1:55094
I20260807 10:40:15.753242 5617 tablet_replica.cc:330] T da99764375bc476798c1f10b093473fa P c39cf82dec1e4b8eb3c756f619b896f6: stopping tablet replica
I20260807 10:40:15.753695 5617 raft_consensus.cc:2229] T da99764375bc476798c1f10b093473fa P c39cf82dec1e4b8eb3c756f619b896f6 [term 1 LEADER]: Raft consensus shutting down.
I20260807 10:40:15.753791 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 5155
I20260807 10:40:15.754148 5618 tablet_replica.cc:330] T da99764375bc476798c1f10b093473fa P 497ad307b555407f8ed1c7b48256fe79: stopping tablet replica
I20260807 10:40:15.754416 5617 raft_consensus.cc:2258] T da99764375bc476798c1f10b093473fa P c39cf82dec1e4b8eb3c756f619b896f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:40:15.754593 5618 raft_consensus.cc:2229] T da99764375bc476798c1f10b093473fa P 497ad307b555407f8ed1c7b48256fe79 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 10:40:15.754611 5512 tablet_service.cc:1514] Processing DeleteTablet for tablet da99764375bc476798c1f10b093473fa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:40:15 UTC) from {username='kudu', principal='kudu/127.20.171.126@KRBTEST.COM'} at 127.0.0.1:56132
I20260807 10:40:15.755055 5618 raft_consensus.cc:2258] T da99764375bc476798c1f10b093473fa P 497ad307b555407f8ed1c7b48256fe79 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:40:15.755462 5619 tablet_replica.cc:330] T da99764375bc476798c1f10b093473fa P 8c1a9160f3ff4ab29e1f11faa34ad73a: stopping tablet replica
I20260807 10:40:15.755879 5619 raft_consensus.cc:2229] T da99764375bc476798c1f10b093473fa P 8c1a9160f3ff4ab29e1f11faa34ad73a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 10:40:15.756386 5619 raft_consensus.cc:2258] T da99764375bc476798c1f10b093473fa P 8c1a9160f3ff4ab29e1f11faa34ad73a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:40:15.758543 5619 ts_tablet_manager.cc:1905] T da99764375bc476798c1f10b093473fa P 8c1a9160f3ff4ab29e1f11faa34ad73a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 10:40:15.758661 5617 ts_tablet_manager.cc:1905] T da99764375bc476798c1f10b093473fa P c39cf82dec1e4b8eb3c756f619b896f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 10:40:15.761898 5618 ts_tablet_manager.cc:1905] T da99764375bc476798c1f10b093473fa P 497ad307b555407f8ed1c7b48256fe79: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 10:40:15.765746 5619 ts_tablet_manager.cc:1918] T da99764375bc476798c1f10b093473fa P 8c1a9160f3ff4ab29e1f11faa34ad73a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 10:40:15.765911 5619 log.cc:1196] T da99764375bc476798c1f10b093473fa P 8c1a9160f3ff4ab29e1f11faa34ad73a: Deleting WAL directory at /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/ts-2/wal/wals/da99764375bc476798c1f10b093473fa
I20260807 10:40:15.766463 5619 ts_tablet_manager.cc:1939] T da99764375bc476798c1f10b093473fa P 8c1a9160f3ff4ab29e1f11faa34ad73a: Deleting consensus metadata
I20260807 10:40:15.768137 5617 ts_tablet_manager.cc:1918] T da99764375bc476798c1f10b093473fa P c39cf82dec1e4b8eb3c756f619b896f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 10:40:15.768352 5617 log.cc:1196] T da99764375bc476798c1f10b093473fa P c39cf82dec1e4b8eb3c756f619b896f6: Deleting WAL directory at /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/ts-1/wal/wals/da99764375bc476798c1f10b093473fa
I20260807 10:40:15.768646 5101 catalog_manager.cc:4841] TS 8c1a9160f3ff4ab29e1f11faa34ad73a (127.20.171.67:32991): tablet da99764375bc476798c1f10b093473fa (table test-table [id=20eddbc8913a479abf8761e2c2d40af5]) successfully deleted
I20260807 10:40:15.768905 5617 ts_tablet_manager.cc:1939] T da99764375bc476798c1f10b093473fa P c39cf82dec1e4b8eb3c756f619b896f6: Deleting consensus metadata
I20260807 10:40:15.770560 5100 catalog_manager.cc:4841] TS c39cf82dec1e4b8eb3c756f619b896f6 (127.20.171.66:44645): tablet da99764375bc476798c1f10b093473fa (table test-table [id=20eddbc8913a479abf8761e2c2d40af5]) successfully deleted
I20260807 10:40:15.775035 5618 ts_tablet_manager.cc:1918] T da99764375bc476798c1f10b093473fa P 497ad307b555407f8ed1c7b48256fe79: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 10:40:15.775249 5618 log.cc:1196] T da99764375bc476798c1f10b093473fa P 497ad307b555407f8ed1c7b48256fe79: Deleting WAL directory at /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/ts-0/wal/wals/da99764375bc476798c1f10b093473fa
I20260807 10:40:15.775832 5618 ts_tablet_manager.cc:1939] T da99764375bc476798c1f10b093473fa P 497ad307b555407f8ed1c7b48256fe79: Deleting consensus metadata
I20260807 10:40:15.777760 5101 catalog_manager.cc:4841] TS 497ad307b555407f8ed1c7b48256fe79 (127.20.171.65:40835): tablet da99764375bc476798c1f10b093473fa (table test-table [id=20eddbc8913a479abf8761e2c2d40af5]) successfully deleted
W20260807 10:40:15.778264 5101 catalog_manager.cc:4808] TS 497ad307b555407f8ed1c7b48256fe79 (127.20.171.65:40835): delete failed for tablet da99764375bc476798c1f10b093473fa because the tablet was not found. No further retry: Not found: Tablet not found: da99764375bc476798c1f10b093473fa
I20260807 10:40:15.778689 5593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:40:15.755744 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55108 (local address 127.20.171.65:40835)
0807 10:40:15.755934 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0807 10:40:15.755940 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:40:15.756212 (+ 272us) server_negotiation.cc:407] Connection header received
0807 10:40:15.756442 (+ 230us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:40:15.756448 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:40:15.756534 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:40:15.756641 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:40:15.758605 (+ 1964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:40:15.759687 (+ 1082us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:40:15.761873 (+ 2186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:40:15.762560 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:40:15.762694 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:40:15.769999 (+ 7305us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:40:15.770014 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:40:15.770031 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:40:15.770071 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:40:15.774374 (+ 4303us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:40:15.775397 (+ 1023us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:40:15.775409 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:40:15.775414 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:40:15.775594 (+ 180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:40:15.776129 (+ 535us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:40:15.776133 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:40:15.776136 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:40:15.776622 (+ 486us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:40:15.776954 (+ 332us) server_negotiation.cc:1035] Waiting for connection context
0807 10:40:15.778183 (+ 1229us) server_negotiation.cc:299] Negotiation successful
0807 10:40:15.778359 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260807 10:40:15.779424 5302 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:40:15.916533 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 5155
I20260807 10:40:15.939502 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 5312
I20260807 10:40:15.956763 5591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:40:15.940405 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51088 (local address 127.20.171.66:44645)
0807 10:40:15.940618 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0807 10:40:15.940623 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:40:15.940745 (+ 122us) server_negotiation.cc:407] Connection header received
0807 10:40:15.940931 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:40:15.940935 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:40:15.941024 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:40:15.941109 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:40:15.942971 (+ 1862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:40:15.943802 (+ 831us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:40:15.945732 (+ 1930us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:40:15.946185 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:40:15.946284 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:40:15.949961 (+ 3677us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:40:15.949974 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:40:15.949989 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:40:15.950025 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:40:15.953742 (+ 3717us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:40:15.954609 (+ 867us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:40:15.954616 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:40:15.954619 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:40:15.954792 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:40:15.955208 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:40:15.955211 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:40:15.955213 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:40:15.955560 (+ 347us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:40:15.955840 (+ 280us) server_negotiation.cc:1035] Waiting for connection context
0807 10:40:15.956150 (+ 310us) server_negotiation.cc:299] Negotiation successful
0807 10:40:15.956390 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260807 10:40:15.957535 5439 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:40:16.075369 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 5312
I20260807 10:40:16.097703 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 5447
I20260807 10:40:16.110816 5589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:40:16.098471 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56142 (local address 127.20.171.67:32991)
0807 10:40:16.098644 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0807 10:40:16.098648 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 10:40:16.098741 (+ 93us) server_negotiation.cc:407] Connection header received
0807 10:40:16.098920 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:40:16.098924 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:40:16.098988 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:40:16.099071 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:40:16.100601 (+ 1530us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:40:16.101312 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:40:16.102515 (+ 1203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:40:16.102896 (+ 381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:40:16.102982 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:40:16.105624 (+ 2642us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:40:16.105639 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:40:16.105654 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:40:16.105686 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:40:16.108350 (+ 2664us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:40:16.108978 (+ 628us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:40:16.108985 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:40:16.108988 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:40:16.109123 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:40:16.109469 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:40:16.109472 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:40:16.109474 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:40:16.109803 (+ 329us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:40:16.110033 (+ 230us) server_negotiation.cc:1035] Waiting for connection context
0807 10:40:16.110278 (+ 245us) server_negotiation.cc:299] Negotiation successful
0807 10:40:16.110453 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260807 10:40:16.111451 5572 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:40:16.201435 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 5447
I20260807 10:40:16.228433 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 5082
I20260807 10:40:16.229771 5148 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:40:16.348907 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 5082
I20260807 10:40:36.375546 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.171.126:44373
--webserver_interface=127.20.171.126
--webserver_port=38647
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.126.keytab
--principal=kudu/127.20.171.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.171.84:36941
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.171.126:44373
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:40:36.717708 5625 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:40:36.718022 5625 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:40:36.718114 5625 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:40:36.725291 5625 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260807 10:40:36.725390 5625 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260807 10:40:36.725430 5625 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260807 10:40:36.725483 5625 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 10:40:36.725538 5625 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:40:36.725610 5625 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:40:36.725670 5625 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 10:40:36.725726 5625 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 10:40:36.736526 5625 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.171.84:36941
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.20.171.126:44373
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.126.keytab
--principal=kudu/127.20.171.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.171.126:44373
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.171.126
--webserver_port=38647
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:40:36.737989 5625 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:40:36.739537 5625 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:40:36.752324 5630 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:40:36.752247 5631 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:40:36.752213 5633 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:40:36.753732 5625 server_base.cc:1034] running on GCE node
I20260807 10:40:36.754545 5625 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:40:36.755946 5625 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:40:36.757241 5625 hybrid_clock.cc:648] HybridClock initialized: now 1786099236757148 us; error 44 us; skew 500 ppm
I20260807 10:40:36.757582 5625 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:40:36 dist-test-slave-0b58 krb5kdc[4515](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099236, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:40:36.768118 5625 init.cc:377] Logged in from keytab as kudu/127.20.171.126@KRBTEST.COM (short username kudu)
I20260807 10:40:36.769774 5625 webserver.cc:460] Webserver started at http://127.20.171.126:38647/ using document root <none> and password file <none>
I20260807 10:40:36.770498 5625 fs_manager.cc:359] Metadata directory not provided
I20260807 10:40:36.770640 5625 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:40:36.776309 5625 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260807 10:40:36.779052 5640 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:40:36.780426 5625 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 10:40:36.780616 5625 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/master-0/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/master-0/wal
uuid: "3338383b9f1e48f99d0d1a2579e10d22"
format_stamp: "Formatted at 2026-08-07 10:39:50 on dist-test-slave-0b58"
server_key: "bcbb2ad5895e8174f3b0b740110d88a3"
server_key_iv: "30f6d338e7bcc11da236c446c51cf3e1"
server_key_version: "encryptionkey@0"
I20260807 10:40:36.781637 5625 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:40:36.803490 5625 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:40:36.808044 5625 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:40:36.808385 5625 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:40:36.827905 5625 rpc_server.cc:307] RPC server started. Bound to: 127.20.171.126:44373
I20260807 10:40:36.827957 5695 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.171.126:44373 every 8 connection(s)
I20260807 10:40:36.829442 5625 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
I20260807 10:40:36.831053 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 5625
I20260807 10:40:36.832129 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.171.65:40835
--local_ip_for_outbound_sockets=127.20.171.65
--tserver_master_addrs=127.20.171.126:44373
--webserver_port=32977
--webserver_interface=127.20.171.65
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.65.keytab
--principal=kudu/127.20.171.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.171.84:36941
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 10:40:36.839148 5696 sys_catalog.cc:263] Verifying existing consensus state
I20260807 10:40:36.844323 5696 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3338383b9f1e48f99d0d1a2579e10d22: Bootstrap starting.
I20260807 10:40:36.866043 5696 log.cc:824] T 00000000000000000000000000000000 P 3338383b9f1e48f99d0d1a2579e10d22: Log is configured to *not* fsync() on all Append() calls
I20260807 10:40:36.881980 5696 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3338383b9f1e48f99d0d1a2579e10d22: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 10:40:36.882529 5696 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3338383b9f1e48f99d0d1a2579e10d22: Bootstrap complete.
I20260807 10:40:36.892132 5696 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3338383b9f1e48f99d0d1a2579e10d22 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3338383b9f1e48f99d0d1a2579e10d22" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 44373 } }
I20260807 10:40:36.893054 5696 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3338383b9f1e48f99d0d1a2579e10d22 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3338383b9f1e48f99d0d1a2579e10d22, State: Initialized, Role: FOLLOWER
I20260807 10:40:36.893679 5696 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3338383b9f1e48f99d0d1a2579e10d22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3338383b9f1e48f99d0d1a2579e10d22" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 44373 } }
I20260807 10:40:36.893910 5696 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3338383b9f1e48f99d0d1a2579e10d22 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 10:40:36.894024 5696 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3338383b9f1e48f99d0d1a2579e10d22 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 10:40:36.894219 5696 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3338383b9f1e48f99d0d1a2579e10d22 [term 2 FOLLOWER]: Advancing to term 3
I20260807 10:40:36.897961 5696 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3338383b9f1e48f99d0d1a2579e10d22 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3338383b9f1e48f99d0d1a2579e10d22" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 44373 } }
I20260807 10:40:36.898447 5696 leader_election.cc:302] T 00000000000000000000000000000000 P 3338383b9f1e48f99d0d1a2579e10d22 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3338383b9f1e48f99d0d1a2579e10d22; no voters:
I20260807 10:40:36.899178 5696 leader_election.cc:288] T 00000000000000000000000000000000 P 3338383b9f1e48f99d0d1a2579e10d22 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260807 10:40:36.899305 5700 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3338383b9f1e48f99d0d1a2579e10d22 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 10:40:36.900647 5700 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3338383b9f1e48f99d0d1a2579e10d22 [term 3 LEADER]: Becoming Leader. State: Replica: 3338383b9f1e48f99d0d1a2579e10d22, State: Running, Role: LEADER
I20260807 10:40:36.901247 5700 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3338383b9f1e48f99d0d1a2579e10d22 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3338383b9f1e48f99d0d1a2579e10d22" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 44373 } }
I20260807 10:40:36.901479 5696 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3338383b9f1e48f99d0d1a2579e10d22 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 10:40:36.903594 5702 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3338383b9f1e48f99d0d1a2579e10d22 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3338383b9f1e48f99d0d1a2579e10d22. Latest consensus state: current_term: 3 leader_uuid: "3338383b9f1e48f99d0d1a2579e10d22" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3338383b9f1e48f99d0d1a2579e10d22" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 44373 } } }
I20260807 10:40:36.903963 5702 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3338383b9f1e48f99d0d1a2579e10d22 [sys.catalog]: This master's current role is: LEADER
I20260807 10:40:36.904505 5701 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3338383b9f1e48f99d0d1a2579e10d22 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "3338383b9f1e48f99d0d1a2579e10d22" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3338383b9f1e48f99d0d1a2579e10d22" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 44373 } } }
I20260807 10:40:36.904814 5701 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3338383b9f1e48f99d0d1a2579e10d22 [sys.catalog]: This master's current role is: LEADER
I20260807 10:40:36.910120 5706 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 10:40:36.921080 5706 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 10:40:36.923101 5706 catalog_manager.cc:1259] Loaded cluster ID: 1914920cfa7240e7b1e07df6302271ff
I20260807 10:40:36.923286 5706 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 10:40:36.928666 5706 catalog_manager.cc:1504] Loading token signing keys...
I20260807 10:40:36.931056 5706 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 3338383b9f1e48f99d0d1a2579e10d22: Loaded TSK: 0
I20260807 10:40:36.931321 5706 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 3338383b9f1e48f99d0d1a2579e10d22: Loaded TSK: 1
F20260807 10:40:36.932837 5706 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7fb5335dd9ad google::LogMessage::Fail() at ??:0
@ 0x7fb5335e088a google::LogMessage::SendToLog() at ??:0
@ 0x7fb5335dd4de google::LogMessage::Flush() at ??:0
@ 0x7fb5335dea19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7fb5373417d2 kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7fb53733073e kudu::security::TokenSigner::ImportKeys() at ??:0
@ 0x7fb5490101c0 kudu::master::CatalogManager::LoadTskEntries() at ??:0
@ 0x7fb54900f783 kudu::master::CatalogManager::InitTokenSigner() at ??:0
@ 0x7fb54909b2a7 kudu::master::CatalogManager::PrepareForLeadershipTask()::$_10::operator()() at ??:0
@ 0x7fb54909b0c4 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x7fb5490e55e9 std::function<>::operator()() at ??:0
@ 0x7fb549013cdd kudu::master::CatalogManager::PrepareForLeadershipTask()::$_6::operator()() at ??:0
@ 0x7fb549011c36 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7fb549099610 kudu::master::CatalogManager::ElectedAsLeaderCb()::$_2::operator()() at ??:0
@ 0x7fb549099439 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7fb536229345 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7fb53622c91c kudu::ThreadPool::CreateThread()::$_2::operator()() at ??:0
@ 0x7fb53622c799 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7fb536207eaf kudu::Thread::SuperviseThread() at ??:0
@ 0x7fb5394e16db start_thread at ??:0
@ 0x7fb53247761f clone at ??:0
W20260807 10:40:37.226156 5698 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:40:37.226483 5698 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:40:37.226658 5698 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:40:37.233994 5698 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:40:37.234157 5698 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:40:37.234324 5698 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.171.65
I20260807 10:40:37.244110 5698 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.171.84:36941
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.65.keytab
--principal=kudu/127.20.171.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.171.65:40835
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.171.65
--webserver_port=32977
--tserver_master_addrs=127.20.171.126:44373
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.171.65
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:40:37.245441 5698 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:40:37.246774 5698 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:40:37.260267 5744 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:40:37.260223 5747 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:40:37.260311 5745 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:40:37.261121 5698 server_base.cc:1034] running on GCE node
I20260807 10:40:37.261750 5698 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:40:37.262828 5698 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:40:37.264029 5698 hybrid_clock.cc:648] HybridClock initialized: now 1786099237263983 us; error 42 us; skew 500 ppm
I20260807 10:40:37.264441 5698 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:40:37 dist-test-slave-0b58 krb5kdc[4515](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099237, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:40:37.267588 5698 init.cc:377] Logged in from keytab as kudu/127.20.171.65@KRBTEST.COM (short username kudu)
I20260807 10:40:37.269084 5698 webserver.cc:460] Webserver started at http://127.20.171.65:32977/ using document root <none> and password file <none>
I20260807 10:40:37.269836 5698 fs_manager.cc:359] Metadata directory not provided
I20260807 10:40:37.269989 5698 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:40:37.275378 5698 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.004s
I20260807 10:40:37.278102 5755 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:40:37.279327 5698 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260807 10:40:37.279503 5698 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/ts-0/wal
uuid: "497ad307b555407f8ed1c7b48256fe79"
format_stamp: "Formatted at 2026-08-07 10:39:51 on dist-test-slave-0b58"
server_key: "8dee52968cbfeedc9beb0888eaab2de6"
server_key_iv: "0baa5d515e7ae209c016724f50842663"
server_key_version: "encryptionkey@0"
I20260807 10:40:37.280586 5698 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:40:37.304945 5698 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:40:37.309065 5698 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:40:37.309350 5698 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:40:37.310408 5698 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:40:37.311820 5698 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:40:37.311944 5698 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:40:37.312080 5698 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:40:37.312172 5698 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:40:37.346285 5698 rpc_server.cc:307] RPC server started. Bound to: 127.20.171.65:40835
I20260807 10:40:37.346400 5874 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.171.65:40835 every 8 connection(s)
I20260807 10:40:37.347777 5698 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/ts-0/data/info.pb
I20260807 10:40:37.353057 5877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:40:37.350873 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:44373 (local address 127.20.171.65:45359)
0807 10:40:37.351632 (+ 759us) negotiation.cc:107] Waiting for socket to connect
0807 10:40:37.352017 (+ 385us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.126:44373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":488,"thread_start_us":268,"threads_started":1}
W20260807 10:40:37.353897 5875 heartbeater.cc:644] Failed to heartbeat to 127.20.171.126:44373 (0 consecutive failures): Network error: Failed to ping master at 127.20.171.126:44373: Client connection negotiation failed: client connection to 127.20.171.126:44373: connect: Connection refused (error 111)
I20260807 10:40:37.354871 5877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:40:37.354471 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:44373 (local address 127.20.171.65:35681)
0807 10:40:37.354621 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0807 10:40:37.354724 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.126:44373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260807 10:40:37.355698 5877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:40:37.355396 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:44373 (local address 127.20.171.65:38675)
0807 10:40:37.355518 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0807 10:40:37.355591 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.126:44373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260807 10:40:37.356030 5875 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260807 10:40:37.356989 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 5698
I20260807 10:40:37.357654 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.171.66:44645
--local_ip_for_outbound_sockets=127.20.171.66
--tserver_master_addrs=127.20.171.126:44373
--webserver_port=33451
--webserver_interface=127.20.171.66
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.66.keytab
--principal=kudu/127.20.171.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.171.84:36941
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:40:37.700213 5878 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:40:37.700519 5878 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:40:37.700714 5878 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:40:37.707865 5878 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:40:37.707973 5878 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:40:37.708143 5878 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.171.66
I20260807 10:40:37.718176 5878 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.171.84:36941
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.66.keytab
--principal=kudu/127.20.171.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.171.66:44645
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.171.66
--webserver_port=33451
--tserver_master_addrs=127.20.171.126:44373
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.171.66
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:40:37.719527 5878 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:40:37.720844 5878 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:40:37.734395 5885 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:40:37.734493 5888 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:40:37.734516 5886 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:40:37.735272 5878 server_base.cc:1034] running on GCE node
I20260807 10:40:37.735858 5878 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:40:37.736871 5878 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:40:37.738099 5878 hybrid_clock.cc:648] HybridClock initialized: now 1786099237738057 us; error 55 us; skew 500 ppm
I20260807 10:40:37.738433 5878 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:40:37 dist-test-slave-0b58 krb5kdc[4515](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099237, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:40:37.741670 5878 init.cc:377] Logged in from keytab as kudu/127.20.171.66@KRBTEST.COM (short username kudu)
I20260807 10:40:37.743075 5878 webserver.cc:460] Webserver started at http://127.20.171.66:33451/ using document root <none> and password file <none>
I20260807 10:40:37.743775 5878 fs_manager.cc:359] Metadata directory not provided
I20260807 10:40:37.743922 5878 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:40:37.749328 5878 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.001s
I20260807 10:40:37.751911 5895 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:40:37.753206 5878 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260807 10:40:37.753391 5878 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/ts-1/wal
uuid: "c39cf82dec1e4b8eb3c756f619b896f6"
format_stamp: "Formatted at 2026-08-07 10:39:51 on dist-test-slave-0b58"
server_key: "b861a30f41e48b30e6da31e0a09f9399"
server_key_iv: "0c30bb09e6851267d19c78277053b0e5"
server_key_version: "encryptionkey@0"
I20260807 10:40:37.754416 5878 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:40:37.775483 5878 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:40:37.779637 5878 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:40:37.779919 5878 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:40:37.780941 5878 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:40:37.782372 5878 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:40:37.782505 5878 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:40:37.782642 5878 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:40:37.782740 5878 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:40:37.817808 5878 rpc_server.cc:307] RPC server started. Bound to: 127.20.171.66:44645
I20260807 10:40:37.817900 6014 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.171.66:44645 every 8 connection(s)
I20260807 10:40:37.819303 5878 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/ts-1/data/info.pb
I20260807 10:40:37.820575 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 5878
I20260807 10:40:37.821403 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.171.67:32991
--local_ip_for_outbound_sockets=127.20.171.67
--tserver_master_addrs=127.20.171.126:44373
--webserver_port=41259
--webserver_interface=127.20.171.67
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.67.keytab
--principal=kudu/127.20.171.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.171.84:36941
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 10:40:37.824976 6017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:40:37.822917 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:44373 (local address 127.20.171.66:50669)
0807 10:40:37.823769 (+ 852us) negotiation.cc:107] Waiting for socket to connect
0807 10:40:37.824022 (+ 253us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.126:44373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":562,"thread_start_us":336,"threads_started":1}
W20260807 10:40:37.825734 6015 heartbeater.cc:644] Failed to heartbeat to 127.20.171.126:44373 (0 consecutive failures): Network error: Failed to ping master at 127.20.171.126:44373: Client connection negotiation failed: client connection to 127.20.171.126:44373: connect: Connection refused (error 111)
I20260807 10:40:37.826622 6017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:40:37.826276 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:44373 (local address 127.20.171.66:59821)
0807 10:40:37.826439 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0807 10:40:37.826519 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.126:44373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260807 10:40:37.827528 6017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:40:37.827231 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:44373 (local address 127.20.171.66:45385)
0807 10:40:37.827355 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0807 10:40:37.827425 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.126:44373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260807 10:40:37.827821 6015 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260807 10:40:38.168093 6018 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:40:38.168395 6018 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:40:38.168494 6018 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:40:38.175623 6018 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:40:38.175735 6018 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:40:38.175848 6018 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.171.67
I20260807 10:40:38.185693 6018 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.171.84:36941
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.67.keytab
--principal=kudu/127.20.171.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.171.67:32991
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.171.67
--webserver_port=41259
--tserver_master_addrs=127.20.171.126:44373
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.171.67
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:40:38.186911 6018 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:40:38.188237 6018 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:40:38.201226 6024 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:40:38.201300 6027 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:40:38.201236 6023 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:40:38.202013 6018 server_base.cc:1034] running on GCE node
I20260807 10:40:38.202656 6018 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:40:38.203596 6018 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:40:38.204790 6018 hybrid_clock.cc:648] HybridClock initialized: now 1786099238204757 us; error 43 us; skew 500 ppm
I20260807 10:40:38.205104 6018 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:40:38 dist-test-slave-0b58 krb5kdc[4515](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099238, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:40:38.208173 6018 init.cc:377] Logged in from keytab as kudu/127.20.171.67@KRBTEST.COM (short username kudu)
I20260807 10:40:38.209687 6018 webserver.cc:460] Webserver started at http://127.20.171.67:41259/ using document root <none> and password file <none>
I20260807 10:40:38.210371 6018 fs_manager.cc:359] Metadata directory not provided
I20260807 10:40:38.210520 6018 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:40:38.215770 6018 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260807 10:40:38.218451 6034 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:40:38.219739 6018 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 10:40:38.219925 6018 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/ts-2/wal
uuid: "8c1a9160f3ff4ab29e1f11faa34ad73a"
format_stamp: "Formatted at 2026-08-07 10:39:52 on dist-test-slave-0b58"
server_key: "43ba2d768895660a34d9b199d0eacd63"
server_key_iv: "483b44cd939a548398a4fc5cf5726bb4"
server_key_version: "encryptionkey@0"
I20260807 10:40:38.221002 6018 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:40:38.254211 6018 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:40:38.258153 6018 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:40:38.258453 6018 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:40:38.259590 6018 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:40:38.260969 6018 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:40:38.261102 6018 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:40:38.261237 6018 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:40:38.261338 6018 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:40:38.295580 6018 rpc_server.cc:307] RPC server started. Bound to: 127.20.171.67:32991
I20260807 10:40:38.295677 6150 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.171.67:32991 every 8 connection(s)
I20260807 10:40:38.297089 6018 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786098956060137-21165-0/minicluster-data/ts-2/data/info.pb
I20260807 10:40:38.301757 6154 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:40:38.299923 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:44373 (local address 127.20.171.67:51335)
0807 10:40:38.300705 (+ 782us) negotiation.cc:107] Waiting for socket to connect
0807 10:40:38.300938 (+ 233us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.126:44373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":529,"thread_start_us":327,"threads_started":1}
W20260807 10:40:38.302386 6152 heartbeater.cc:644] Failed to heartbeat to 127.20.171.126:44373 (0 consecutive failures): Network error: Failed to ping master at 127.20.171.126:44373: Client connection negotiation failed: client connection to 127.20.171.126:44373: connect: Connection refused (error 111)
I20260807 10:40:38.303189 6154 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:40:38.302876 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:44373 (local address 127.20.171.67:49817)
0807 10:40:38.303021 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0807 10:40:38.303093 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.126:44373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260807 10:40:38.304025 6154 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:40:38.303668 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:44373 (local address 127.20.171.67:40281)
0807 10:40:38.303836 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0807 10:40:38.303917 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.126:44373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260807 10:40:38.304311 6152 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260807 10:40:38.305193 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 6018
I20260807 10:40:38.357765 6156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:40:38.356675 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:44373 (local address 127.20.171.65:48279)
0807 10:40:38.357260 (+ 585us) negotiation.cc:107] Waiting for socket to connect
0807 10:40:38.357389 (+ 129us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.126:44373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":440,"thread_start_us":300,"threads_started":1}
I20260807 10:40:38.829391 6157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:40:38.828531 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:44373 (local address 127.20.171.66:54869)
0807 10:40:38.829023 (+ 492us) negotiation.cc:107] Waiting for socket to connect
0807 10:40:38.829133 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.126:44373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":374,"thread_start_us":242,"threads_started":1}
I20260807 10:40:39.305544 6158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:40:39.304789 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:44373 (local address 127.20.171.67:37453)
0807 10:40:39.305226 (+ 437us) negotiation.cc:107] Waiting for socket to connect
0807 10:40:39.305311 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.126:44373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":337,"thread_start_us":216,"threads_started":1}
I20260807 10:40:39.359944 6159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:40:39.358999 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:44373 (local address 127.20.171.65:38805)
0807 10:40:39.359615 (+ 616us) negotiation.cc:107] Waiting for socket to connect
0807 10:40:39.359724 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.126:44373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":487,"thread_start_us":299,"threads_started":1}
I20260807 10:40:39.831095 6160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:40:39.830358 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:44373 (local address 127.20.171.66:43371)
0807 10:40:39.830834 (+ 476us) negotiation.cc:107] Waiting for socket to connect
0807 10:40:39.830923 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.126:44373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":365,"thread_start_us":230,"threads_started":1}
I20260807 10:40:40.307351 6161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:40:40.306519 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:44373 (local address 127.20.171.67:42515)
0807 10:40:40.307051 (+ 532us) negotiation.cc:107] Waiting for socket to connect
0807 10:40:40.307175 (+ 124us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.126:44373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":430,"thread_start_us":300,"threads_started":1}
I20260807 10:40:40.361852 6162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:40:40.360961 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:44373 (local address 127.20.171.65:41845)
0807 10:40:40.361456 (+ 495us) negotiation.cc:107] Waiting for socket to connect
0807 10:40:40.361616 (+ 160us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.126:44373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":376,"thread_start_us":250,"threads_started":1}
I20260807 10:40:40.832827 6163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:40:40.832085 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:44373 (local address 127.20.171.66:33041)
0807 10:40:40.832569 (+ 484us) negotiation.cc:107] Waiting for socket to connect
0807 10:40:40.832648 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.126:44373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":387,"thread_start_us":286,"threads_started":1}
I20260807 10:40:41.308835 6164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:40:41.308117 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:44373 (local address 127.20.171.67:55553)
0807 10:40:41.308583 (+ 466us) negotiation.cc:107] Waiting for socket to connect
0807 10:40:41.308658 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.126:44373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":378,"thread_start_us":286,"threads_started":1}
I20260807 10:40:41.363673 6165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:40:41.362862 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:44373 (local address 127.20.171.65:58255)
0807 10:40:41.363378 (+ 516us) negotiation.cc:107] Waiting for socket to connect
0807 10:40:41.363462 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.126:44373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":404,"thread_start_us":288,"threads_started":1}
I20260807 10:40:41.834438 6166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:40:41.833721 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:44373 (local address 127.20.171.66:55749)
0807 10:40:41.834151 (+ 430us) negotiation.cc:107] Waiting for socket to connect
0807 10:40:41.834233 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.126:44373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":328,"thread_start_us":214,"threads_started":1}
I20260807 10:40:42.310371 6167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:40:42.309631 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:44373 (local address 127.20.171.67:34865)
0807 10:40:42.310089 (+ 458us) negotiation.cc:107] Waiting for socket to connect
0807 10:40:42.310189 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.126:44373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":362,"thread_start_us":233,"threads_started":1}
I20260807 10:40:42.365404 6168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:40:42.364621 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:44373 (local address 127.20.171.65:32979)
0807 10:40:42.365124 (+ 503us) negotiation.cc:107] Waiting for socket to connect
0807 10:40:42.365222 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.126:44373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":396,"thread_start_us":252,"threads_started":1}
I20260807 10:40:42.836122 6169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:40:42.835404 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:44373 (local address 127.20.171.66:54143)
0807 10:40:42.835877 (+ 473us) negotiation.cc:107] Waiting for socket to connect
0807 10:40:42.835958 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.126:44373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":374,"thread_start_us":241,"threads_started":1}
I20260807 10:40:43.312203 6170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:40:43.311393 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:44373 (local address 127.20.171.67:56603)
0807 10:40:43.311962 (+ 569us) negotiation.cc:107] Waiting for socket to connect
0807 10:40:43.312039 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.126:44373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":486,"thread_start_us":293,"threads_started":1}
I20260807 10:40:43.367100 6171 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:40:43.366318 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:44373 (local address 127.20.171.65:45193)
0807 10:40:43.366852 (+ 534us) negotiation.cc:107] Waiting for socket to connect
0807 10:40:43.366940 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.126:44373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":426,"thread_start_us":307,"threads_started":1}
I20260807 10:40:43.837661 6172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:40:43.836965 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:44373 (local address 127.20.171.66:60007)
0807 10:40:43.837392 (+ 427us) negotiation.cc:107] Waiting for socket to connect
0807 10:40:43.837501 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.126:44373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":332,"thread_start_us":225,"threads_started":1}
I20260807 10:40:44.313756 6173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:40:44.313060 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:44373 (local address 127.20.171.67:38403)
0807 10:40:44.313505 (+ 445us) negotiation.cc:107] Waiting for socket to connect
0807 10:40:44.313597 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.126:44373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":355,"thread_start_us":247,"threads_started":1}
I20260807 10:40:44.368862 6174 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:40:44.367985 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:44373 (local address 127.20.171.65:44987)
0807 10:40:44.368567 (+ 582us) negotiation.cc:107] Waiting for socket to connect
0807 10:40:44.368653 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.126:44373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":479,"thread_start_us":316,"threads_started":1}
I20260807 10:40:44.839396 6176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:40:44.838597 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:44373 (local address 127.20.171.66:38965)
0807 10:40:44.839092 (+ 495us) negotiation.cc:107] Waiting for socket to connect
0807 10:40:44.839176 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.126:44373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":387,"thread_start_us":222,"threads_started":1}
I20260807 10:40:45.315616 6177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:40:45.314676 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:44373 (local address 127.20.171.67:46875)
0807 10:40:45.315239 (+ 563us) negotiation.cc:107] Waiting for socket to connect
0807 10:40:45.315368 (+ 129us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.126:44373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":432,"thread_start_us":223,"threads_started":1}
I20260807 10:40:45.370743 6178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:40:45.369827 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:44373 (local address 127.20.171.65:58203)
0807 10:40:45.370391 (+ 564us) negotiation.cc:107] Waiting for socket to connect
0807 10:40:45.370519 (+ 128us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.126:44373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":435,"thread_start_us":308,"threads_started":1}
I20260807 10:40:45.841068 6179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:40:45.840249 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:44373 (local address 127.20.171.66:42967)
0807 10:40:45.840800 (+ 551us) negotiation.cc:107] Waiting for socket to connect
0807 10:40:45.840902 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.126:44373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":379,"thread_start_us":250,"threads_started":1}
I20260807 10:40:46.317376 6180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:40:46.316633 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:44373 (local address 127.20.171.67:38987)
0807 10:40:46.317063 (+ 430us) negotiation.cc:107] Waiting for socket to connect
0807 10:40:46.317163 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.126:44373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":339,"thread_start_us":228,"threads_started":1}
I20260807 10:40:46.372596 6181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:40:46.371723 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:44373 (local address 127.20.171.65:33467)
0807 10:40:46.372225 (+ 502us) negotiation.cc:107] Waiting for socket to connect
0807 10:40:46.372372 (+ 147us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.126:44373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":398,"thread_start_us":265,"threads_started":1}
I20260807 10:40:46.842702 6182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:40:46.841969 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:44373 (local address 127.20.171.66:57087)
0807 10:40:46.842443 (+ 474us) negotiation.cc:107] Waiting for socket to connect
0807 10:40:46.842524 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.126:44373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":359,"thread_start_us":226,"threads_started":1}
I20260807 10:40:47.319098 6183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:40:47.318285 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:44373 (local address 127.20.171.67:55671)
0807 10:40:47.318794 (+ 509us) negotiation.cc:107] Waiting for socket to connect
0807 10:40:47.318921 (+ 127us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.126:44373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":399,"thread_start_us":238,"threads_started":1}
I20260807 10:40:47.374363 6184 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:40:47.373633 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:44373 (local address 127.20.171.65:37931)
0807 10:40:47.374113 (+ 480us) negotiation.cc:107] Waiting for socket to connect
0807 10:40:47.374198 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.126:44373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":380,"thread_start_us":265,"threads_started":1}
I20260807 10:40:47.844364 6185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:40:47.843610 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:44373 (local address 127.20.171.66:34853)
0807 10:40:47.844084 (+ 474us) negotiation.cc:107] Waiting for socket to connect
0807 10:40:47.844169 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.126:44373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":370,"thread_start_us":265,"threads_started":1}
I20260807 10:40:48.320988 6186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:40:48.320101 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:44373 (local address 127.20.171.67:34353)
0807 10:40:48.320697 (+ 596us) negotiation.cc:107] Waiting for socket to connect
0807 10:40:48.320794 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.126:44373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":466,"thread_start_us":327,"threads_started":1}
I20260807 10:40:48.376210 6187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:40:48.375339 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:44373 (local address 127.20.171.65:34381)
0807 10:40:48.375877 (+ 538us) negotiation.cc:107] Waiting for socket to connect
0807 10:40:48.375993 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.126:44373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":416,"thread_start_us":255,"threads_started":1}
I20260807 10:40:48.846055 6188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:40:48.845328 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:44373 (local address 127.20.171.66:59535)
0807 10:40:48.845770 (+ 442us) negotiation.cc:107] Waiting for socket to connect
0807 10:40:48.845862 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.126:44373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":341,"thread_start_us":228,"threads_started":1}
I20260807 10:40:49.322480 6189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:40:49.321785 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:44373 (local address 127.20.171.67:40187)
0807 10:40:49.322229 (+ 444us) negotiation.cc:107] Waiting for socket to connect
0807 10:40:49.322310 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.126:44373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":343,"thread_start_us":234,"threads_started":1}
I20260807 10:40:49.377718 6190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:40:49.377080 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:44373 (local address 127.20.171.65:42513)
0807 10:40:49.377488 (+ 408us) negotiation.cc:107] Waiting for socket to connect
0807 10:40:49.377565 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.126:44373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":310,"thread_start_us":205,"threads_started":1}
I20260807 10:40:49.847849 6191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:40:49.847087 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:44373 (local address 127.20.171.66:59265)
0807 10:40:49.847566 (+ 479us) negotiation.cc:107] Waiting for socket to connect
0807 10:40:49.847656 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.126:44373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":347,"thread_start_us":223,"threads_started":1}
I20260807 10:40:50.324154 6192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:40:50.323422 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:44373 (local address 127.20.171.67:35315)
0807 10:40:50.323901 (+ 479us) negotiation.cc:107] Waiting for socket to connect
0807 10:40:50.323996 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.126:44373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":367,"thread_start_us":255,"threads_started":1}
I20260807 10:40:50.379524 6193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:40:50.378707 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:44373 (local address 127.20.171.65:41059)
0807 10:40:50.379220 (+ 513us) negotiation.cc:107] Waiting for socket to connect
0807 10:40:50.379318 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.126:44373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":414,"thread_start_us":243,"threads_started":1}
I20260807 10:40:50.849602 6194 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:40:50.848838 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:44373 (local address 127.20.171.66:52685)
0807 10:40:50.849311 (+ 473us) negotiation.cc:107] Waiting for socket to connect
0807 10:40:50.849409 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.126:44373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":369,"thread_start_us":227,"threads_started":1}
I20260807 10:40:51.326057 6195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:40:51.325192 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:44373 (local address 127.20.171.67:59213)
0807 10:40:51.325669 (+ 477us) negotiation.cc:107] Waiting for socket to connect
0807 10:40:51.325842 (+ 173us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.126:44373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":361,"thread_start_us":236,"threads_started":1}
I20260807 10:40:51.381232 6196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:40:51.380526 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:44373 (local address 127.20.171.65:50663)
0807 10:40:51.380966 (+ 440us) negotiation.cc:107] Waiting for socket to connect
0807 10:40:51.381049 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.126:44373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":322,"thread_start_us":212,"threads_started":1}
I20260807 10:40:51.851296 6197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:40:51.850495 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:44373 (local address 127.20.171.66:54207)
0807 10:40:51.851026 (+ 531us) negotiation.cc:107] Waiting for socket to connect
0807 10:40:51.851110 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.126:44373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":405,"thread_start_us":295,"threads_started":1}
I20260807 10:40:52.327648 6198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:40:52.326939 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:44373 (local address 127.20.171.67:54299)
0807 10:40:52.327367 (+ 428us) negotiation.cc:107] Waiting for socket to connect
0807 10:40:52.327462 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.126:44373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":332,"thread_start_us":221,"threads_started":1}
I20260807 10:40:52.383340 6199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:40:52.382345 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:44373 (local address 127.20.171.65:54731)
0807 10:40:52.382903 (+ 558us) negotiation.cc:107] Waiting for socket to connect
0807 10:40:52.383059 (+ 156us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.126:44373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":417,"thread_start_us":288,"threads_started":1}
I20260807 10:40:52.853535 6200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:40:52.852567 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:44373 (local address 127.20.171.66:47611)
0807 10:40:52.853116 (+ 549us) negotiation.cc:107] Waiting for socket to connect
0807 10:40:52.853267 (+ 151us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.126:44373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":435,"thread_start_us":289,"threads_started":1}
I20260807 10:40:53.316157 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 5698
I20260807 10:40:53.329627 6203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:40:53.328797 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:44373 (local address 127.20.171.67:51569)
0807 10:40:53.329362 (+ 565us) negotiation.cc:107] Waiting for socket to connect
0807 10:40:53.329458 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.126:44373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":449,"thread_start_us":305,"threads_started":1}
I20260807 10:40:53.335151 6201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:40:53.317331 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45382 (local address 127.20.171.65:40835)
0807 10:40:53.318121 (+ 790us) server_negotiation.cc:206] Beginning negotiation
0807 10:40:53.318143 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0807 10:40:53.318193 (+ 50us) server_negotiation.cc:407] Connection header received
0807 10:40:53.320071 (+ 1878us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:40:53.320081 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:40:53.320585 (+ 504us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:40:53.320947 (+ 362us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:40:53.322516 (+ 1569us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:40:53.323763 (+ 1247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:40:53.325165 (+ 1402us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:40:53.325868 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:40:53.326070 (+ 202us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:40:53.329099 (+ 3029us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:40:53.329107 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:40:53.329121 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:40:53.329161 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:40:53.332051 (+ 2890us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:40:53.332793 (+ 742us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:40:53.332800 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:40:53.332807 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:40:53.332977 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:40:53.333346 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:40:53.333349 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:40:53.333351 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:40:53.333841 (+ 490us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:40:53.334074 (+ 233us) server_negotiation.cc:1035] Waiting for connection context
0807 10:40:53.334468 (+ 394us) server_negotiation.cc:299] Negotiation successful
0807 10:40:53.334869 (+ 401us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":572,"thread_start_us":389,"threads_started":1}
I20260807 10:40:53.336622 5869 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:40:53.423091 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 5698
I20260807 10:40:53.444975 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 5878
I20260807 10:40:53.462500 6206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:40:53.446012 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43146 (local address 127.20.171.66:44645)
0807 10:40:53.446546 (+ 534us) server_negotiation.cc:206] Beginning negotiation
0807 10:40:53.446560 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0807 10:40:53.446597 (+ 37us) server_negotiation.cc:407] Connection header received
0807 10:40:53.448187 (+ 1590us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:40:53.448196 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:40:53.448703 (+ 507us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:40:53.449003 (+ 300us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:40:53.450361 (+ 1358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:40:53.451654 (+ 1293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:40:53.452951 (+ 1297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:40:53.453609 (+ 658us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:40:53.453736 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:40:53.456383 (+ 2647us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:40:53.456391 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:40:53.456405 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:40:53.456440 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:40:53.459441 (+ 3001us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:40:53.460057 (+ 616us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:40:53.460081 (+ 24us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:40:53.460086 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:40:53.460250 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:40:53.460665 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:40:53.460668 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:40:53.460670 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:40:53.461199 (+ 529us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:40:53.461420 (+ 221us) server_negotiation.cc:1035] Waiting for connection context
0807 10:40:53.461790 (+ 370us) server_negotiation.cc:299] Negotiation successful
0807 10:40:53.462202 (+ 412us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":365,"thread_start_us":247,"threads_started":1}
I20260807 10:40:53.463850 6010 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:40:53.548357 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 5878
I20260807 10:40:53.569382 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 6018
I20260807 10:40:53.587733 6208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:40:53.570524 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43700 (local address 127.20.171.67:32991)
0807 10:40:53.571126 (+ 602us) server_negotiation.cc:206] Beginning negotiation
0807 10:40:53.571140 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0807 10:40:53.571182 (+ 42us) server_negotiation.cc:407] Connection header received
0807 10:40:53.572975 (+ 1793us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:40:53.572985 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:40:53.573393 (+ 408us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:40:53.573755 (+ 362us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:40:53.575280 (+ 1525us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:40:53.576636 (+ 1356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:40:53.577944 (+ 1308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:40:53.578610 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:40:53.578825 (+ 215us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:40:53.581579 (+ 2754us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:40:53.581587 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:40:53.581603 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:40:53.581645 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:40:53.584365 (+ 2720us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:40:53.585072 (+ 707us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:40:53.585080 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:40:53.585091 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:40:53.585258 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:40:53.585637 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:40:53.585642 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:40:53.585647 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:40:53.586205 (+ 558us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:40:53.586513 (+ 308us) server_negotiation.cc:1035] Waiting for connection context
0807 10:40:53.587019 (+ 506us) server_negotiation.cc:299] Negotiation successful
0807 10:40:53.587428 (+ 409us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":447,"thread_start_us":280,"threads_started":1}
I20260807 10:40:53.589218 6146 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:40:53.679268 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 6018
2026-08-07T10:40:53Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (64971 ms)
[----------] 30 tests from SecurityITest (297476 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786098956060137-21165-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 10:40:53 dist-test-slave-0b58 krb5kdc[6212](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 10:40:53 dist-test-slave-0b58 krb5kdc[6212](info): set up 2 sockets
Aug 07 10:40:53 dist-test-slave-0b58 krb5kdc[6212](info): commencing operation
krb5kdc: starting...
W20260807 10:40:54.851691 21165 mini_kdc.cc:121] Time spent starting KDC: real 1.128s user 0.001s sys 0.051s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786098956060137-21165-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786098956060137-21165-0/krb5kdc/test-user.keytab.
Aug 07 10:40:55 dist-test-slave-0b58 krb5kdc[6212](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099255, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T10:40:55Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T10:40:55Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.171.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.171.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.171.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.126.keytab.
Entry for principal kudu/127.20.171.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.126.keytab.
I20260807 10:40:55.195554 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786098956060137-21165-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786098956060137-21165-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786098956060137-21165-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.171.126:36631
--webserver_interface=127.20.171.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.126.keytab
--principal=kudu/127.20.171.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.171.84:40535
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.171.126:36631
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786098956060137-21165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786098956060137-21165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786098956060137-21165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:40:55.542673 6225 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:40:55.542968 6225 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:40:55.543061 6225 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:40:55.550462 6225 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 10:40:55.550594 6225 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:40:55.550642 6225 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:40:55.550709 6225 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 10:40:55.550753 6225 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 10:40:55.560834 6225 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.171.84:40535
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786098956060137-21165-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786098956060137-21165-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.171.126:36631
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.126.keytab
--principal=kudu/127.20.171.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.171.126:36631
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.171.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786098956060137-21165-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:40:55.562144 6225 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:40:55.563419 6225 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:40:55.575307 6230 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:40:55.575265 6231 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:40:55.575477 6233 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:40:55.576310 6225 server_base.cc:1034] running on GCE node
I20260807 10:40:55.577100 6225 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:40:55.578488 6225 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:40:55.579694 6225 hybrid_clock.cc:648] HybridClock initialized: now 1786099255579659 us; error 37 us; skew 500 ppm
I20260807 10:40:55.580022 6225 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:40:55 dist-test-slave-0b58 krb5kdc[6212](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099255, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:40:55.583216 6225 init.cc:377] Logged in from keytab as kudu/127.20.171.126@KRBTEST.COM (short username kudu)
I20260807 10:40:55.584873 6225 webserver.cc:460] Webserver started at http://127.20.171.126:37573/ using document root <none> and password file <none>
I20260807 10:40:55.585604 6225 fs_manager.cc:359] Metadata directory not provided
I20260807 10:40:55.585747 6225 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:40:55.586077 6225 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:40:55.589295 6225 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786098956060137-21165-0/minicluster-data/master-0/data/instance:
uuid: "9df8677149e14e548c2dd7bc148b5bdf"
format_stamp: "Formatted at 2026-08-07 10:40:55 on dist-test-slave-0b58"
server_key: "d1e805d41ca3a865152b1d698db8c79d"
server_key_iv: "0545b5d273b221bc82abb79ca92845a2"
server_key_version: "encryptionkey@0"
I20260807 10:40:55.590088 6225 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786098956060137-21165-0/minicluster-data/master-0/wal/instance:
uuid: "9df8677149e14e548c2dd7bc148b5bdf"
format_stamp: "Formatted at 2026-08-07 10:40:55 on dist-test-slave-0b58"
server_key: "d1e805d41ca3a865152b1d698db8c79d"
server_key_iv: "0545b5d273b221bc82abb79ca92845a2"
server_key_version: "encryptionkey@0"
I20260807 10:40:55.595350 6225 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260807 10:40:55.598824 6240 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:40:55.600153 6225 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 10:40:55.600351 6225 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786098956060137-21165-0/minicluster-data/master-0/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786098956060137-21165-0/minicluster-data/master-0/wal
uuid: "9df8677149e14e548c2dd7bc148b5bdf"
format_stamp: "Formatted at 2026-08-07 10:40:55 on dist-test-slave-0b58"
server_key: "d1e805d41ca3a865152b1d698db8c79d"
server_key_iv: "0545b5d273b221bc82abb79ca92845a2"
server_key_version: "encryptionkey@0"
I20260807 10:40:55.600587 6225 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786098956060137-21165-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786098956060137-21165-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786098956060137-21165-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:40:55.623979 6225 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:40:55.628199 6225 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:40:55.628547 6225 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:40:55.648443 6225 rpc_server.cc:307] RPC server started. Bound to: 127.20.171.126:36631
I20260807 10:40:55.648486 6291 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.171.126:36631 every 8 connection(s)
I20260807 10:40:55.649837 6225 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
I20260807 10:40:55.653759 6292 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:40:55.658402 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 6225
I20260807 10:40:55.658643 21165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786098956060137-21165-0/minicluster-data/master-0/wal/instance
I20260807 10:40:55.659547 21165 external_mini_cluster.cc:1428] Setting key fbc22ffe3689824f3f013743a792edb7
I20260807 10:40:55.666018 6292 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9df8677149e14e548c2dd7bc148b5bdf: Bootstrap starting.
I20260807 10:40:55.669775 6292 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9df8677149e14e548c2dd7bc148b5bdf: Neither blocks nor log segments found. Creating new log.
I20260807 10:40:55.670994 6292 log.cc:824] T 00000000000000000000000000000000 P 9df8677149e14e548c2dd7bc148b5bdf: Log is configured to *not* fsync() on all Append() calls
I20260807 10:40:55.673812 6292 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9df8677149e14e548c2dd7bc148b5bdf: No bootstrap required, opened a new log
Aug 07 10:40:55 dist-test-slave-0b58 krb5kdc[6212](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099255, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.171.126@KRBTEST.COM
I20260807 10:40:55.683531 6292 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9df8677149e14e548c2dd7bc148b5bdf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9df8677149e14e548c2dd7bc148b5bdf" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 36631 } }
I20260807 10:40:55.683961 6292 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9df8677149e14e548c2dd7bc148b5bdf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:40:55.684098 6292 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9df8677149e14e548c2dd7bc148b5bdf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9df8677149e14e548c2dd7bc148b5bdf, State: Initialized, Role: FOLLOWER
I20260807 10:40:55.684818 6295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:40:55.661727 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57158 (local address 127.20.171.126:36631)
0807 10:40:55.662624 (+ 897us) server_negotiation.cc:206] Beginning negotiation
0807 10:40:55.662636 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 10:40:55.662682 (+ 46us) server_negotiation.cc:407] Connection header received
0807 10:40:55.664586 (+ 1904us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:40:55.664610 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:40:55.664983 (+ 373us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:40:55.665311 (+ 328us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:40:55.667365 (+ 2054us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:40:55.668788 (+ 1423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:40:55.670697 (+ 1909us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:40:55.671445 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:40:55.671669 (+ 224us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:40:55.675938 (+ 4269us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:40:55.675948 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:40:55.675966 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:40:55.676013 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:40:55.680275 (+ 4262us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:40:55.681158 (+ 883us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:40:55.681173 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:40:55.681183 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:40:55.681358 (+ 175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:40:55.681784 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:40:55.681788 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:40:55.681790 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:40:55.682334 (+ 544us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:40:55.682666 (+ 332us) server_negotiation.cc:1035] Waiting for connection context
0807 10:40:55.683145 (+ 479us) server_negotiation.cc:299] Negotiation successful
0807 10:40:55.683564 (+ 419us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":679,"thread_start_us":440,"threads_started":1}
I20260807 10:40:55.684712 6292 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9df8677149e14e548c2dd7bc148b5bdf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9df8677149e14e548c2dd7bc148b5bdf" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 36631 } }
I20260807 10:40:55.685003 6292 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9df8677149e14e548c2dd7bc148b5bdf [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 10:40:55.685199 6292 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9df8677149e14e548c2dd7bc148b5bdf [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 10:40:55.685410 6292 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9df8677149e14e548c2dd7bc148b5bdf [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:40:55.688222 6292 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9df8677149e14e548c2dd7bc148b5bdf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9df8677149e14e548c2dd7bc148b5bdf" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 36631 } }
I20260807 10:40:55.688726 6292 leader_election.cc:302] T 00000000000000000000000000000000 P 9df8677149e14e548c2dd7bc148b5bdf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9df8677149e14e548c2dd7bc148b5bdf; no voters:
I20260807 10:40:55.689283 6292 leader_election.cc:288] T 00000000000000000000000000000000 P 9df8677149e14e548c2dd7bc148b5bdf [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 10:40:55.689419 6297 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9df8677149e14e548c2dd7bc148b5bdf [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:40:55.690227 6297 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9df8677149e14e548c2dd7bc148b5bdf [term 1 LEADER]: Becoming Leader. State: Replica: 9df8677149e14e548c2dd7bc148b5bdf, State: Running, Role: LEADER
I20260807 10:40:55.690850 6297 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9df8677149e14e548c2dd7bc148b5bdf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9df8677149e14e548c2dd7bc148b5bdf" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 36631 } }
I20260807 10:40:55.691392 6292 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9df8677149e14e548c2dd7bc148b5bdf [sys.catalog]: configured and running, proceeding with master startup.
I20260807 10:40:55.694392 6298 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9df8677149e14e548c2dd7bc148b5bdf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9df8677149e14e548c2dd7bc148b5bdf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9df8677149e14e548c2dd7bc148b5bdf" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 36631 } } }
I20260807 10:40:55.694732 6298 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9df8677149e14e548c2dd7bc148b5bdf [sys.catalog]: This master's current role is: LEADER
I20260807 10:40:55.696486 6299 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9df8677149e14e548c2dd7bc148b5bdf [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9df8677149e14e548c2dd7bc148b5bdf. Latest consensus state: current_term: 1 leader_uuid: "9df8677149e14e548c2dd7bc148b5bdf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9df8677149e14e548c2dd7bc148b5bdf" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 36631 } } }
I20260807 10:40:55.696782 6299 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9df8677149e14e548c2dd7bc148b5bdf [sys.catalog]: This master's current role is: LEADER
I20260807 10:40:55.698091 6304 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 10:40:55.703328 6304 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 10:40:55.712548 6304 catalog_manager.cc:1347] Generated new cluster ID: be02b095fe614747aa37e4ba6e3371b6
I20260807 10:40:55.712683 6304 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 10:40:55.735603 6304 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 10:40:55.737581 6304 catalog_manager.cc:1504] Loading token signing keys...
I20260807 10:40:55.750483 6304 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9df8677149e14e548c2dd7bc148b5bdf: Generated new TSK 0
I20260807 10:40:55.751607 6304 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.171.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.171.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.171.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.65.keytab.
Entry for principal kudu/127.20.171.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.65.keytab.
I20260807 10:40:55.828604 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786098956060137-21165-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786098956060137-21165-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786098956060137-21165-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786098956060137-21165-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.171.65:0
--local_ip_for_outbound_sockets=127.20.171.65
--webserver_interface=127.20.171.65
--webserver_port=0
--tserver_master_addrs=127.20.171.126:36631
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.65.keytab
--principal=kudu/127.20.171.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.171.84:40535
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786098956060137-21165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786098956060137-21165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786098956060137-21165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:40:56.183717 6319 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:40:56.184113 6319 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:40:56.184216 6319 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:40:56.191500 6319 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:40:56.191602 6319 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:40:56.191787 6319 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.171.65
I20260807 10:40:56.202010 6319 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.171.84:40535
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786098956060137-21165-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786098956060137-21165-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.65.keytab
--principal=kudu/127.20.171.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.171.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786098956060137-21165-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.171.65
--webserver_port=0
--tserver_master_addrs=127.20.171.126:36631
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.171.65
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786098956060137-21165-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:40:56.203219 6319 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:40:56.204610 6319 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:40:56.217677 6325 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:40:56.217707 6328 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:40:56.217767 6326 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:40:56.218426 6319 server_base.cc:1034] running on GCE node
I20260807 10:40:56.218997 6319 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:40:56.219871 6319 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:40:56.221074 6319 hybrid_clock.cc:648] HybridClock initialized: now 1786099256221038 us; error 34 us; skew 500 ppm
I20260807 10:40:56.221398 6319 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:40:56 dist-test-slave-0b58 krb5kdc[6212](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099256, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:40:56.229974 6319 init.cc:377] Logged in from keytab as kudu/127.20.171.65@KRBTEST.COM (short username kudu)
I20260807 10:40:56.231515 6319 webserver.cc:460] Webserver started at http://127.20.171.65:37833/ using document root <none> and password file <none>
I20260807 10:40:56.232201 6319 fs_manager.cc:359] Metadata directory not provided
I20260807 10:40:56.232383 6319 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:40:56.232703 6319 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:40:56.235607 6319 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786098956060137-21165-0/minicluster-data/ts-0/data/instance:
uuid: "1dff1347dc7e41b1aa1c14f258428c60"
format_stamp: "Formatted at 2026-08-07 10:40:56 on dist-test-slave-0b58"
server_key: "ea3b7e8ddd3c89a2b63532a3513bb7dc"
server_key_iv: "ad208bbb552d1835a91ecd7854b9138e"
server_key_version: "encryptionkey@0"
I20260807 10:40:56.236474 6319 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786098956060137-21165-0/minicluster-data/ts-0/wal/instance:
uuid: "1dff1347dc7e41b1aa1c14f258428c60"
format_stamp: "Formatted at 2026-08-07 10:40:56 on dist-test-slave-0b58"
server_key: "ea3b7e8ddd3c89a2b63532a3513bb7dc"
server_key_iv: "ad208bbb552d1835a91ecd7854b9138e"
server_key_version: "encryptionkey@0"
I20260807 10:40:56.241655 6319 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.004s
I20260807 10:40:56.245044 6336 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:40:56.246331 6319 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260807 10:40:56.246510 6319 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786098956060137-21165-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786098956060137-21165-0/minicluster-data/ts-0/wal
uuid: "1dff1347dc7e41b1aa1c14f258428c60"
format_stamp: "Formatted at 2026-08-07 10:40:56 on dist-test-slave-0b58"
server_key: "ea3b7e8ddd3c89a2b63532a3513bb7dc"
server_key_iv: "ad208bbb552d1835a91ecd7854b9138e"
server_key_version: "encryptionkey@0"
I20260807 10:40:56.246711 6319 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786098956060137-21165-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786098956060137-21165-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786098956060137-21165-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:40:56.266618 6319 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:40:56.270745 6319 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:40:56.271039 6319 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:40:56.272033 6319 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:40:56.273473 6319 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:40:56.273577 6319 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:40:56.273734 6319 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:40:56.273808 6319 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:40:56.307586 6319 rpc_server.cc:307] RPC server started. Bound to: 127.20.171.65:35473
I20260807 10:40:56.307638 6450 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.171.65:35473 every 8 connection(s)
I20260807 10:40:56.308967 6319 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786098956060137-21165-0/minicluster-data/ts-0/data/info.pb
I20260807 10:40:56.312376 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 6319
I20260807 10:40:56.312619 21165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786098956060137-21165-0/minicluster-data/ts-0/wal/instance
I20260807 10:40:56.313519 21165 external_mini_cluster.cc:1428] Setting key c01154a7f716a3889c1f18897b119df6
Aug 07 10:40:56 dist-test-slave-0b58 krb5kdc[6212](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099256, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.65@KRBTEST.COM for kudu/127.20.171.126@KRBTEST.COM
I20260807 10:40:56.333240 6453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:40:56.311424 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.65:37511 (local address 127.20.171.126:36631)
0807 10:40:56.311924 (+ 500us) server_negotiation.cc:206] Beginning negotiation
0807 10:40:56.311932 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 10:40:56.313193 (+ 1261us) server_negotiation.cc:407] Connection header received
0807 10:40:56.315487 (+ 2294us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:40:56.315493 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:40:56.315588 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:40:56.315687 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:40:56.317832 (+ 2145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:40:56.318564 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:40:56.321029 (+ 2465us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:40:56.321438 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:40:56.321543 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:40:56.326160 (+ 4617us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:40:56.326168 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:40:56.326175 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:40:56.326222 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:40:56.329919 (+ 3697us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:40:56.330833 (+ 914us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:40:56.330841 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:40:56.330847 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:40:56.330983 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:40:56.331431 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:40:56.331436 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:40:56.331440 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:40:56.331716 (+ 276us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:40:56.331882 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0807 10:40:56.332801 (+ 919us) server_negotiation.cc:299] Negotiation successful
0807 10:40:56.332977 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":354,"thread_start_us":234,"threads_started":1}
I20260807 10:40:56.334702 6454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:40:56.311979 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:36631 (local address 127.20.171.65:37511)
0807 10:40:56.313003 (+ 1024us) negotiation.cc:107] Waiting for socket to connect
0807 10:40:56.313058 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0807 10:40:56.315177 (+ 2119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:40:56.315994 (+ 817us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:40:56.316004 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:40:56.316836 (+ 832us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:40:56.317660 (+ 824us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:40:56.317689 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:40:56.318735 (+ 1046us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:40:56.318743 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:40:56.320892 (+ 2149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:40:56.320910 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:40:56.321677 (+ 767us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:40:56.321687 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:40:56.322029 (+ 342us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:40:56.322822 (+ 793us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:40:56.322863 (+ 41us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:40:56.325902 (+ 3039us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:40:56.330070 (+ 4168us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:40:56.330081 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:40:56.330098 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:40:56.330678 (+ 580us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:40:56.331105 (+ 427us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:40:56.331110 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:40:56.331114 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:40:56.331312 (+ 198us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:40:56.331848 (+ 536us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:40:56.331855 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:40:56.332369 (+ 514us) client_negotiation.cc:769] Sending connection context
0807 10:40:56.332676 (+ 307us) client_negotiation.cc:240] Negotiation successful
0807 10:40:56.333250 (+ 574us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":687,"thread_start_us":386,"threads_started":1}
I20260807 10:40:56.336328 6451 heartbeater.cc:347] Connected to a master server at 127.20.171.126:36631
I20260807 10:40:56.336654 6451 heartbeater.cc:464] Registering TS with master...
I20260807 10:40:56.337563 6451 heartbeater.cc:511] Master 127.20.171.126:36631 requested a full tablet report, sending...
I20260807 10:40:56.339831 6257 ts_manager.cc:194] Registered new tserver with Master: 1dff1347dc7e41b1aa1c14f258428c60 (127.20.171.65:35473)
I20260807 10:40:56.341377 6257 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.171.65@KRBTEST.COM'} at 127.20.171.65:37511
WARNING: no policy specified for kudu/127.20.171.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.171.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.171.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.66.keytab.
Entry for principal kudu/127.20.171.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.66.keytab.
I20260807 10:40:56.389477 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786098956060137-21165-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786098956060137-21165-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786098956060137-21165-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786098956060137-21165-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.171.66:0
--local_ip_for_outbound_sockets=127.20.171.66
--webserver_interface=127.20.171.66
--webserver_port=0
--tserver_master_addrs=127.20.171.126:36631
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.66.keytab
--principal=kudu/127.20.171.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.171.84:40535
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786098956060137-21165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786098956060137-21165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786098956060137-21165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:40:56.736214 6457 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:40:56.736511 6457 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:40:56.736611 6457 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:40:56.743898 6457 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:40:56.744011 6457 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:40:56.744134 6457 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.171.66
I20260807 10:40:56.754539 6457 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.171.84:40535
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786098956060137-21165-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786098956060137-21165-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.66.keytab
--principal=kudu/127.20.171.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.171.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786098956060137-21165-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.171.66
--webserver_port=0
--tserver_master_addrs=127.20.171.126:36631
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.171.66
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786098956060137-21165-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:40:56.755779 6457 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:40:56.757148 6457 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:40:56.770505 6463 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:40:56.770431 6465 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:40:56.770471 6462 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:40:56.771337 6457 server_base.cc:1034] running on GCE node
I20260807 10:40:56.772083 6457 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:40:56.773079 6457 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:40:56.774282 6457 hybrid_clock.cc:648] HybridClock initialized: now 1786099256774233 us; error 43 us; skew 500 ppm
I20260807 10:40:56.774595 6457 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:40:56 dist-test-slave-0b58 krb5kdc[6212](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099256, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:40:56.777766 6457 init.cc:377] Logged in from keytab as kudu/127.20.171.66@KRBTEST.COM (short username kudu)
I20260807 10:40:56.779172 6457 webserver.cc:460] Webserver started at http://127.20.171.66:37477/ using document root <none> and password file <none>
I20260807 10:40:56.779851 6457 fs_manager.cc:359] Metadata directory not provided
I20260807 10:40:56.779995 6457 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:40:56.780364 6457 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:40:56.783224 6457 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786098956060137-21165-0/minicluster-data/ts-1/data/instance:
uuid: "53a326d4fd554a6286d0966b3d954faf"
format_stamp: "Formatted at 2026-08-07 10:40:56 on dist-test-slave-0b58"
server_key: "14c9c389eb2fd7e142093a924737fe29"
server_key_iv: "2779859b571a6a46b395bfb7e1f7d7c0"
server_key_version: "encryptionkey@0"
I20260807 10:40:56.783984 6457 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786098956060137-21165-0/minicluster-data/ts-1/wal/instance:
uuid: "53a326d4fd554a6286d0966b3d954faf"
format_stamp: "Formatted at 2026-08-07 10:40:56 on dist-test-slave-0b58"
server_key: "14c9c389eb2fd7e142093a924737fe29"
server_key_iv: "2779859b571a6a46b395bfb7e1f7d7c0"
server_key_version: "encryptionkey@0"
I20260807 10:40:56.789160 6457 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.002s
I20260807 10:40:56.792512 6472 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:40:56.793746 6457 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260807 10:40:56.793917 6457 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786098956060137-21165-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786098956060137-21165-0/minicluster-data/ts-1/wal
uuid: "53a326d4fd554a6286d0966b3d954faf"
format_stamp: "Formatted at 2026-08-07 10:40:56 on dist-test-slave-0b58"
server_key: "14c9c389eb2fd7e142093a924737fe29"
server_key_iv: "2779859b571a6a46b395bfb7e1f7d7c0"
server_key_version: "encryptionkey@0"
I20260807 10:40:56.794121 6457 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786098956060137-21165-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786098956060137-21165-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786098956060137-21165-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:40:56.834431 6457 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:40:56.838543 6457 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:40:56.838860 6457 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:40:56.839850 6457 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:40:56.841267 6457 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:40:56.841372 6457 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:40:56.841516 6457 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:40:56.841598 6457 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:40:56.875306 6457 rpc_server.cc:307] RPC server started. Bound to: 127.20.171.66:35827
I20260807 10:40:56.875396 6584 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.171.66:35827 every 8 connection(s)
I20260807 10:40:56.876668 6457 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786098956060137-21165-0/minicluster-data/ts-1/data/info.pb
I20260807 10:40:56.883490 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 6457
I20260807 10:40:56.883699 21165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786098956060137-21165-0/minicluster-data/ts-1/wal/instance
I20260807 10:40:56.884177 21165 external_mini_cluster.cc:1428] Setting key 3ee3e9a3c105fdcb682310b86d1dd403
Aug 07 10:40:56 dist-test-slave-0b58 krb5kdc[6212](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099256, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.66@KRBTEST.COM for kudu/127.20.171.126@KRBTEST.COM
I20260807 10:40:56.898204 6587 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:40:56.879204 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.66:48681 (local address 127.20.171.126:36631)
0807 10:40:56.879677 (+ 473us) server_negotiation.cc:206] Beginning negotiation
0807 10:40:56.879684 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:40:56.880742 (+ 1058us) server_negotiation.cc:407] Connection header received
0807 10:40:56.882520 (+ 1778us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:40:56.882525 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:40:56.882594 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:40:56.882692 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:40:56.884309 (+ 1617us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:40:56.885271 (+ 962us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:40:56.887072 (+ 1801us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:40:56.887800 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:40:56.887941 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:40:56.891839 (+ 3898us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:40:56.891845 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:40:56.891848 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:40:56.891880 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:40:56.894572 (+ 2692us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:40:56.895534 (+ 962us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:40:56.895538 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:40:56.895540 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:40:56.895664 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:40:56.896154 (+ 490us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:40:56.896157 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:40:56.896159 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:40:56.896460 (+ 301us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:40:56.896607 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0807 10:40:56.897498 (+ 891us) server_negotiation.cc:299] Negotiation successful
0807 10:40:56.897737 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":331,"thread_start_us":215,"threads_started":1}
I20260807 10:40:56.899569 6588 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:40:56.879819 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:36631 (local address 127.20.171.66:48681)
0807 10:40:56.880580 (+ 761us) negotiation.cc:107] Waiting for socket to connect
0807 10:40:56.880617 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0807 10:40:56.882272 (+ 1655us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:40:56.882892 (+ 620us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:40:56.882900 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:40:56.883455 (+ 555us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:40:56.884103 (+ 648us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:40:56.884120 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:40:56.885450 (+ 1330us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:40:56.885455 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:40:56.886929 (+ 1474us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:40:56.886941 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:40:56.888019 (+ 1078us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:40:56.888024 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:40:56.888228 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:40:56.888957 (+ 729us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:40:56.888980 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:40:56.891634 (+ 2654us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:40:56.894708 (+ 3074us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:40:56.894719 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:40:56.894737 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:40:56.895414 (+ 677us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:40:56.895787 (+ 373us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:40:56.895794 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:40:56.895801 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:40:56.896048 (+ 247us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:40:56.896593 (+ 545us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:40:56.896604 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:40:56.897053 (+ 449us) client_negotiation.cc:769] Sending connection context
0807 10:40:56.897394 (+ 341us) client_negotiation.cc:240] Negotiation successful
0807 10:40:56.898011 (+ 617us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":540,"thread_start_us":305,"threads_started":1}
I20260807 10:40:56.901026 6585 heartbeater.cc:347] Connected to a master server at 127.20.171.126:36631
I20260807 10:40:56.901372 6585 heartbeater.cc:464] Registering TS with master...
I20260807 10:40:56.902294 6585 heartbeater.cc:511] Master 127.20.171.126:36631 requested a full tablet report, sending...
I20260807 10:40:56.903887 6257 ts_manager.cc:194] Registered new tserver with Master: 53a326d4fd554a6286d0966b3d954faf (127.20.171.66:35827)
I20260807 10:40:56.904844 6257 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.171.66@KRBTEST.COM'} at 127.20.171.66:48681
WARNING: no policy specified for kudu/127.20.171.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.171.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.171.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.67.keytab.
Entry for principal kudu/127.20.171.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.67.keytab.
I20260807 10:40:56.958973 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786098956060137-21165-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786098956060137-21165-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786098956060137-21165-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786098956060137-21165-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.171.67:0
--local_ip_for_outbound_sockets=127.20.171.67
--webserver_interface=127.20.171.67
--webserver_port=0
--tserver_master_addrs=127.20.171.126:36631
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.67.keytab
--principal=kudu/127.20.171.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.171.84:40535
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786098956060137-21165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786098956060137-21165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786098956060137-21165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:40:57.309895 6592 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:40:57.310199 6592 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:40:57.310370 6592 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:40:57.317921 6592 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:40:57.318080 6592 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:40:57.318262 6592 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.171.67
I20260807 10:40:57.328604 6592 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.171.84:40535
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786098956060137-21165-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786098956060137-21165-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.67.keytab
--principal=kudu/127.20.171.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.171.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786098956060137-21165-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.171.67
--webserver_port=0
--tserver_master_addrs=127.20.171.126:36631
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.171.67
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786098956060137-21165-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:40:57.329947 6592 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:40:57.331892 6592 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 10:40:57.345118 6451 heartbeater.cc:503] Master 127.20.171.126:36631 was elected leader, sending a full tablet report...
W20260807 10:40:57.345443 6598 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:40:57.345839 6597 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:40:57.345865 6600 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:40:57.346825 6592 server_base.cc:1034] running on GCE node
I20260807 10:40:57.347549 6592 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:40:57.348632 6592 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:40:57.349870 6592 hybrid_clock.cc:648] HybridClock initialized: now 1786099257349834 us; error 61 us; skew 500 ppm
I20260807 10:40:57.350198 6592 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:40:57 dist-test-slave-0b58 krb5kdc[6212](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099257, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:40:57.353470 6592 init.cc:377] Logged in from keytab as kudu/127.20.171.67@KRBTEST.COM (short username kudu)
I20260807 10:40:57.354959 6592 webserver.cc:460] Webserver started at http://127.20.171.67:43689/ using document root <none> and password file <none>
I20260807 10:40:57.355652 6592 fs_manager.cc:359] Metadata directory not provided
I20260807 10:40:57.355808 6592 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:40:57.356127 6592 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:40:57.359087 6592 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786098956060137-21165-0/minicluster-data/ts-2/data/instance:
uuid: "f65940f011484890b8d55cd4d8b9ed8f"
format_stamp: "Formatted at 2026-08-07 10:40:57 on dist-test-slave-0b58"
server_key: "aea0e5a997e1c025f4f6d762853e2dfa"
server_key_iv: "25e71db3e6d4e13f27053e52c33369ca"
server_key_version: "encryptionkey@0"
I20260807 10:40:57.359876 6592 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786098956060137-21165-0/minicluster-data/ts-2/wal/instance:
uuid: "f65940f011484890b8d55cd4d8b9ed8f"
format_stamp: "Formatted at 2026-08-07 10:40:57 on dist-test-slave-0b58"
server_key: "aea0e5a997e1c025f4f6d762853e2dfa"
server_key_iv: "25e71db3e6d4e13f27053e52c33369ca"
server_key_version: "encryptionkey@0"
I20260807 10:40:57.365159 6592 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.008s sys 0.000s
I20260807 10:40:57.368899 6607 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:40:57.370374 6592 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260807 10:40:57.370587 6592 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786098956060137-21165-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786098956060137-21165-0/minicluster-data/ts-2/wal
uuid: "f65940f011484890b8d55cd4d8b9ed8f"
format_stamp: "Formatted at 2026-08-07 10:40:57 on dist-test-slave-0b58"
server_key: "aea0e5a997e1c025f4f6d762853e2dfa"
server_key_iv: "25e71db3e6d4e13f27053e52c33369ca"
server_key_version: "encryptionkey@0"
I20260807 10:40:57.370807 6592 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786098956060137-21165-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786098956060137-21165-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786098956060137-21165-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:40:57.382512 6592 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:40:57.387097 6592 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:40:57.387419 6592 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:40:57.388491 6592 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:40:57.389846 6592 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:40:57.389952 6592 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:40:57.390100 6592 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:40:57.390174 6592 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:40:57.426800 6592 rpc_server.cc:307] RPC server started. Bound to: 127.20.171.67:45093
I20260807 10:40:57.426877 6723 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.171.67:45093 every 8 connection(s)
I20260807 10:40:57.428303 6592 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786098956060137-21165-0/minicluster-data/ts-2/data/info.pb
I20260807 10:40:57.433982 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 6592
I20260807 10:40:57.434190 21165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786098956060137-21165-0/minicluster-data/ts-2/wal/instance
I20260807 10:40:57.434669 21165 external_mini_cluster.cc:1428] Setting key 848acf83bdcbea0fdedcfd48af1407d0
Aug 07 10:40:57 dist-test-slave-0b58 krb5kdc[6212](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099257, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.67@KRBTEST.COM for kudu/127.20.171.126@KRBTEST.COM
I20260807 10:40:57.450816 6726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:40:57.431122 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.67:54623 (local address 127.20.171.126:36631)
0807 10:40:57.431626 (+ 504us) server_negotiation.cc:206] Beginning negotiation
0807 10:40:57.431631 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:40:57.432764 (+ 1133us) server_negotiation.cc:407] Connection header received
0807 10:40:57.434824 (+ 2060us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:40:57.434831 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:40:57.434943 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:40:57.435068 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:40:57.437172 (+ 2104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:40:57.438172 (+ 1000us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:40:57.439785 (+ 1613us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:40:57.440196 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:40:57.440351 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:40:57.444153 (+ 3802us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:40:57.444159 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:40:57.444162 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:40:57.444200 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:40:57.447089 (+ 2889us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:40:57.447943 (+ 854us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:40:57.447947 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:40:57.447950 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:40:57.448124 (+ 174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:40:57.448657 (+ 533us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:40:57.448666 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:40:57.448668 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:40:57.449068 (+ 400us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:40:57.449243 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0807 10:40:57.450092 (+ 849us) server_negotiation.cc:299] Negotiation successful
0807 10:40:57.450354 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":387,"thread_start_us":240,"threads_started":1}
I20260807 10:40:57.451807 6727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:40:57.431722 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:36631 (local address 127.20.171.67:54623)
0807 10:40:57.432591 (+ 869us) negotiation.cc:107] Waiting for socket to connect
0807 10:40:57.432632 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0807 10:40:57.434529 (+ 1897us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:40:57.435372 (+ 843us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:40:57.435386 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:40:57.436208 (+ 822us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:40:57.436989 (+ 781us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:40:57.437021 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:40:57.438343 (+ 1322us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:40:57.438347 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:40:57.439631 (+ 1284us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:40:57.439649 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:40:57.440478 (+ 829us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:40:57.440485 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:40:57.440734 (+ 249us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:40:57.441448 (+ 714us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:40:57.441475 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:40:57.443896 (+ 2421us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:40:57.447282 (+ 3386us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:40:57.447293 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:40:57.447316 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:40:57.447794 (+ 478us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:40:57.448252 (+ 458us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:40:57.448293 (+ 41us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:40:57.448297 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:40:57.448519 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:40:57.449205 (+ 686us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:40:57.449214 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:40:57.449634 (+ 420us) client_negotiation.cc:769] Sending connection context
0807 10:40:57.449973 (+ 339us) client_negotiation.cc:240] Negotiation successful
0807 10:40:57.450605 (+ 632us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":630,"thread_start_us":318,"threads_started":1}
I20260807 10:40:57.453285 6724 heartbeater.cc:347] Connected to a master server at 127.20.171.126:36631
I20260807 10:40:57.453569 6724 heartbeater.cc:464] Registering TS with master...
I20260807 10:40:57.454274 6724 heartbeater.cc:511] Master 127.20.171.126:36631 requested a full tablet report, sending...
I20260807 10:40:57.455718 6257 ts_manager.cc:194] Registered new tserver with Master: f65940f011484890b8d55cd4d8b9ed8f (127.20.171.67:45093)
I20260807 10:40:57.456673 6257 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.171.67@KRBTEST.COM'} at 127.20.171.67:54623
I20260807 10:40:57.463431 21165 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 10:40:57.483569 6726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:40:57.468655 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57162 (local address 127.20.171.126:36631)
0807 10:40:57.468849 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0807 10:40:57.468854 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:40:57.469257 (+ 403us) server_negotiation.cc:407] Connection header received
0807 10:40:57.469446 (+ 189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:40:57.469451 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:40:57.469541 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:40:57.469637 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:40:57.471261 (+ 1624us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:40:57.472004 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:40:57.473985 (+ 1981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:40:57.474587 (+ 602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:40:57.474740 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:40:57.477621 (+ 2881us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:40:57.477629 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:40:57.477632 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:40:57.477675 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:40:57.480603 (+ 2928us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:40:57.481377 (+ 774us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:40:57.481384 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:40:57.481387 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:40:57.481530 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:40:57.481960 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:40:57.481965 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:40:57.481973 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:40:57.482331 (+ 358us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:40:57.482600 (+ 269us) server_negotiation.cc:1035] Waiting for connection context
0807 10:40:57.482983 (+ 383us) server_negotiation.cc:299] Negotiation successful
0807 10:40:57.483226 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260807 10:40:57.488302 6257 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57162:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 10:40:57.495798 6257 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 10:40:57.532681 6739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:40:57.509372 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.66:35827 (local address 127.0.0.1:43312)
0807 10:40:57.522240 (+ 12868us) negotiation.cc:107] Waiting for socket to connect
0807 10:40:57.522330 (+ 90us) client_negotiation.cc:174] Beginning negotiation
0807 10:40:57.522601 (+ 271us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:40:57.524575 (+ 1974us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:40:57.524582 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:40:57.524614 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:40:57.525138 (+ 524us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:40:57.525149 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:40:57.526939 (+ 1790us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:40:57.526947 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:40:57.529343 (+ 2396us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:40:57.529359 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:40:57.531545 (+ 2186us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:40:57.531552 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:40:57.531775 (+ 223us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:40:57.531833 (+ 58us) client_negotiation.cc:769] Sending connection context
0807 10:40:57.531952 (+ 119us) client_negotiation.cc:240] Negotiation successful
0807 10:40:57.532182 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12679,"mutex_wait_us":35,"spinlock_wait_cycles":10496,"thread_start_us":12509,"threads_started":1}
I20260807 10:40:57.533411 6741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:40:57.523041 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.67:45093 (local address 127.0.0.1:48616)
0807 10:40:57.523789 (+ 748us) negotiation.cc:107] Waiting for socket to connect
0807 10:40:57.523815 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0807 10:40:57.523976 (+ 161us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:40:57.525414 (+ 1438us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:40:57.525421 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:40:57.525450 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:40:57.525855 (+ 405us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:40:57.525867 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:40:57.528061 (+ 2194us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:40:57.528069 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:40:57.530251 (+ 2182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:40:57.530265 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:40:57.532062 (+ 1797us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:40:57.532074 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:40:57.532385 (+ 311us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:40:57.532530 (+ 145us) client_negotiation.cc:769] Sending connection context
0807 10:40:57.532624 (+ 94us) client_negotiation.cc:240] Negotiation successful
0807 10:40:57.532839 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":544,"mutex_wait_us":150,"thread_start_us":352,"threads_started":1}
I20260807 10:40:57.533418 6737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:40:57.509079 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.65:35473 (local address 127.0.0.1:48852)
0807 10:40:57.522240 (+ 13161us) negotiation.cc:107] Waiting for socket to connect
0807 10:40:57.522330 (+ 90us) client_negotiation.cc:174] Beginning negotiation
0807 10:40:57.522601 (+ 271us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:40:57.524610 (+ 2009us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:40:57.524615 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:40:57.524641 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:40:57.525302 (+ 661us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:40:57.525319 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:40:57.527334 (+ 2015us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:40:57.527340 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:40:57.529864 (+ 2524us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:40:57.529879 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:40:57.532089 (+ 2210us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:40:57.532094 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:40:57.532383 (+ 289us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:40:57.532528 (+ 145us) client_negotiation.cc:769] Sending connection context
0807 10:40:57.532622 (+ 94us) client_negotiation.cc:240] Negotiation successful
0807 10:40:57.532839 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12829,"mutex_wait_us":191,"spinlock_wait_cycles":7552,"thread_start_us":12385,"threads_started":1}
I20260807 10:40:57.533811 6740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:40:57.509586 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43312 (local address 127.20.171.66:35827)
0807 10:40:57.520531 (+ 10945us) server_negotiation.cc:206] Beginning negotiation
0807 10:40:57.520545 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0807 10:40:57.522668 (+ 2123us) server_negotiation.cc:407] Connection header received
0807 10:40:57.522852 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:40:57.522862 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:40:57.523158 (+ 296us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:40:57.523419 (+ 261us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:40:57.525324 (+ 1905us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:40:57.526747 (+ 1423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:40:57.529522 (+ 2775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:40:57.531011 (+ 1489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:40:57.531155 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:40:57.531387 (+ 232us) server_negotiation.cc:1035] Waiting for connection context
0807 10:40:57.533296 (+ 1909us) server_negotiation.cc:299] Negotiation successful
0807 10:40:57.533477 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10649,"thread_start_us":10970,"threads_started":1}
I20260807 10:40:57.534134 6738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:40:57.509280 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48852 (local address 127.20.171.65:35473)
0807 10:40:57.521435 (+ 12155us) server_negotiation.cc:206] Beginning negotiation
0807 10:40:57.521447 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 10:40:57.522555 (+ 1108us) server_negotiation.cc:407] Connection header received
0807 10:40:57.523794 (+ 1239us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:40:57.523804 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:40:57.524045 (+ 241us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:40:57.524241 (+ 196us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:40:57.525530 (+ 1289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:40:57.527162 (+ 1632us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:40:57.530041 (+ 2879us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:40:57.531534 (+ 1493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:40:57.531670 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:40:57.531928 (+ 258us) server_negotiation.cc:1035] Waiting for connection context
0807 10:40:57.532771 (+ 843us) server_negotiation.cc:299] Negotiation successful
0807 10:40:57.533801 (+ 1030us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11952,"thread_start_us":11770,"threads_started":1}
I20260807 10:40:57.534535 6742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:40:57.523115 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48616 (local address 127.20.171.67:45093)
0807 10:40:57.524823 (+ 1708us) server_negotiation.cc:206] Beginning negotiation
0807 10:40:57.524831 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 10:40:57.524868 (+ 37us) server_negotiation.cc:407] Connection header received
0807 10:40:57.524964 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:40:57.524973 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:40:57.525202 (+ 229us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:40:57.525434 (+ 232us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:40:57.526047 (+ 613us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:40:57.527664 (+ 1617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:40:57.530426 (+ 2762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:40:57.531847 (+ 1421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:40:57.531982 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:40:57.532203 (+ 221us) server_negotiation.cc:1035] Waiting for connection context
0807 10:40:57.533133 (+ 930us) server_negotiation.cc:299] Negotiation successful
0807 10:40:57.533338 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1374,"thread_start_us":1194,"threads_started":1}
I20260807 10:40:57.537551 6520 tablet_service.cc:1467] Processing CreateTablet for tablet 6c941c8139cd4a85ac547dfbacd68550 (DEFAULT_TABLE table=test-table [id=a5cc05c3b6ee4ca2af5cc1c86f147243]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:40:57.537719 6658 tablet_service.cc:1467] Processing CreateTablet for tablet 6c941c8139cd4a85ac547dfbacd68550 (DEFAULT_TABLE table=test-table [id=a5cc05c3b6ee4ca2af5cc1c86f147243]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:40:57.539016 6520 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6c941c8139cd4a85ac547dfbacd68550. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:40:57.539053 6658 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6c941c8139cd4a85ac547dfbacd68550. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:40:57.541097 6385 tablet_service.cc:1467] Processing CreateTablet for tablet 6c941c8139cd4a85ac547dfbacd68550 (DEFAULT_TABLE table=test-table [id=a5cc05c3b6ee4ca2af5cc1c86f147243]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:40:57.542572 6385 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6c941c8139cd4a85ac547dfbacd68550. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:40:57.551846 6743 tablet_bootstrap.cc:492] T 6c941c8139cd4a85ac547dfbacd68550 P f65940f011484890b8d55cd4d8b9ed8f: Bootstrap starting.
I20260807 10:40:57.555765 6743 tablet_bootstrap.cc:654] T 6c941c8139cd4a85ac547dfbacd68550 P f65940f011484890b8d55cd4d8b9ed8f: Neither blocks nor log segments found. Creating new log.
I20260807 10:40:57.556946 6743 log.cc:824] T 6c941c8139cd4a85ac547dfbacd68550 P f65940f011484890b8d55cd4d8b9ed8f: Log is configured to *not* fsync() on all Append() calls
I20260807 10:40:57.560048 6743 tablet_bootstrap.cc:492] T 6c941c8139cd4a85ac547dfbacd68550 P f65940f011484890b8d55cd4d8b9ed8f: No bootstrap required, opened a new log
I20260807 10:40:57.560377 6743 ts_tablet_manager.cc:1397] T 6c941c8139cd4a85ac547dfbacd68550 P f65940f011484890b8d55cd4d8b9ed8f: Time spent bootstrapping tablet: real 0.009s user 0.005s sys 0.004s
I20260807 10:40:57.563164 6744 tablet_bootstrap.cc:492] T 6c941c8139cd4a85ac547dfbacd68550 P 53a326d4fd554a6286d0966b3d954faf: Bootstrap starting.
I20260807 10:40:57.565127 6746 tablet_bootstrap.cc:492] T 6c941c8139cd4a85ac547dfbacd68550 P 1dff1347dc7e41b1aa1c14f258428c60: Bootstrap starting.
I20260807 10:40:57.567585 6744 tablet_bootstrap.cc:654] T 6c941c8139cd4a85ac547dfbacd68550 P 53a326d4fd554a6286d0966b3d954faf: Neither blocks nor log segments found. Creating new log.
I20260807 10:40:57.568346 6746 tablet_bootstrap.cc:654] T 6c941c8139cd4a85ac547dfbacd68550 P 1dff1347dc7e41b1aa1c14f258428c60: Neither blocks nor log segments found. Creating new log.
I20260807 10:40:57.568965 6744 log.cc:824] T 6c941c8139cd4a85ac547dfbacd68550 P 53a326d4fd554a6286d0966b3d954faf: Log is configured to *not* fsync() on all Append() calls
I20260807 10:40:57.569372 6746 log.cc:824] T 6c941c8139cd4a85ac547dfbacd68550 P 1dff1347dc7e41b1aa1c14f258428c60: Log is configured to *not* fsync() on all Append() calls
I20260807 10:40:57.570921 6743 raft_consensus.cc:348] T 6c941c8139cd4a85ac547dfbacd68550 P f65940f011484890b8d55cd4d8b9ed8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dff1347dc7e41b1aa1c14f258428c60" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 35473 } } peers { permanent_uuid: "53a326d4fd554a6286d0966b3d954faf" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 35827 } } peers { permanent_uuid: "f65940f011484890b8d55cd4d8b9ed8f" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 45093 } }
I20260807 10:40:57.571323 6743 raft_consensus.cc:374] T 6c941c8139cd4a85ac547dfbacd68550 P f65940f011484890b8d55cd4d8b9ed8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:40:57.571436 6743 raft_consensus.cc:729] T 6c941c8139cd4a85ac547dfbacd68550 P f65940f011484890b8d55cd4d8b9ed8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f65940f011484890b8d55cd4d8b9ed8f, State: Initialized, Role: FOLLOWER
I20260807 10:40:57.572075 6743 consensus_queue.cc:260] T 6c941c8139cd4a85ac547dfbacd68550 P f65940f011484890b8d55cd4d8b9ed8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dff1347dc7e41b1aa1c14f258428c60" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 35473 } } peers { permanent_uuid: "53a326d4fd554a6286d0966b3d954faf" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 35827 } } peers { permanent_uuid: "f65940f011484890b8d55cd4d8b9ed8f" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 45093 } }
I20260807 10:40:57.572450 6744 tablet_bootstrap.cc:492] T 6c941c8139cd4a85ac547dfbacd68550 P 53a326d4fd554a6286d0966b3d954faf: No bootstrap required, opened a new log
I20260807 10:40:57.572449 6746 tablet_bootstrap.cc:492] T 6c941c8139cd4a85ac547dfbacd68550 P 1dff1347dc7e41b1aa1c14f258428c60: No bootstrap required, opened a new log
I20260807 10:40:57.572741 6746 ts_tablet_manager.cc:1397] T 6c941c8139cd4a85ac547dfbacd68550 P 1dff1347dc7e41b1aa1c14f258428c60: Time spent bootstrapping tablet: real 0.008s user 0.007s sys 0.000s
I20260807 10:40:57.572741 6744 ts_tablet_manager.cc:1397] T 6c941c8139cd4a85ac547dfbacd68550 P 53a326d4fd554a6286d0966b3d954faf: Time spent bootstrapping tablet: real 0.015s user 0.009s sys 0.000s
I20260807 10:40:57.573339 6724 heartbeater.cc:503] Master 127.20.171.126:36631 was elected leader, sending a full tablet report...
I20260807 10:40:57.574010 6743 ts_tablet_manager.cc:1428] T 6c941c8139cd4a85ac547dfbacd68550 P f65940f011484890b8d55cd4d8b9ed8f: Time spent starting tablet: real 0.014s user 0.009s sys 0.003s
I20260807 10:40:57.581938 6744 raft_consensus.cc:348] T 6c941c8139cd4a85ac547dfbacd68550 P 53a326d4fd554a6286d0966b3d954faf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dff1347dc7e41b1aa1c14f258428c60" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 35473 } } peers { permanent_uuid: "53a326d4fd554a6286d0966b3d954faf" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 35827 } } peers { permanent_uuid: "f65940f011484890b8d55cd4d8b9ed8f" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 45093 } }
I20260807 10:40:57.582410 6744 raft_consensus.cc:374] T 6c941c8139cd4a85ac547dfbacd68550 P 53a326d4fd554a6286d0966b3d954faf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:40:57.582525 6744 raft_consensus.cc:729] T 6c941c8139cd4a85ac547dfbacd68550 P 53a326d4fd554a6286d0966b3d954faf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53a326d4fd554a6286d0966b3d954faf, State: Initialized, Role: FOLLOWER
I20260807 10:40:57.582902 6746 raft_consensus.cc:348] T 6c941c8139cd4a85ac547dfbacd68550 P 1dff1347dc7e41b1aa1c14f258428c60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dff1347dc7e41b1aa1c14f258428c60" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 35473 } } peers { permanent_uuid: "53a326d4fd554a6286d0966b3d954faf" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 35827 } } peers { permanent_uuid: "f65940f011484890b8d55cd4d8b9ed8f" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 45093 } }
I20260807 10:40:57.583299 6746 raft_consensus.cc:374] T 6c941c8139cd4a85ac547dfbacd68550 P 1dff1347dc7e41b1aa1c14f258428c60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:40:57.583112 6744 consensus_queue.cc:260] T 6c941c8139cd4a85ac547dfbacd68550 P 53a326d4fd554a6286d0966b3d954faf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dff1347dc7e41b1aa1c14f258428c60" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 35473 } } peers { permanent_uuid: "53a326d4fd554a6286d0966b3d954faf" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 35827 } } peers { permanent_uuid: "f65940f011484890b8d55cd4d8b9ed8f" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 45093 } }
I20260807 10:40:57.583420 6746 raft_consensus.cc:729] T 6c941c8139cd4a85ac547dfbacd68550 P 1dff1347dc7e41b1aa1c14f258428c60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1dff1347dc7e41b1aa1c14f258428c60, State: Initialized, Role: FOLLOWER
I20260807 10:40:57.584092 6746 consensus_queue.cc:260] T 6c941c8139cd4a85ac547dfbacd68550 P 1dff1347dc7e41b1aa1c14f258428c60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dff1347dc7e41b1aa1c14f258428c60" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 35473 } } peers { permanent_uuid: "53a326d4fd554a6286d0966b3d954faf" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 35827 } } peers { permanent_uuid: "f65940f011484890b8d55cd4d8b9ed8f" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 45093 } }
I20260807 10:40:57.584444 6585 heartbeater.cc:503] Master 127.20.171.126:36631 was elected leader, sending a full tablet report...
I20260807 10:40:57.585083 6744 ts_tablet_manager.cc:1428] T 6c941c8139cd4a85ac547dfbacd68550 P 53a326d4fd554a6286d0966b3d954faf: Time spent starting tablet: real 0.012s user 0.012s sys 0.000s
I20260807 10:40:57.585991 6746 ts_tablet_manager.cc:1428] T 6c941c8139cd4a85ac547dfbacd68550 P 1dff1347dc7e41b1aa1c14f258428c60: Time spent starting tablet: real 0.013s user 0.011s sys 0.000s
W20260807 10:40:57.628736 6586 tablet.cc:2369] T 6c941c8139cd4a85ac547dfbacd68550 P 53a326d4fd554a6286d0966b3d954faf: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 10:40:57.680017 6725 tablet.cc:2369] T 6c941c8139cd4a85ac547dfbacd68550 P f65940f011484890b8d55cd4d8b9ed8f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 10:40:57.787425 6749 raft_consensus.cc:482] T 6c941c8139cd4a85ac547dfbacd68550 P f65940f011484890b8d55cd4d8b9ed8f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 10:40:57.787775 6749 raft_consensus.cc:504] T 6c941c8139cd4a85ac547dfbacd68550 P f65940f011484890b8d55cd4d8b9ed8f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dff1347dc7e41b1aa1c14f258428c60" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 35473 } } peers { permanent_uuid: "53a326d4fd554a6286d0966b3d954faf" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 35827 } } peers { permanent_uuid: "f65940f011484890b8d55cd4d8b9ed8f" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 45093 } }
I20260807 10:40:57.789584 6749 leader_election.cc:288] T 6c941c8139cd4a85ac547dfbacd68550 P f65940f011484890b8d55cd4d8b9ed8f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1dff1347dc7e41b1aa1c14f258428c60 (127.20.171.65:35473), 53a326d4fd554a6286d0966b3d954faf (127.20.171.66:35827)
I20260807 10:40:57.795550 6738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:40:57.790114 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.67:46135 (local address 127.20.171.65:35473)
0807 10:40:57.790339 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0807 10:40:57.790344 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:40:57.790360 (+ 16us) server_negotiation.cc:407] Connection header received
0807 10:40:57.790421 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:40:57.790425 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:40:57.790532 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:40:57.790638 (+ 106us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:40:57.791158 (+ 520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:40:57.791970 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:40:57.793805 (+ 1835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:40:57.794639 (+ 834us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:40:57.794810 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:40:57.794898 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0807 10:40:57.795170 (+ 272us) server_negotiation.cc:299] Negotiation successful
0807 10:40:57.795302 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260807 10:40:57.795584 6727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:40:57.789786 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.65:35473 (local address 127.20.171.67:46135)
0807 10:40:57.790021 (+ 235us) negotiation.cc:107] Waiting for socket to connect
0807 10:40:57.790045 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0807 10:40:57.790176 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:40:57.790701 (+ 525us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:40:57.790713 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:40:57.790749 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:40:57.790969 (+ 220us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:40:57.790978 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:40:57.792102 (+ 1124us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:40:57.792110 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:40:57.793629 (+ 1519us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:40:57.793642 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:40:57.794808 (+ 1166us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:40:57.794814 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:40:57.795006 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:40:57.795030 (+ 24us) client_negotiation.cc:769] Sending connection context
0807 10:40:57.795140 (+ 110us) client_negotiation.cc:240] Negotiation successful
0807 10:40:57.795270 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":62,"mutex_wait_us":47}
I20260807 10:40:57.796151 6740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:40:57.790168 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.67:49023 (local address 127.20.171.66:35827)
0807 10:40:57.790402 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0807 10:40:57.790410 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 10:40:57.791062 (+ 652us) server_negotiation.cc:407] Connection header received
0807 10:40:57.791267 (+ 205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:40:57.791272 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:40:57.791332 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:40:57.791429 (+ 97us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:40:57.791938 (+ 509us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:40:57.792748 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:40:57.794418 (+ 1670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:40:57.795204 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:40:57.795373 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:40:57.795447 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0807 10:40:57.795788 (+ 341us) server_negotiation.cc:299] Negotiation successful
0807 10:40:57.795908 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260807 10:40:57.796908 6752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:40:57.790147 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.66:35827 (local address 127.20.171.67:49023)
0807 10:40:57.790957 (+ 810us) negotiation.cc:107] Waiting for socket to connect
0807 10:40:57.790971 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 10:40:57.791108 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:40:57.791454 (+ 346us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:40:57.791458 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:40:57.791481 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:40:57.791787 (+ 306us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:40:57.791795 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:40:57.792899 (+ 1104us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:40:57.792911 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:40:57.794263 (+ 1352us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:40:57.794274 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:40:57.795418 (+ 1144us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:40:57.795424 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:40:57.795575 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:40:57.795599 (+ 24us) client_negotiation.cc:769] Sending connection context
0807 10:40:57.796374 (+ 775us) client_negotiation.cc:240] Negotiation successful
0807 10:40:57.796508 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":707,"mutex_wait_us":1,"thread_start_us":442,"threads_started":1}
I20260807 10:40:57.796648 6405 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c941c8139cd4a85ac547dfbacd68550" candidate_uuid: "f65940f011484890b8d55cd4d8b9ed8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1dff1347dc7e41b1aa1c14f258428c60" is_pre_election: true
I20260807 10:40:57.797254 6405 raft_consensus.cc:2454] T 6c941c8139cd4a85ac547dfbacd68550 P 1dff1347dc7e41b1aa1c14f258428c60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f65940f011484890b8d55cd4d8b9ed8f in term 0.
I20260807 10:40:57.798038 6611 leader_election.cc:302] T 6c941c8139cd4a85ac547dfbacd68550 P f65940f011484890b8d55cd4d8b9ed8f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1dff1347dc7e41b1aa1c14f258428c60, f65940f011484890b8d55cd4d8b9ed8f; no voters:
I20260807 10:40:57.798092 6540 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c941c8139cd4a85ac547dfbacd68550" candidate_uuid: "f65940f011484890b8d55cd4d8b9ed8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53a326d4fd554a6286d0966b3d954faf" is_pre_election: true
I20260807 10:40:57.798559 6749 raft_consensus.cc:2781] T 6c941c8139cd4a85ac547dfbacd68550 P f65940f011484890b8d55cd4d8b9ed8f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 10:40:57.798736 6749 raft_consensus.cc:482] T 6c941c8139cd4a85ac547dfbacd68550 P f65940f011484890b8d55cd4d8b9ed8f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 10:40:57.798710 6540 raft_consensus.cc:2454] T 6c941c8139cd4a85ac547dfbacd68550 P 53a326d4fd554a6286d0966b3d954faf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f65940f011484890b8d55cd4d8b9ed8f in term 0.
I20260807 10:40:57.798864 6749 raft_consensus.cc:3037] T 6c941c8139cd4a85ac547dfbacd68550 P f65940f011484890b8d55cd4d8b9ed8f [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:40:57.801401 6749 raft_consensus.cc:504] T 6c941c8139cd4a85ac547dfbacd68550 P f65940f011484890b8d55cd4d8b9ed8f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dff1347dc7e41b1aa1c14f258428c60" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 35473 } } peers { permanent_uuid: "53a326d4fd554a6286d0966b3d954faf" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 35827 } } peers { permanent_uuid: "f65940f011484890b8d55cd4d8b9ed8f" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 45093 } }
I20260807 10:40:57.801990 6749 leader_election.cc:288] T 6c941c8139cd4a85ac547dfbacd68550 P f65940f011484890b8d55cd4d8b9ed8f [CANDIDATE]: Term 1 election: Requested vote from peers 1dff1347dc7e41b1aa1c14f258428c60 (127.20.171.65:35473), 53a326d4fd554a6286d0966b3d954faf (127.20.171.66:35827)
I20260807 10:40:57.802500 6540 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c941c8139cd4a85ac547dfbacd68550" candidate_uuid: "f65940f011484890b8d55cd4d8b9ed8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53a326d4fd554a6286d0966b3d954faf"
I20260807 10:40:57.802500 6405 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c941c8139cd4a85ac547dfbacd68550" candidate_uuid: "f65940f011484890b8d55cd4d8b9ed8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1dff1347dc7e41b1aa1c14f258428c60"
I20260807 10:40:57.802722 6540 raft_consensus.cc:3037] T 6c941c8139cd4a85ac547dfbacd68550 P 53a326d4fd554a6286d0966b3d954faf [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:40:57.802733 6405 raft_consensus.cc:3037] T 6c941c8139cd4a85ac547dfbacd68550 P 1dff1347dc7e41b1aa1c14f258428c60 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:40:57.806035 6405 raft_consensus.cc:2454] T 6c941c8139cd4a85ac547dfbacd68550 P 1dff1347dc7e41b1aa1c14f258428c60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f65940f011484890b8d55cd4d8b9ed8f in term 1.
I20260807 10:40:57.806035 6540 raft_consensus.cc:2454] T 6c941c8139cd4a85ac547dfbacd68550 P 53a326d4fd554a6286d0966b3d954faf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f65940f011484890b8d55cd4d8b9ed8f in term 1.
I20260807 10:40:57.806502 6610 leader_election.cc:302] T 6c941c8139cd4a85ac547dfbacd68550 P f65940f011484890b8d55cd4d8b9ed8f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53a326d4fd554a6286d0966b3d954faf, f65940f011484890b8d55cd4d8b9ed8f; no voters:
I20260807 10:40:57.806877 6749 raft_consensus.cc:2781] T 6c941c8139cd4a85ac547dfbacd68550 P f65940f011484890b8d55cd4d8b9ed8f [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:40:57.807327 6749 raft_consensus.cc:686] T 6c941c8139cd4a85ac547dfbacd68550 P f65940f011484890b8d55cd4d8b9ed8f [term 1 LEADER]: Becoming Leader. State: Replica: f65940f011484890b8d55cd4d8b9ed8f, State: Running, Role: LEADER
I20260807 10:40:57.807826 6749 consensus_queue.cc:237] T 6c941c8139cd4a85ac547dfbacd68550 P f65940f011484890b8d55cd4d8b9ed8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dff1347dc7e41b1aa1c14f258428c60" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 35473 } } peers { permanent_uuid: "53a326d4fd554a6286d0966b3d954faf" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 35827 } } peers { permanent_uuid: "f65940f011484890b8d55cd4d8b9ed8f" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 45093 } }
W20260807 10:40:57.811589 6452 tablet.cc:2369] T 6c941c8139cd4a85ac547dfbacd68550 P 1dff1347dc7e41b1aa1c14f258428c60: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 10:40:57.812930 6256 catalog_manager.cc:5495] T 6c941c8139cd4a85ac547dfbacd68550 P f65940f011484890b8d55cd4d8b9ed8f reported cstate change: term changed from 0 to 1, leader changed from <none> to f65940f011484890b8d55cd4d8b9ed8f (127.20.171.67). New cstate: current_term: 1 leader_uuid: "f65940f011484890b8d55cd4d8b9ed8f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dff1347dc7e41b1aa1c14f258428c60" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 35473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "53a326d4fd554a6286d0966b3d954faf" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 35827 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f65940f011484890b8d55cd4d8b9ed8f" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 45093 } health_report { overall_health: HEALTHY } } }
I20260807 10:40:57.832373 6742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:40:57.826508 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48624 (local address 127.20.171.67:45093)
0807 10:40:57.826712 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0807 10:40:57.826718 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:40:57.826738 (+ 20us) server_negotiation.cc:407] Connection header received
0807 10:40:57.826872 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:40:57.826876 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:40:57.826958 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:40:57.827098 (+ 140us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 10:40:57.827522 (+ 424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:40:57.828474 (+ 952us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:40:57.830016 (+ 1542us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:40:57.830459 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:40:57.830564 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:40:57.831036 (+ 472us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 10:40:57.831618 (+ 582us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 10:40:57.831744 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0807 10:40:57.831917 (+ 173us) server_negotiation.cc:299] Negotiation successful
0807 10:40:57.831990 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260807 10:40:57.840873 6540 raft_consensus.cc:1261] T 6c941c8139cd4a85ac547dfbacd68550 P 53a326d4fd554a6286d0966b3d954faf [term 1 FOLLOWER]: Refusing update from remote peer f65940f011484890b8d55cd4d8b9ed8f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 10:40:57.840873 6405 raft_consensus.cc:1261] T 6c941c8139cd4a85ac547dfbacd68550 P 1dff1347dc7e41b1aa1c14f258428c60 [term 1 FOLLOWER]: Refusing update from remote peer f65940f011484890b8d55cd4d8b9ed8f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 10:40:57.842012 6753 consensus_queue.cc:1035] T 6c941c8139cd4a85ac547dfbacd68550 P f65940f011484890b8d55cd4d8b9ed8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1dff1347dc7e41b1aa1c14f258428c60" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 35473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 10:40:57.842374 6749 consensus_queue.cc:1035] T 6c941c8139cd4a85ac547dfbacd68550 P f65940f011484890b8d55cd4d8b9ed8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "53a326d4fd554a6286d0966b3d954faf" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 35827 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 10:40:57.870327 6257 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57162:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 10:40:57.870646 6257 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57162:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 10:40:57.874605 6257 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9df8677149e14e548c2dd7bc148b5bdf: Sending DeleteTablet for 3 replicas of tablet 6c941c8139cd4a85ac547dfbacd68550
I20260807 10:40:57.876127 6520 tablet_service.cc:1514] Processing DeleteTablet for tablet 6c941c8139cd4a85ac547dfbacd68550 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:40:57 UTC) from {username='kudu', principal='kudu/127.20.171.126@KRBTEST.COM'} at 127.0.0.1:43312
I20260807 10:40:57.876121 6385 tablet_service.cc:1514] Processing DeleteTablet for tablet 6c941c8139cd4a85ac547dfbacd68550 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:40:57 UTC) from {username='kudu', principal='kudu/127.20.171.126@KRBTEST.COM'} at 127.0.0.1:48852
I20260807 10:40:57.877400 6658 tablet_service.cc:1514] Processing DeleteTablet for tablet 6c941c8139cd4a85ac547dfbacd68550 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:40:57 UTC) from {username='kudu', principal='kudu/127.20.171.126@KRBTEST.COM'} at 127.0.0.1:48616
I20260807 10:40:57.879470 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 6319
I20260807 10:40:57.895704 6767 tablet_replica.cc:330] T 6c941c8139cd4a85ac547dfbacd68550 P 53a326d4fd554a6286d0966b3d954faf: stopping tablet replica
I20260807 10:40:57.896531 6767 raft_consensus.cc:2229] T 6c941c8139cd4a85ac547dfbacd68550 P 53a326d4fd554a6286d0966b3d954faf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 10:40:57.897435 6767 raft_consensus.cc:2258] T 6c941c8139cd4a85ac547dfbacd68550 P 53a326d4fd554a6286d0966b3d954faf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:40:57.899794 6768 tablet_replica.cc:330] T 6c941c8139cd4a85ac547dfbacd68550 P f65940f011484890b8d55cd4d8b9ed8f: stopping tablet replica
I20260807 10:40:57.900054 6767 ts_tablet_manager.cc:1905] T 6c941c8139cd4a85ac547dfbacd68550 P 53a326d4fd554a6286d0966b3d954faf: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 10:40:57.900291 6768 raft_consensus.cc:2229] T 6c941c8139cd4a85ac547dfbacd68550 P f65940f011484890b8d55cd4d8b9ed8f [term 1 LEADER]: Raft consensus shutting down.
I20260807 10:40:57.902972 6768 raft_consensus.cc:2258] T 6c941c8139cd4a85ac547dfbacd68550 P f65940f011484890b8d55cd4d8b9ed8f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:40:57.903317 6766 tablet_replica.cc:330] T 6c941c8139cd4a85ac547dfbacd68550 P 1dff1347dc7e41b1aa1c14f258428c60: stopping tablet replica
I20260807 10:40:57.904536 6766 raft_consensus.cc:2229] T 6c941c8139cd4a85ac547dfbacd68550 P 1dff1347dc7e41b1aa1c14f258428c60 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 10:40:57.905827 6766 raft_consensus.cc:2258] T 6c941c8139cd4a85ac547dfbacd68550 P 1dff1347dc7e41b1aa1c14f258428c60 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:40:57.906571 6768 ts_tablet_manager.cc:1905] T 6c941c8139cd4a85ac547dfbacd68550 P f65940f011484890b8d55cd4d8b9ed8f: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 07 10:40:57 dist-test-slave-0b58 krb5kdc[6212](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099255, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.171.65@KRBTEST.COM
I20260807 10:40:57.909934 6767 ts_tablet_manager.cc:1918] T 6c941c8139cd4a85ac547dfbacd68550 P 53a326d4fd554a6286d0966b3d954faf: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 10:40:57.910102 6767 log.cc:1196] T 6c941c8139cd4a85ac547dfbacd68550 P 53a326d4fd554a6286d0966b3d954faf: Deleting WAL directory at /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786098956060137-21165-0/minicluster-data/ts-1/wal/wals/6c941c8139cd4a85ac547dfbacd68550
I20260807 10:40:57.910686 6767 ts_tablet_manager.cc:1939] T 6c941c8139cd4a85ac547dfbacd68550 P 53a326d4fd554a6286d0966b3d954faf: Deleting consensus metadata
I20260807 10:40:57.914224 6768 ts_tablet_manager.cc:1918] T 6c941c8139cd4a85ac547dfbacd68550 P f65940f011484890b8d55cd4d8b9ed8f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 10:40:57.914368 6766 ts_tablet_manager.cc:1905] T 6c941c8139cd4a85ac547dfbacd68550 P 1dff1347dc7e41b1aa1c14f258428c60: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 10:40:57.914491 6768 log.cc:1196] T 6c941c8139cd4a85ac547dfbacd68550 P f65940f011484890b8d55cd4d8b9ed8f: Deleting WAL directory at /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786098956060137-21165-0/minicluster-data/ts-2/wal/wals/6c941c8139cd4a85ac547dfbacd68550
I20260807 10:40:57.915132 6768 ts_tablet_manager.cc:1939] T 6c941c8139cd4a85ac547dfbacd68550 P f65940f011484890b8d55cd4d8b9ed8f: Deleting consensus metadata
I20260807 10:40:57.917088 6244 catalog_manager.cc:4841] TS f65940f011484890b8d55cd4d8b9ed8f (127.20.171.67:45093): tablet 6c941c8139cd4a85ac547dfbacd68550 (table test-table [id=a5cc05c3b6ee4ca2af5cc1c86f147243]) successfully deleted
I20260807 10:40:57.917732 6243 catalog_manager.cc:4841] TS 53a326d4fd554a6286d0966b3d954faf (127.20.171.66:35827): tablet 6c941c8139cd4a85ac547dfbacd68550 (table test-table [id=a5cc05c3b6ee4ca2af5cc1c86f147243]) successfully deleted
I20260807 10:40:57.918706 6738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:40:57.880949 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48858 (local address 127.20.171.65:35473)
0807 10:40:57.881189 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0807 10:40:57.881198 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 10:40:57.889716 (+ 8518us) server_negotiation.cc:407] Connection header received
0807 10:40:57.890601 (+ 885us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:40:57.890608 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:40:57.890704 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:40:57.890779 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:40:57.897283 (+ 6504us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:40:57.898623 (+ 1340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:40:57.902789 (+ 4166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:40:57.903502 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:40:57.903651 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:40:57.910058 (+ 6407us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:40:57.910074 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:40:57.910091 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:40:57.910137 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:40:57.914669 (+ 4532us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:40:57.915720 (+ 1051us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:40:57.915730 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:40:57.915734 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:40:57.915916 (+ 182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:40:57.916449 (+ 533us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:40:57.916454 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:40:57.916458 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:40:57.916972 (+ 514us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:40:57.917294 (+ 322us) server_negotiation.cc:1035] Waiting for connection context
0807 10:40:57.917940 (+ 646us) server_negotiation.cc:299] Negotiation successful
0807 10:40:57.918214 (+ 274us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260807 10:40:57.920321 6446 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:40:58.024890 6766 ts_tablet_manager.cc:1918] T 6c941c8139cd4a85ac547dfbacd68550 P 1dff1347dc7e41b1aa1c14f258428c60: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 10:40:58.025180 6766 log.cc:1196] T 6c941c8139cd4a85ac547dfbacd68550 P 1dff1347dc7e41b1aa1c14f258428c60: Deleting WAL directory at /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786098956060137-21165-0/minicluster-data/ts-0/wal/wals/6c941c8139cd4a85ac547dfbacd68550
I20260807 10:40:58.025779 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 6319
I20260807 10:40:58.025857 6766 ts_tablet_manager.cc:1939] T 6c941c8139cd4a85ac547dfbacd68550 P 1dff1347dc7e41b1aa1c14f258428c60: Deleting consensus metadata
W20260807 10:40:58.052073 6244 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.20.171.65:35473 (error 108)
I20260807 10:40:58.052933 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 6457
I20260807 10:40:58.054523 6772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:40:58.053484 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.65:35473 (local address 127.0.0.1:48860)
0807 10:40:58.054145 (+ 661us) negotiation.cc:107] Waiting for socket to connect
0807 10:40:58.054298 (+ 153us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.65:35473: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":510,"thread_start_us":610,"threads_started":1}
W20260807 10:40:58.056108 6244 catalog_manager.cc:4584] TS 1dff1347dc7e41b1aa1c14f258428c60 (127.20.171.65:35473): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 6c941c8139cd4a85ac547dfbacd68550: Network error: Client connection negotiation failed: client connection to 127.20.171.65:35473: connect: Connection refused (error 111)
Aug 07 10:40:58 dist-test-slave-0b58 krb5kdc[6212](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099255, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.171.66@KRBTEST.COM
I20260807 10:40:58.072043 6740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:40:58.053705 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43314 (local address 127.20.171.66:35827)
0807 10:40:58.053920 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0807 10:40:58.053928 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 10:40:58.053953 (+ 25us) server_negotiation.cc:407] Connection header received
0807 10:40:58.054134 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:40:58.054140 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:40:58.054239 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:40:58.054351 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:40:58.056008 (+ 1657us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:40:58.057049 (+ 1041us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:40:58.059022 (+ 1973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:40:58.059382 (+ 360us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:40:58.059469 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:40:58.064989 (+ 5520us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:40:58.065009 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:40:58.065032 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:40:58.065080 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:40:58.069045 (+ 3965us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:40:58.069817 (+ 772us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:40:58.069827 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:40:58.069831 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:40:58.069997 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:40:58.070373 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:40:58.070378 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:40:58.070381 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:40:58.070891 (+ 510us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:40:58.071230 (+ 339us) server_negotiation.cc:1035] Waiting for connection context
0807 10:40:58.071409 (+ 179us) server_negotiation.cc:299] Negotiation successful
0807 10:40:58.071644 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260807 10:40:58.072872 6580 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:40:58.110247 6772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:40:58.109676 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.65:35473 (local address 127.0.0.1:48866)
0807 10:40:58.109934 (+ 258us) negotiation.cc:107] Waiting for socket to connect
0807 10:40:58.110049 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.65:35473: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":93}
I20260807 10:40:58.111526 6772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:40:58.111056 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.65:35473 (local address 127.0.0.1:48872)
0807 10:40:58.111228 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0807 10:40:58.111334 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.65:35473: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
I20260807 10:40:58.167989 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 6457
I20260807 10:40:58.172050 6772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:40:58.171574 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.65:35473 (local address 127.0.0.1:48876)
0807 10:40:58.171797 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0807 10:40:58.171898 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.65:35473: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":84}
I20260807 10:40:58.173297 6772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:40:58.172887 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.65:35473 (local address 127.0.0.1:48878)
0807 10:40:58.173049 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0807 10:40:58.173141 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.65:35473: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
I20260807 10:40:58.195329 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 6592
Aug 07 10:40:58 dist-test-slave-0b58 krb5kdc[6212](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099255, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.171.67@KRBTEST.COM
I20260807 10:40:58.214178 6742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:40:58.196318 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48626 (local address 127.20.171.67:45093)
0807 10:40:58.196537 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0807 10:40:58.196542 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:40:58.196562 (+ 20us) server_negotiation.cc:407] Connection header received
0807 10:40:58.196774 (+ 212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:40:58.196778 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:40:58.196854 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:40:58.196979 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:40:58.198373 (+ 1394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:40:58.199333 (+ 960us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:40:58.201249 (+ 1916us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:40:58.201801 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:40:58.201967 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:40:58.207322 (+ 5355us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:40:58.207335 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:40:58.207353 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:40:58.207404 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:40:58.210906 (+ 3502us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:40:58.211712 (+ 806us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:40:58.211720 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:40:58.211723 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:40:58.211902 (+ 179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:40:58.212388 (+ 486us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:40:58.212393 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:40:58.212395 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:40:58.212784 (+ 389us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:40:58.213163 (+ 379us) server_negotiation.cc:1035] Waiting for connection context
0807 10:40:58.213516 (+ 353us) server_negotiation.cc:299] Negotiation successful
0807 10:40:58.213773 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":95}
I20260807 10:40:58.214936 6718 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:40:58.254133 6772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:40:58.253637 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.65:35473 (local address 127.0.0.1:48880)
0807 10:40:58.253888 (+ 251us) negotiation.cc:107] Waiting for socket to connect
0807 10:40:58.253980 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.65:35473: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":78}
I20260807 10:40:58.255318 6772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:40:58.254880 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.65:35473 (local address 127.0.0.1:48888)
0807 10:40:58.255078 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0807 10:40:58.255163 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.65:35473: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":94}
I20260807 10:40:58.349649 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 6592
I20260807 10:40:58.373873 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 6225
I20260807 10:40:58.375164 6287 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:40:58.490024 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 6225
I20260807 10:40:58.490170 6772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:40:58.489698 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.65:35473 (local address 127.0.0.1:48904)
0807 10:40:58.489909 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0807 10:40:58.489999 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.65:35473: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":77}
2026-08-07T10:40:58Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (4815 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-08-07T10:40:58Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T10:40:58Z Disabled control of system clock
I20260807 10:40:58.587373 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786098956060137-21165-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786098956060137-21165-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786098956060137-21165-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.171.126:40465
--webserver_interface=127.20.171.126
--webserver_port=0
--builtin_ntp_servers=127.20.171.84:38069
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.171.126:40465
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260807 10:40:58.923887 6779 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:40:58.924196 6779 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:40:58.924378 6779 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:40:58.931787 6779 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 10:40:58.931917 6779 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:40:58.932008 6779 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:40:58.932096 6779 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 10:40:58.932184 6779 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 10:40:58.941123 6779 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.171.84:38069
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786098956060137-21165-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786098956060137-21165-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.171.126:40465
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.171.126:40465
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.171.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786098956060137-21165-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:40:58.942386 6779 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:40:58.944227 6779 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:40:58.960593 6785 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:40:58.960548 6787 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:40:58.960637 6784 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:40:58.961477 6779 server_base.cc:1034] running on GCE node
I20260807 10:40:58.962323 6779 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:40:58.963725 6779 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:40:58.964946 6779 hybrid_clock.cc:648] HybridClock initialized: now 1786099258964904 us; error 51 us; skew 500 ppm
I20260807 10:40:58.965298 6779 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 10:40:58.967556 6779 webserver.cc:460] Webserver started at http://127.20.171.126:46295/ using document root <none> and password file <none>
I20260807 10:40:58.968328 6779 fs_manager.cc:359] Metadata directory not provided
I20260807 10:40:58.968465 6779 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:40:58.968792 6779 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:40:58.971673 6779 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786098956060137-21165-0/minicluster-data/master-0/data/instance:
uuid: "d0ddc7819887417e88eab04e64d51c88"
format_stamp: "Formatted at 2026-08-07 10:40:58 on dist-test-slave-0b58"
server_key: "c021641ca223975826139772ce07b747"
server_key_iv: "708479215cb3865e171424c4f895a286"
server_key_version: "encryptionkey@0"
I20260807 10:40:58.972553 6779 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786098956060137-21165-0/minicluster-data/master-0/wal/instance:
uuid: "d0ddc7819887417e88eab04e64d51c88"
format_stamp: "Formatted at 2026-08-07 10:40:58 on dist-test-slave-0b58"
server_key: "c021641ca223975826139772ce07b747"
server_key_iv: "708479215cb3865e171424c4f895a286"
server_key_version: "encryptionkey@0"
I20260807 10:40:58.977645 6779 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.004s
I20260807 10:40:58.981005 6793 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:40:58.982203 6779 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260807 10:40:58.982398 6779 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786098956060137-21165-0/minicluster-data/master-0/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786098956060137-21165-0/minicluster-data/master-0/wal
uuid: "d0ddc7819887417e88eab04e64d51c88"
format_stamp: "Formatted at 2026-08-07 10:40:58 on dist-test-slave-0b58"
server_key: "c021641ca223975826139772ce07b747"
server_key_iv: "708479215cb3865e171424c4f895a286"
server_key_version: "encryptionkey@0"
I20260807 10:40:58.982620 6779 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786098956060137-21165-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786098956060137-21165-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786098956060137-21165-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:40:58.998618 6779 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:40:58.999397 6779 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:40:58.999679 6779 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:40:59.019039 6779 rpc_server.cc:307] RPC server started. Bound to: 127.20.171.126:40465
I20260807 10:40:59.019016 6845 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.171.126:40465 every 8 connection(s)
I20260807 10:40:59.020452 6779 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
I20260807 10:40:59.024106 6846 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:40:59.025372 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 6779
I20260807 10:40:59.025584 21165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786098956060137-21165-0/minicluster-data/master-0/wal/instance
I20260807 10:40:59.026194 21165 external_mini_cluster.cc:1428] Setting key ea0b4e368809bd720c39bd58e42d9d6d
I20260807 10:40:59.039119 6846 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d0ddc7819887417e88eab04e64d51c88: Bootstrap starting.
I20260807 10:40:59.040387 6849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:40:59.028176 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35026 (local address 127.20.171.126:40465)
0807 10:40:59.029404 (+ 1228us) server_negotiation.cc:206] Beginning negotiation
0807 10:40:59.029415 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 10:40:59.029461 (+ 46us) server_negotiation.cc:407] Connection header received
0807 10:40:59.031219 (+ 1758us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:40:59.031242 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:40:59.031729 (+ 487us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:40:59.032147 (+ 418us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:40:59.032813 (+ 666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:40:59.034073 (+ 1260us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:40:59.036067 (+ 1994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:40:59.036823 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:40:59.036957 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:40:59.038185 (+ 1228us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:40:59.038192 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:40:59.038204 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:40:59.038722 (+ 518us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:40:59.038794 (+ 72us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:40:59.038815 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:40:59.038945 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0807 10:40:59.039156 (+ 211us) server_negotiation.cc:299] Negotiation successful
0807 10:40:59.039448 (+ 292us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":774,"thread_start_us":431,"threads_started":1}
I20260807 10:40:59.042415 6846 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d0ddc7819887417e88eab04e64d51c88: Neither blocks nor log segments found. Creating new log.
I20260807 10:40:59.043561 6846 log.cc:824] T 00000000000000000000000000000000 P d0ddc7819887417e88eab04e64d51c88: Log is configured to *not* fsync() on all Append() calls
I20260807 10:40:59.046432 6846 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d0ddc7819887417e88eab04e64d51c88: No bootstrap required, opened a new log
I20260807 10:40:59.054172 6846 raft_consensus.cc:348] T 00000000000000000000000000000000 P d0ddc7819887417e88eab04e64d51c88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d0ddc7819887417e88eab04e64d51c88" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 40465 } }
I20260807 10:40:59.054575 6846 raft_consensus.cc:374] T 00000000000000000000000000000000 P d0ddc7819887417e88eab04e64d51c88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:40:59.054695 6846 raft_consensus.cc:729] T 00000000000000000000000000000000 P d0ddc7819887417e88eab04e64d51c88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0ddc7819887417e88eab04e64d51c88, State: Initialized, Role: FOLLOWER
I20260807 10:40:59.055244 6846 consensus_queue.cc:260] T 00000000000000000000000000000000 P d0ddc7819887417e88eab04e64d51c88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d0ddc7819887417e88eab04e64d51c88" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 40465 } }
I20260807 10:40:59.055496 6846 raft_consensus.cc:388] T 00000000000000000000000000000000 P d0ddc7819887417e88eab04e64d51c88 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 10:40:59.055646 6846 raft_consensus.cc:482] T 00000000000000000000000000000000 P d0ddc7819887417e88eab04e64d51c88 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 10:40:59.055823 6846 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d0ddc7819887417e88eab04e64d51c88 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:40:59.058193 6846 raft_consensus.cc:504] T 00000000000000000000000000000000 P d0ddc7819887417e88eab04e64d51c88 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d0ddc7819887417e88eab04e64d51c88" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 40465 } }
I20260807 10:40:59.058725 6846 leader_election.cc:302] T 00000000000000000000000000000000 P d0ddc7819887417e88eab04e64d51c88 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d0ddc7819887417e88eab04e64d51c88; no voters:
I20260807 10:40:59.059309 6846 leader_election.cc:288] T 00000000000000000000000000000000 P d0ddc7819887417e88eab04e64d51c88 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 10:40:59.059468 6851 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d0ddc7819887417e88eab04e64d51c88 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:40:59.060346 6851 raft_consensus.cc:686] T 00000000000000000000000000000000 P d0ddc7819887417e88eab04e64d51c88 [term 1 LEADER]: Becoming Leader. State: Replica: d0ddc7819887417e88eab04e64d51c88, State: Running, Role: LEADER
I20260807 10:40:59.060928 6851 consensus_queue.cc:237] T 00000000000000000000000000000000 P d0ddc7819887417e88eab04e64d51c88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d0ddc7819887417e88eab04e64d51c88" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 40465 } }
I20260807 10:40:59.061651 6846 sys_catalog.cc:564] T 00000000000000000000000000000000 P d0ddc7819887417e88eab04e64d51c88 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 10:40:59.063710 6852 sys_catalog.cc:455] T 00000000000000000000000000000000 P d0ddc7819887417e88eab04e64d51c88 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d0ddc7819887417e88eab04e64d51c88" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d0ddc7819887417e88eab04e64d51c88" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 40465 } } }
I20260807 10:40:59.064571 6853 sys_catalog.cc:455] T 00000000000000000000000000000000 P d0ddc7819887417e88eab04e64d51c88 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d0ddc7819887417e88eab04e64d51c88. Latest consensus state: current_term: 1 leader_uuid: "d0ddc7819887417e88eab04e64d51c88" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d0ddc7819887417e88eab04e64d51c88" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 40465 } } }
I20260807 10:40:59.064947 6852 sys_catalog.cc:458] T 00000000000000000000000000000000 P d0ddc7819887417e88eab04e64d51c88 [sys.catalog]: This master's current role is: LEADER
I20260807 10:40:59.064991 6853 sys_catalog.cc:458] T 00000000000000000000000000000000 P d0ddc7819887417e88eab04e64d51c88 [sys.catalog]: This master's current role is: LEADER
I20260807 10:40:59.066773 6857 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 10:40:59.071714 6857 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 10:40:59.081228 6857 catalog_manager.cc:1347] Generated new cluster ID: d09a3b2a7e6a4cb6ab8e3871b0442a05
I20260807 10:40:59.081377 6857 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 10:40:59.097107 6857 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 10:40:59.098766 6857 catalog_manager.cc:1504] Loading token signing keys...
I20260807 10:40:59.126503 6857 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d0ddc7819887417e88eab04e64d51c88: Generated new TSK 0
I20260807 10:40:59.127524 6857 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 10:40:59.139046 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786098956060137-21165-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786098956060137-21165-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786098956060137-21165-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786098956060137-21165-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.171.65:0
--local_ip_for_outbound_sockets=127.20.171.65
--webserver_interface=127.20.171.65
--webserver_port=0
--tserver_master_addrs=127.20.171.126:40465
--builtin_ntp_servers=127.20.171.84:38069
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260807 10:40:59.490607 6871 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:40:59.490887 6871 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:40:59.490973 6871 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:40:59.498647 6871 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:40:59.498759 6871 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:40:59.498930 6871 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.171.65
I20260807 10:40:59.508194 6871 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.171.84:38069
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786098956060137-21165-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786098956060137-21165-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.171.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786098956060137-21165-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.171.65
--webserver_port=0
--tserver_master_addrs=127.20.171.126:40465
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.171.65
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786098956060137-21165-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:40:59.509563 6871 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:40:59.511336 6871 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:40:59.524381 6879 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:40:59.524506 6876 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:40:59.524664 6877 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:40:59.525519 6871 server_base.cc:1034] running on GCE node
I20260807 10:40:59.526094 6871 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:40:59.527022 6871 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:40:59.528293 6871 hybrid_clock.cc:648] HybridClock initialized: now 1786099259528210 us; error 49 us; skew 500 ppm
I20260807 10:40:59.528612 6871 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 10:40:59.530905 6871 webserver.cc:460] Webserver started at http://127.20.171.65:37905/ using document root <none> and password file <none>
I20260807 10:40:59.531612 6871 fs_manager.cc:359] Metadata directory not provided
I20260807 10:40:59.531783 6871 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:40:59.532120 6871 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:40:59.535106 6871 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786098956060137-21165-0/minicluster-data/ts-0/data/instance:
uuid: "083ca5b2834d42b982e578de508ecf81"
format_stamp: "Formatted at 2026-08-07 10:40:59 on dist-test-slave-0b58"
server_key: "5b5fbe4a2d482a663b0d1a66e4c54651"
server_key_iv: "a6fccd1f48148eec96fde51094fe8a1f"
server_key_version: "encryptionkey@0"
I20260807 10:40:59.535920 6871 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786098956060137-21165-0/minicluster-data/ts-0/wal/instance:
uuid: "083ca5b2834d42b982e578de508ecf81"
format_stamp: "Formatted at 2026-08-07 10:40:59 on dist-test-slave-0b58"
server_key: "5b5fbe4a2d482a663b0d1a66e4c54651"
server_key_iv: "a6fccd1f48148eec96fde51094fe8a1f"
server_key_version: "encryptionkey@0"
I20260807 10:40:59.541199 6871 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.001s
I20260807 10:40:59.544507 6885 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:40:59.545835 6871 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260807 10:40:59.546010 6871 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786098956060137-21165-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786098956060137-21165-0/minicluster-data/ts-0/wal
uuid: "083ca5b2834d42b982e578de508ecf81"
format_stamp: "Formatted at 2026-08-07 10:40:59 on dist-test-slave-0b58"
server_key: "5b5fbe4a2d482a663b0d1a66e4c54651"
server_key_iv: "a6fccd1f48148eec96fde51094fe8a1f"
server_key_version: "encryptionkey@0"
I20260807 10:40:59.546238 6871 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786098956060137-21165-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786098956060137-21165-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786098956060137-21165-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:40:59.571265 6871 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:40:59.572130 6871 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:40:59.572479 6871 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:40:59.573511 6871 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:40:59.575165 6871 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:40:59.575292 6871 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:40:59.575423 6871 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:40:59.575515 6871 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:40:59.608956 6871 rpc_server.cc:307] RPC server started. Bound to: 127.20.171.65:44085
I20260807 10:40:59.609047 7002 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.171.65:44085 every 8 connection(s)
I20260807 10:40:59.610320 6871 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786098956060137-21165-0/minicluster-data/ts-0/data/info.pb
I20260807 10:40:59.613384 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 6871
I20260807 10:40:59.613612 21165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786098956060137-21165-0/minicluster-data/ts-0/wal/instance
I20260807 10:40:59.614260 21165 external_mini_cluster.cc:1428] Setting key 717594600762004c1127304cceef6c7b
I20260807 10:40:59.617326 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786098956060137-21165-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786098956060137-21165-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786098956060137-21165-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786098956060137-21165-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.171.66:0
--local_ip_for_outbound_sockets=127.20.171.66
--webserver_interface=127.20.171.66
--webserver_port=0
--tserver_master_addrs=127.20.171.126:40465
--builtin_ntp_servers=127.20.171.84:38069
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260807 10:40:59.624543 7005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:40:59.613003 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.65:35251 (local address 127.20.171.126:40465)
0807 10:40:59.613467 (+ 464us) server_negotiation.cc:206] Beginning negotiation
0807 10:40:59.613493 (+ 26us) server_negotiation.cc:399] Waiting for connection header
0807 10:40:59.614929 (+ 1436us) server_negotiation.cc:407] Connection header received
0807 10:40:59.617265 (+ 2336us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:40:59.617271 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:40:59.617373 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:40:59.617490 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:40:59.618614 (+ 1124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:40:59.619365 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:40:59.621011 (+ 1646us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:40:59.621671 (+ 660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:40:59.621819 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:40:59.623510 (+ 1691us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:40:59.623519 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:40:59.623527 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:40:59.623554 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:40:59.623618 (+ 64us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:40:59.623637 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:40:59.623733 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0807 10:40:59.623948 (+ 215us) server_negotiation.cc:299] Negotiation successful
0807 10:40:59.624065 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":359,"thread_start_us":248,"threads_started":1}
I20260807 10:40:59.625438 7006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:40:59.613685 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:40465 (local address 127.20.171.65:35251)
0807 10:40:59.614726 (+ 1041us) negotiation.cc:107] Waiting for socket to connect
0807 10:40:59.614764 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0807 10:40:59.616991 (+ 2227us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:40:59.617735 (+ 744us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:40:59.617744 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:40:59.617842 (+ 98us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:40:59.618437 (+ 595us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:40:59.618455 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:40:59.619529 (+ 1074us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:40:59.619539 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:40:59.620863 (+ 1324us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:40:59.620877 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:40:59.622120 (+ 1243us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:40:59.622128 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:40:59.622441 (+ 313us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:40:59.623169 (+ 728us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 10:40:59.623172 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:40:59.623212 (+ 40us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 10:40:59.623295 (+ 83us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:40:59.623746 (+ 451us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:40:59.623755 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:40:59.623761 (+ 6us) client_negotiation.cc:769] Sending connection context
0807 10:40:59.623906 (+ 145us) client_negotiation.cc:240] Negotiation successful
0807 10:40:59.624209 (+ 303us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":525,"thread_start_us":310,"threads_started":1}
I20260807 10:40:59.627108 7003 heartbeater.cc:347] Connected to a master server at 127.20.171.126:40465
I20260807 10:40:59.627451 7003 heartbeater.cc:464] Registering TS with master...
I20260807 10:40:59.628360 7003 heartbeater.cc:511] Master 127.20.171.126:40465 requested a full tablet report, sending...
I20260807 10:40:59.630678 6811 ts_manager.cc:194] Registered new tserver with Master: 083ca5b2834d42b982e578de508ecf81 (127.20.171.65:44085)
I20260807 10:40:59.632474 6811 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.20.171.65:35251
W20260807 10:40:59.968039 7007 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:40:59.968371 7007 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:40:59.968561 7007 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:40:59.975946 7007 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:40:59.976078 7007 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:40:59.976293 7007 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.171.66
I20260807 10:40:59.985581 7007 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.171.84:38069
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786098956060137-21165-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786098956060137-21165-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.171.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786098956060137-21165-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.171.66
--webserver_port=0
--tserver_master_addrs=127.20.171.126:40465
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.171.66
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786098956060137-21165-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:40:59.987001 7007 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:40:59.988932 7007 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:41:00.002163 7014 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:41:00.002242 7013 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:41:00.002247 7016 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:41:00.003332 7007 server_base.cc:1034] running on GCE node
I20260807 10:41:00.004112 7007 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:41:00.005127 7007 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:41:00.006333 7007 hybrid_clock.cc:648] HybridClock initialized: now 1786099260006290 us; error 31 us; skew 500 ppm
I20260807 10:41:00.006667 7007 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 10:41:00.009109 7007 webserver.cc:460] Webserver started at http://127.20.171.66:46621/ using document root <none> and password file <none>
I20260807 10:41:00.009810 7007 fs_manager.cc:359] Metadata directory not provided
I20260807 10:41:00.009941 7007 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:41:00.010273 7007 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:41:00.013391 7007 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786098956060137-21165-0/minicluster-data/ts-1/data/instance:
uuid: "bd9079434d8a48abb6b2c92aa80eeb8e"
format_stamp: "Formatted at 2026-08-07 10:41:00 on dist-test-slave-0b58"
server_key: "bd4e686a01d10299ac3a92f1ac127059"
server_key_iv: "e355cb68c21dbbcbdcb7dae4b4420ed5"
server_key_version: "encryptionkey@0"
I20260807 10:41:00.014204 7007 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786098956060137-21165-0/minicluster-data/ts-1/wal/instance:
uuid: "bd9079434d8a48abb6b2c92aa80eeb8e"
format_stamp: "Formatted at 2026-08-07 10:41:00 on dist-test-slave-0b58"
server_key: "bd4e686a01d10299ac3a92f1ac127059"
server_key_iv: "e355cb68c21dbbcbdcb7dae4b4420ed5"
server_key_version: "encryptionkey@0"
I20260807 10:41:00.019528 7007 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260807 10:41:00.023841 7022 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:41:00.025380 7007 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 10:41:00.025538 7007 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786098956060137-21165-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786098956060137-21165-0/minicluster-data/ts-1/wal
uuid: "bd9079434d8a48abb6b2c92aa80eeb8e"
format_stamp: "Formatted at 2026-08-07 10:41:00 on dist-test-slave-0b58"
server_key: "bd4e686a01d10299ac3a92f1ac127059"
server_key_iv: "e355cb68c21dbbcbdcb7dae4b4420ed5"
server_key_version: "encryptionkey@0"
I20260807 10:41:00.025764 7007 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786098956060137-21165-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786098956060137-21165-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786098956060137-21165-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:41:00.040056 7007 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:41:00.040913 7007 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:41:00.041219 7007 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:41:00.042151 7007 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:41:00.043545 7007 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:41:00.043673 7007 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:41:00.043799 7007 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:41:00.043890 7007 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:41:00.075946 7007 rpc_server.cc:307] RPC server started. Bound to: 127.20.171.66:38515
I20260807 10:41:00.075999 7139 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.171.66:38515 every 8 connection(s)
I20260807 10:41:00.077327 7007 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786098956060137-21165-0/minicluster-data/ts-1/data/info.pb
I20260807 10:41:00.082378 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 7007
I20260807 10:41:00.082567 21165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786098956060137-21165-0/minicluster-data/ts-1/wal/instance
I20260807 10:41:00.083032 21165 external_mini_cluster.cc:1428] Setting key 976442402bfb28b38610b8db86385a73
I20260807 10:41:00.086246 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786098956060137-21165-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786098956060137-21165-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786098956060137-21165-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786098956060137-21165-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.171.67:0
--local_ip_for_outbound_sockets=127.20.171.67
--webserver_interface=127.20.171.67
--webserver_port=0
--tserver_master_addrs=127.20.171.126:40465
--builtin_ntp_servers=127.20.171.84:38069
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260807 10:41:00.090570 7005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:00.079848 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.66:45751 (local address 127.20.171.126:40465)
0807 10:41:00.080073 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0807 10:41:00.080079 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:41:00.081377 (+ 1298us) server_negotiation.cc:407] Connection header received
0807 10:41:00.083296 (+ 1919us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:41:00.083303 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:41:00.083397 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:41:00.083515 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:41:00.084672 (+ 1157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:00.085634 (+ 962us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:00.087443 (+ 1809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:00.088167 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:00.088360 (+ 193us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:00.089656 (+ 1296us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:41:00.089665 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:41:00.089672 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:41:00.089696 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:41:00.089739 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:41:00.089756 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:41:00.089852 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0807 10:41:00.090062 (+ 210us) server_negotiation.cc:299] Negotiation successful
0807 10:41:00.090173 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260807 10:41:00.091389 7142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:00.080368 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:40465 (local address 127.20.171.66:45751)
0807 10:41:00.081224 (+ 856us) negotiation.cc:107] Waiting for socket to connect
0807 10:41:00.081267 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0807 10:41:00.083002 (+ 1735us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:41:00.083744 (+ 742us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:41:00.083756 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:41:00.083877 (+ 121us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:41:00.084516 (+ 639us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:41:00.084536 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:41:00.085782 (+ 1246us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:41:00.085786 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:41:00.087308 (+ 1522us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:41:00.087321 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:41:00.088448 (+ 1127us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:41:00.088453 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:41:00.088640 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:00.089343 (+ 703us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 10:41:00.089346 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:41:00.089393 (+ 47us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 10:41:00.089466 (+ 73us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:41:00.089854 (+ 388us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:41:00.089863 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:41:00.089868 (+ 5us) client_negotiation.cc:769] Sending connection context
0807 10:41:00.090009 (+ 141us) client_negotiation.cc:240] Negotiation successful
0807 10:41:00.090272 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":447,"thread_start_us":273,"threads_started":1}
I20260807 10:41:00.092985 7140 heartbeater.cc:347] Connected to a master server at 127.20.171.126:40465
I20260807 10:41:00.093291 7140 heartbeater.cc:464] Registering TS with master...
I20260807 10:41:00.094005 7140 heartbeater.cc:511] Master 127.20.171.126:40465 requested a full tablet report, sending...
I20260807 10:41:00.095476 6811 ts_manager.cc:194] Registered new tserver with Master: bd9079434d8a48abb6b2c92aa80eeb8e (127.20.171.66:38515)
I20260807 10:41:00.096671 6811 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.20.171.66:45751
W20260807 10:41:00.433849 7143 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:41:00.434345 7143 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:41:00.434518 7143 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:41:00.442157 7143 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:41:00.442257 7143 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:41:00.442369 7143 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.171.67
I20260807 10:41:00.452332 7143 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.171.84:38069
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786098956060137-21165-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786098956060137-21165-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.171.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786098956060137-21165-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.171.67
--webserver_port=0
--tserver_master_addrs=127.20.171.126:40465
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.171.67
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786098956060137-21165-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:41:00.453634 7143 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:41:00.455441 7143 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:41:00.469081 7150 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:41:00.469012 7152 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:41:00.469708 7143 server_base.cc:1034] running on GCE node
W20260807 10:41:00.469892 7149 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:41:00.470577 7143 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:41:00.471611 7143 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:41:00.472843 7143 hybrid_clock.cc:648] HybridClock initialized: now 1786099260472801 us; error 60 us; skew 500 ppm
I20260807 10:41:00.473160 7143 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 10:41:00.475502 7143 webserver.cc:460] Webserver started at http://127.20.171.67:45609/ using document root <none> and password file <none>
I20260807 10:41:00.476222 7143 fs_manager.cc:359] Metadata directory not provided
I20260807 10:41:00.476392 7143 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:41:00.476732 7143 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:41:00.479609 7143 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786098956060137-21165-0/minicluster-data/ts-2/data/instance:
uuid: "70795fe22ec34d5ba492cf8e3bd1f489"
format_stamp: "Formatted at 2026-08-07 10:41:00 on dist-test-slave-0b58"
server_key: "0ec61547f1138a5c3d9ad5de63ce005c"
server_key_iv: "dc74b33f41974244474ad35f41e41a8d"
server_key_version: "encryptionkey@0"
I20260807 10:41:00.480459 7143 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786098956060137-21165-0/minicluster-data/ts-2/wal/instance:
uuid: "70795fe22ec34d5ba492cf8e3bd1f489"
format_stamp: "Formatted at 2026-08-07 10:41:00 on dist-test-slave-0b58"
server_key: "0ec61547f1138a5c3d9ad5de63ce005c"
server_key_iv: "dc74b33f41974244474ad35f41e41a8d"
server_key_version: "encryptionkey@0"
I20260807 10:41:00.485607 7143 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.003s
I20260807 10:41:00.489281 7158 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:41:00.490561 7143 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260807 10:41:00.490741 7143 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786098956060137-21165-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786098956060137-21165-0/minicluster-data/ts-2/wal
uuid: "70795fe22ec34d5ba492cf8e3bd1f489"
format_stamp: "Formatted at 2026-08-07 10:41:00 on dist-test-slave-0b58"
server_key: "0ec61547f1138a5c3d9ad5de63ce005c"
server_key_iv: "dc74b33f41974244474ad35f41e41a8d"
server_key_version: "encryptionkey@0"
I20260807 10:41:00.490971 7143 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786098956060137-21165-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786098956060137-21165-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786098956060137-21165-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:41:00.511523 7143 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:41:00.512395 7143 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:41:00.512688 7143 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:41:00.513634 7143 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:41:00.515120 7143 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:41:00.515231 7143 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:41:00.515352 7143 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:41:00.515442 7143 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:41:00.549737 7143 rpc_server.cc:307] RPC server started. Bound to: 127.20.171.67:46055
I20260807 10:41:00.549894 7273 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.171.67:46055 every 8 connection(s)
I20260807 10:41:00.551211 7143 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786098956060137-21165-0/minicluster-data/ts-2/data/info.pb
I20260807 10:41:00.560657 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 7143
I20260807 10:41:00.560858 21165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786098956060137-21165-0/minicluster-data/ts-2/wal/instance
I20260807 10:41:00.561492 21165 external_mini_cluster.cc:1428] Setting key 24ec3f6ddb39a07617b0fff449e42a76
I20260807 10:41:00.563946 7005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:00.553861 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.67:53009 (local address 127.20.171.126:40465)
0807 10:41:00.554064 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0807 10:41:00.554068 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 10:41:00.555491 (+ 1423us) server_negotiation.cc:407] Connection header received
0807 10:41:00.557371 (+ 1880us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:41:00.557376 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:41:00.557447 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:41:00.557533 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:41:00.558550 (+ 1017us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:00.559287 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:00.560950 (+ 1663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:00.561576 (+ 626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:00.561710 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:00.563116 (+ 1406us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:41:00.563122 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:41:00.563126 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:41:00.563148 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:41:00.563188 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:41:00.563208 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:41:00.563300 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0807 10:41:00.563565 (+ 265us) server_negotiation.cc:299] Negotiation successful
0807 10:41:00.563674 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260807 10:41:00.565241 7276 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:00.554432 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:40465 (local address 127.20.171.67:53009)
0807 10:41:00.555324 (+ 892us) negotiation.cc:107] Waiting for socket to connect
0807 10:41:00.555360 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0807 10:41:00.557116 (+ 1756us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:41:00.557736 (+ 620us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:41:00.557744 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:41:00.557832 (+ 88us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:41:00.558398 (+ 566us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:41:00.558416 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:41:00.559445 (+ 1029us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:41:00.559448 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:41:00.560769 (+ 1321us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:41:00.560782 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:41:00.561792 (+ 1010us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:41:00.561797 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:41:00.562003 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:00.562795 (+ 792us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 10:41:00.562798 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:41:00.562856 (+ 58us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 10:41:00.562948 (+ 92us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:41:00.563321 (+ 373us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:41:00.563333 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:41:00.563341 (+ 8us) client_negotiation.cc:769] Sending connection context
0807 10:41:00.563529 (+ 188us) client_negotiation.cc:240] Negotiation successful
0807 10:41:00.563960 (+ 431us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":467,"thread_start_us":272,"threads_started":1}
I20260807 10:41:00.566627 7274 heartbeater.cc:347] Connected to a master server at 127.20.171.126:40465
I20260807 10:41:00.567028 7274 heartbeater.cc:464] Registering TS with master...
I20260807 10:41:00.567878 7274 heartbeater.cc:511] Master 127.20.171.126:40465 requested a full tablet report, sending...
I20260807 10:41:00.569259 6811 ts_manager.cc:194] Registered new tserver with Master: 70795fe22ec34d5ba492cf8e3bd1f489 (127.20.171.67:46055)
I20260807 10:41:00.570133 6811 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.20.171.67:53009
I20260807 10:41:00.576776 21165 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 10:41:00.586979 7005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:00.580926 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35032 (local address 127.20.171.126:40465)
0807 10:41:00.581076 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0807 10:41:00.581080 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 10:41:00.581547 (+ 467us) server_negotiation.cc:407] Connection header received
0807 10:41:00.581729 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:41:00.581735 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:41:00.581826 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:41:00.581928 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:41:00.582436 (+ 508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:00.583144 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:00.584599 (+ 1455us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:00.585028 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:00.585156 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:00.586268 (+ 1112us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:41:00.586274 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:41:00.586278 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:41:00.586307 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:41:00.586338 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:41:00.586349 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:41:00.586444 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0807 10:41:00.586587 (+ 143us) server_negotiation.cc:299] Negotiation successful
0807 10:41:00.586679 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260807 10:41:00.590649 6811 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35032:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 10:41:00.597970 6811 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 10:41:00.624661 7287 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:00.611176 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.67:46055 (local address 127.0.0.1:39588)
0807 10:41:00.614021 (+ 2845us) negotiation.cc:107] Waiting for socket to connect
0807 10:41:00.614060 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0807 10:41:00.614763 (+ 703us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:41:00.615586 (+ 823us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:41:00.615590 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:41:00.615630 (+ 40us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:41:00.616140 (+ 510us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:41:00.616166 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:41:00.619580 (+ 3414us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:41:00.619588 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:41:00.621761 (+ 2173us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:41:00.621778 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:41:00.623589 (+ 1811us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:41:00.623597 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:41:00.623804 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:00.623862 (+ 58us) client_negotiation.cc:769] Sending connection context
0807 10:41:00.623984 (+ 122us) client_negotiation.cc:240] Negotiation successful
0807 10:41:00.624183 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2565,"mutex_wait_us":1,"spinlock_wait_cycles":896,"thread_start_us":1343,"threads_started":1}
I20260807 10:41:00.624683 7289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:00.611790 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39588 (local address 127.20.171.67:46055)
0807 10:41:00.613393 (+ 1603us) server_negotiation.cc:206] Beginning negotiation
0807 10:41:00.613402 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 10:41:00.614158 (+ 756us) server_negotiation.cc:407] Connection header received
0807 10:41:00.614935 (+ 777us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:41:00.614942 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:41:00.615145 (+ 203us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:41:00.615288 (+ 143us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:41:00.617970 (+ 2682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:00.619418 (+ 1448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:00.621987 (+ 2569us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:00.623374 (+ 1387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:00.623549 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:00.623835 (+ 286us) server_negotiation.cc:1035] Waiting for connection context
0807 10:41:00.624069 (+ 234us) server_negotiation.cc:299] Negotiation successful
0807 10:41:00.624281 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1433,"thread_start_us":1278,"threads_started":1}
I20260807 10:41:00.625708 7288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:00.611306 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33078 (local address 127.20.171.66:38515)
0807 10:41:00.612172 (+ 866us) server_negotiation.cc:206] Beginning negotiation
0807 10:41:00.612186 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0807 10:41:00.614426 (+ 2240us) server_negotiation.cc:407] Connection header received
0807 10:41:00.614750 (+ 324us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:41:00.614758 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:41:00.614996 (+ 238us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:41:00.615193 (+ 197us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:41:00.617976 (+ 2783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:00.619537 (+ 1561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:00.622323 (+ 2786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:00.623755 (+ 1432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:00.623917 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:00.624145 (+ 228us) server_negotiation.cc:1035] Waiting for connection context
0807 10:41:00.625202 (+ 1057us) server_negotiation.cc:299] Negotiation successful
0807 10:41:00.625360 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":634,"thread_start_us":955,"threads_started":1}
I20260807 10:41:00.626257 7291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:00.613930 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.65:44085 (local address 127.0.0.1:40024)
0807 10:41:00.618339 (+ 4409us) negotiation.cc:107] Waiting for socket to connect
0807 10:41:00.618357 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 10:41:00.618485 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:41:00.619082 (+ 597us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:41:00.619088 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:41:00.619114 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:41:00.619486 (+ 372us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:41:00.619503 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:41:00.621529 (+ 2026us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:41:00.621535 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:41:00.623152 (+ 1617us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:41:00.623172 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:41:00.625414 (+ 2242us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:41:00.625418 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:41:00.625532 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:00.625553 (+ 21us) client_negotiation.cc:769] Sending connection context
0807 10:41:00.625671 (+ 118us) client_negotiation.cc:240] Negotiation successful
0807 10:41:00.625896 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4292,"thread_start_us":4162,"threads_started":1}
I20260807 10:41:00.626588 7290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:00.612578 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.66:38515 (local address 127.0.0.1:33078)
0807 10:41:00.614313 (+ 1735us) negotiation.cc:107] Waiting for socket to connect
0807 10:41:00.614326 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 10:41:00.614523 (+ 197us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:41:00.615509 (+ 986us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:41:00.615520 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:41:00.615554 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:41:00.617771 (+ 2217us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:41:00.617786 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:41:00.619752 (+ 1966us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:41:00.619759 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:41:00.622108 (+ 2349us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:41:00.622122 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:41:00.624301 (+ 2179us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:41:00.624308 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:41:00.624509 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:00.624542 (+ 33us) client_negotiation.cc:769] Sending connection context
0807 10:41:00.624632 (+ 90us) client_negotiation.cc:240] Negotiation successful
0807 10:41:00.624774 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1637,"mutex_wait_us":2,"spinlock_wait_cycles":2304,"thread_start_us":974,"threads_started":1}
I20260807 10:41:00.627051 7292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:00.614474 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40024 (local address 127.20.171.65:44085)
0807 10:41:00.617844 (+ 3370us) server_negotiation.cc:206] Beginning negotiation
0807 10:41:00.617853 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 10:41:00.618473 (+ 620us) server_negotiation.cc:407] Connection header received
0807 10:41:00.618656 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:41:00.618664 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:41:00.618870 (+ 206us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:41:00.619075 (+ 205us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:41:00.619686 (+ 611us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:00.621355 (+ 1669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:00.623343 (+ 1988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:00.624955 (+ 1612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:00.625088 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:00.625314 (+ 226us) server_negotiation.cc:1035] Waiting for connection context
0807 10:41:00.625706 (+ 392us) server_negotiation.cc:299] Negotiation successful
0807 10:41:00.626568 (+ 862us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3195,"thread_start_us":3022,"threads_started":1}
I20260807 10:41:00.628989 7208 tablet_service.cc:1467] Processing CreateTablet for tablet 65e0311316a2475696f18e1aaa8f8591 (DEFAULT_TABLE table=test-table [id=f85bc6c4524d4b5f98a7f2ff0519eebc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:41:00.630127 6935 tablet_service.cc:1467] Processing CreateTablet for tablet 65e0311316a2475696f18e1aaa8f8591 (DEFAULT_TABLE table=test-table [id=f85bc6c4524d4b5f98a7f2ff0519eebc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:41:00.630750 7208 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 65e0311316a2475696f18e1aaa8f8591. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:41:00.630306 7073 tablet_service.cc:1467] Processing CreateTablet for tablet 65e0311316a2475696f18e1aaa8f8591 (DEFAULT_TABLE table=test-table [id=f85bc6c4524d4b5f98a7f2ff0519eebc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:41:00.631428 6935 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 65e0311316a2475696f18e1aaa8f8591. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:41:00.631577 7073 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 65e0311316a2475696f18e1aaa8f8591. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:41:00.635525 7003 heartbeater.cc:503] Master 127.20.171.126:40465 was elected leader, sending a full tablet report...
I20260807 10:41:00.643982 7293 tablet_bootstrap.cc:492] T 65e0311316a2475696f18e1aaa8f8591 P 083ca5b2834d42b982e578de508ecf81: Bootstrap starting.
I20260807 10:41:00.645768 7294 tablet_bootstrap.cc:492] T 65e0311316a2475696f18e1aaa8f8591 P bd9079434d8a48abb6b2c92aa80eeb8e: Bootstrap starting.
I20260807 10:41:00.646843 7295 tablet_bootstrap.cc:492] T 65e0311316a2475696f18e1aaa8f8591 P 70795fe22ec34d5ba492cf8e3bd1f489: Bootstrap starting.
I20260807 10:41:00.649044 7293 tablet_bootstrap.cc:654] T 65e0311316a2475696f18e1aaa8f8591 P 083ca5b2834d42b982e578de508ecf81: Neither blocks nor log segments found. Creating new log.
I20260807 10:41:00.649385 7294 tablet_bootstrap.cc:654] T 65e0311316a2475696f18e1aaa8f8591 P bd9079434d8a48abb6b2c92aa80eeb8e: Neither blocks nor log segments found. Creating new log.
I20260807 10:41:00.650251 7295 tablet_bootstrap.cc:654] T 65e0311316a2475696f18e1aaa8f8591 P 70795fe22ec34d5ba492cf8e3bd1f489: Neither blocks nor log segments found. Creating new log.
I20260807 10:41:00.650595 7293 log.cc:824] T 65e0311316a2475696f18e1aaa8f8591 P 083ca5b2834d42b982e578de508ecf81: Log is configured to *not* fsync() on all Append() calls
I20260807 10:41:00.650596 7294 log.cc:824] T 65e0311316a2475696f18e1aaa8f8591 P bd9079434d8a48abb6b2c92aa80eeb8e: Log is configured to *not* fsync() on all Append() calls
I20260807 10:41:00.651388 7295 log.cc:824] T 65e0311316a2475696f18e1aaa8f8591 P 70795fe22ec34d5ba492cf8e3bd1f489: Log is configured to *not* fsync() on all Append() calls
I20260807 10:41:00.653807 7294 tablet_bootstrap.cc:492] T 65e0311316a2475696f18e1aaa8f8591 P bd9079434d8a48abb6b2c92aa80eeb8e: No bootstrap required, opened a new log
I20260807 10:41:00.654111 7294 ts_tablet_manager.cc:1397] T 65e0311316a2475696f18e1aaa8f8591 P bd9079434d8a48abb6b2c92aa80eeb8e: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.000s
I20260807 10:41:00.654527 7293 tablet_bootstrap.cc:492] T 65e0311316a2475696f18e1aaa8f8591 P 083ca5b2834d42b982e578de508ecf81: No bootstrap required, opened a new log
I20260807 10:41:00.654812 7295 tablet_bootstrap.cc:492] T 65e0311316a2475696f18e1aaa8f8591 P 70795fe22ec34d5ba492cf8e3bd1f489: No bootstrap required, opened a new log
I20260807 10:41:00.654821 7293 ts_tablet_manager.cc:1397] T 65e0311316a2475696f18e1aaa8f8591 P 083ca5b2834d42b982e578de508ecf81: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.005s
I20260807 10:41:00.655068 7295 ts_tablet_manager.cc:1397] T 65e0311316a2475696f18e1aaa8f8591 P 70795fe22ec34d5ba492cf8e3bd1f489: Time spent bootstrapping tablet: real 0.008s user 0.003s sys 0.003s
I20260807 10:41:00.662801 7294 raft_consensus.cc:348] T 65e0311316a2475696f18e1aaa8f8591 P bd9079434d8a48abb6b2c92aa80eeb8e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9079434d8a48abb6b2c92aa80eeb8e" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 38515 } } peers { permanent_uuid: "70795fe22ec34d5ba492cf8e3bd1f489" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 46055 } } peers { permanent_uuid: "083ca5b2834d42b982e578de508ecf81" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 44085 } }
I20260807 10:41:00.663307 7294 raft_consensus.cc:374] T 65e0311316a2475696f18e1aaa8f8591 P bd9079434d8a48abb6b2c92aa80eeb8e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:41:00.663410 7294 raft_consensus.cc:729] T 65e0311316a2475696f18e1aaa8f8591 P bd9079434d8a48abb6b2c92aa80eeb8e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd9079434d8a48abb6b2c92aa80eeb8e, State: Initialized, Role: FOLLOWER
I20260807 10:41:00.664067 7294 consensus_queue.cc:260] T 65e0311316a2475696f18e1aaa8f8591 P bd9079434d8a48abb6b2c92aa80eeb8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9079434d8a48abb6b2c92aa80eeb8e" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 38515 } } peers { permanent_uuid: "70795fe22ec34d5ba492cf8e3bd1f489" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 46055 } } peers { permanent_uuid: "083ca5b2834d42b982e578de508ecf81" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 44085 } }
I20260807 10:41:00.665233 7140 heartbeater.cc:503] Master 127.20.171.126:40465 was elected leader, sending a full tablet report...
I20260807 10:41:00.665588 7293 raft_consensus.cc:348] T 65e0311316a2475696f18e1aaa8f8591 P 083ca5b2834d42b982e578de508ecf81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9079434d8a48abb6b2c92aa80eeb8e" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 38515 } } peers { permanent_uuid: "70795fe22ec34d5ba492cf8e3bd1f489" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 46055 } } peers { permanent_uuid: "083ca5b2834d42b982e578de508ecf81" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 44085 } }
I20260807 10:41:00.666011 7293 raft_consensus.cc:374] T 65e0311316a2475696f18e1aaa8f8591 P 083ca5b2834d42b982e578de508ecf81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:41:00.666131 7293 raft_consensus.cc:729] T 65e0311316a2475696f18e1aaa8f8591 P 083ca5b2834d42b982e578de508ecf81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 083ca5b2834d42b982e578de508ecf81, State: Initialized, Role: FOLLOWER
I20260807 10:41:00.666389 7295 raft_consensus.cc:348] T 65e0311316a2475696f18e1aaa8f8591 P 70795fe22ec34d5ba492cf8e3bd1f489 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9079434d8a48abb6b2c92aa80eeb8e" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 38515 } } peers { permanent_uuid: "70795fe22ec34d5ba492cf8e3bd1f489" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 46055 } } peers { permanent_uuid: "083ca5b2834d42b982e578de508ecf81" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 44085 } }
I20260807 10:41:00.666800 7295 raft_consensus.cc:374] T 65e0311316a2475696f18e1aaa8f8591 P 70795fe22ec34d5ba492cf8e3bd1f489 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:41:00.666898 7295 raft_consensus.cc:729] T 65e0311316a2475696f18e1aaa8f8591 P 70795fe22ec34d5ba492cf8e3bd1f489 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70795fe22ec34d5ba492cf8e3bd1f489, State: Initialized, Role: FOLLOWER
I20260807 10:41:00.666877 7293 consensus_queue.cc:260] T 65e0311316a2475696f18e1aaa8f8591 P 083ca5b2834d42b982e578de508ecf81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9079434d8a48abb6b2c92aa80eeb8e" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 38515 } } peers { permanent_uuid: "70795fe22ec34d5ba492cf8e3bd1f489" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 46055 } } peers { permanent_uuid: "083ca5b2834d42b982e578de508ecf81" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 44085 } }
I20260807 10:41:00.667258 7294 ts_tablet_manager.cc:1428] T 65e0311316a2475696f18e1aaa8f8591 P bd9079434d8a48abb6b2c92aa80eeb8e: Time spent starting tablet: real 0.013s user 0.009s sys 0.004s
I20260807 10:41:00.667647 7295 consensus_queue.cc:260] T 65e0311316a2475696f18e1aaa8f8591 P 70795fe22ec34d5ba492cf8e3bd1f489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9079434d8a48abb6b2c92aa80eeb8e" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 38515 } } peers { permanent_uuid: "70795fe22ec34d5ba492cf8e3bd1f489" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 46055 } } peers { permanent_uuid: "083ca5b2834d42b982e578de508ecf81" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 44085 } }
I20260807 10:41:00.669005 7274 heartbeater.cc:503] Master 127.20.171.126:40465 was elected leader, sending a full tablet report...
I20260807 10:41:00.669827 7295 ts_tablet_manager.cc:1428] T 65e0311316a2475696f18e1aaa8f8591 P 70795fe22ec34d5ba492cf8e3bd1f489: Time spent starting tablet: real 0.015s user 0.013s sys 0.002s
I20260807 10:41:00.671597 7293 ts_tablet_manager.cc:1428] T 65e0311316a2475696f18e1aaa8f8591 P 083ca5b2834d42b982e578de508ecf81: Time spent starting tablet: real 0.017s user 0.017s sys 0.000s
I20260807 10:41:00.758270 7300 raft_consensus.cc:482] T 65e0311316a2475696f18e1aaa8f8591 P 083ca5b2834d42b982e578de508ecf81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 10:41:00.758607 7300 raft_consensus.cc:504] T 65e0311316a2475696f18e1aaa8f8591 P 083ca5b2834d42b982e578de508ecf81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9079434d8a48abb6b2c92aa80eeb8e" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 38515 } } peers { permanent_uuid: "70795fe22ec34d5ba492cf8e3bd1f489" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 46055 } } peers { permanent_uuid: "083ca5b2834d42b982e578de508ecf81" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 44085 } }
I20260807 10:41:00.760299 7300 leader_election.cc:288] T 65e0311316a2475696f18e1aaa8f8591 P 083ca5b2834d42b982e578de508ecf81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd9079434d8a48abb6b2c92aa80eeb8e (127.20.171.66:38515), 70795fe22ec34d5ba492cf8e3bd1f489 (127.20.171.67:46055)
I20260807 10:41:00.767452 7289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:00.760919 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.65:39105 (local address 127.20.171.67:46055)
0807 10:41:00.761170 (+ 251us) server_negotiation.cc:206] Beginning negotiation
0807 10:41:00.761178 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 10:41:00.761753 (+ 575us) server_negotiation.cc:407] Connection header received
0807 10:41:00.761994 (+ 241us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:41:00.762004 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:41:00.762106 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:41:00.762203 (+ 97us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:41:00.762919 (+ 716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:00.763811 (+ 892us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:00.765776 (+ 1965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:00.766567 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:00.766748 (+ 181us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:00.766843 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0807 10:41:00.767083 (+ 240us) server_negotiation.cc:299] Negotiation successful
0807 10:41:00.767202 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260807 10:41:00.767699 7288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:00.760690 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.65:58479 (local address 127.20.171.66:38515)
0807 10:41:00.760902 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0807 10:41:00.760911 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 10:41:00.762073 (+ 1162us) server_negotiation.cc:407] Connection header received
0807 10:41:00.762344 (+ 271us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:41:00.762349 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:41:00.762466 (+ 117us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:41:00.762536 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:41:00.763364 (+ 828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:00.764089 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:00.766018 (+ 1929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:00.766770 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:00.766946 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:00.767015 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0807 10:41:00.767294 (+ 279us) server_negotiation.cc:299] Negotiation successful
0807 10:41:00.767425 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260807 10:41:00.767769 7302 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:00.760732 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.66:38515 (local address 127.20.171.65:58479)
0807 10:41:00.761916 (+ 1184us) negotiation.cc:107] Waiting for socket to connect
0807 10:41:00.761962 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0807 10:41:00.762099 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:41:00.762729 (+ 630us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:41:00.762733 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:41:00.762759 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:41:00.763189 (+ 430us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:41:00.763202 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:41:00.764234 (+ 1032us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:41:00.764242 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:41:00.765818 (+ 1576us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:41:00.765831 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:41:00.766976 (+ 1145us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:41:00.766982 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:41:00.767137 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:00.767159 (+ 22us) client_negotiation.cc:769] Sending connection context
0807 10:41:00.767263 (+ 104us) client_negotiation.cc:240] Negotiation successful
0807 10:41:00.767394 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1079,"mutex_wait_us":58,"thread_start_us":430,"threads_started":1}
I20260807 10:41:00.767828 7303 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:00.760584 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.67:46055 (local address 127.20.171.65:39105)
0807 10:41:00.761618 (+ 1034us) negotiation.cc:107] Waiting for socket to connect
0807 10:41:00.761637 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 10:41:00.761832 (+ 195us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:41:00.762298 (+ 466us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:41:00.762303 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:41:00.762329 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:41:00.762709 (+ 380us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:41:00.762721 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:41:00.763948 (+ 1227us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:41:00.763954 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:41:00.765583 (+ 1629us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:41:00.765596 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:41:00.766753 (+ 1157us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:41:00.766759 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:41:00.766927 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:00.766953 (+ 26us) client_negotiation.cc:769] Sending connection context
0807 10:41:00.767056 (+ 103us) client_negotiation.cc:240] Negotiation successful
0807 10:41:00.767180 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":882,"mutex_wait_us":33,"thread_start_us":994,"threads_started":1}
I20260807 10:41:00.768985 7095 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "65e0311316a2475696f18e1aaa8f8591" candidate_uuid: "083ca5b2834d42b982e578de508ecf81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd9079434d8a48abb6b2c92aa80eeb8e" is_pre_election: true
I20260807 10:41:00.768983 7229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "65e0311316a2475696f18e1aaa8f8591" candidate_uuid: "083ca5b2834d42b982e578de508ecf81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70795fe22ec34d5ba492cf8e3bd1f489" is_pre_election: true
I20260807 10:41:00.769608 7095 raft_consensus.cc:2454] T 65e0311316a2475696f18e1aaa8f8591 P bd9079434d8a48abb6b2c92aa80eeb8e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 083ca5b2834d42b982e578de508ecf81 in term 0.
I20260807 10:41:00.769591 7229 raft_consensus.cc:2454] T 65e0311316a2475696f18e1aaa8f8591 P 70795fe22ec34d5ba492cf8e3bd1f489 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 083ca5b2834d42b982e578de508ecf81 in term 0.
I20260807 10:41:00.770407 6886 leader_election.cc:302] T 65e0311316a2475696f18e1aaa8f8591 P 083ca5b2834d42b982e578de508ecf81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 083ca5b2834d42b982e578de508ecf81, 70795fe22ec34d5ba492cf8e3bd1f489; no voters:
I20260807 10:41:00.770852 7300 raft_consensus.cc:2781] T 65e0311316a2475696f18e1aaa8f8591 P 083ca5b2834d42b982e578de508ecf81 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 10:41:00.771028 7300 raft_consensus.cc:482] T 65e0311316a2475696f18e1aaa8f8591 P 083ca5b2834d42b982e578de508ecf81 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 10:41:00.771154 7300 raft_consensus.cc:3037] T 65e0311316a2475696f18e1aaa8f8591 P 083ca5b2834d42b982e578de508ecf81 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:41:00.773500 7300 raft_consensus.cc:504] T 65e0311316a2475696f18e1aaa8f8591 P 083ca5b2834d42b982e578de508ecf81 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9079434d8a48abb6b2c92aa80eeb8e" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 38515 } } peers { permanent_uuid: "70795fe22ec34d5ba492cf8e3bd1f489" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 46055 } } peers { permanent_uuid: "083ca5b2834d42b982e578de508ecf81" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 44085 } }
I20260807 10:41:00.774205 7300 leader_election.cc:288] T 65e0311316a2475696f18e1aaa8f8591 P 083ca5b2834d42b982e578de508ecf81 [CANDIDATE]: Term 1 election: Requested vote from peers bd9079434d8a48abb6b2c92aa80eeb8e (127.20.171.66:38515), 70795fe22ec34d5ba492cf8e3bd1f489 (127.20.171.67:46055)
I20260807 10:41:00.774729 7229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "65e0311316a2475696f18e1aaa8f8591" candidate_uuid: "083ca5b2834d42b982e578de508ecf81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70795fe22ec34d5ba492cf8e3bd1f489"
I20260807 10:41:00.774724 7095 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "65e0311316a2475696f18e1aaa8f8591" candidate_uuid: "083ca5b2834d42b982e578de508ecf81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd9079434d8a48abb6b2c92aa80eeb8e"
I20260807 10:41:00.774956 7095 raft_consensus.cc:3037] T 65e0311316a2475696f18e1aaa8f8591 P bd9079434d8a48abb6b2c92aa80eeb8e [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:41:00.774968 7229 raft_consensus.cc:3037] T 65e0311316a2475696f18e1aaa8f8591 P 70795fe22ec34d5ba492cf8e3bd1f489 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:41:00.777387 7095 raft_consensus.cc:2454] T 65e0311316a2475696f18e1aaa8f8591 P bd9079434d8a48abb6b2c92aa80eeb8e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 083ca5b2834d42b982e578de508ecf81 in term 1.
I20260807 10:41:00.777392 7229 raft_consensus.cc:2454] T 65e0311316a2475696f18e1aaa8f8591 P 70795fe22ec34d5ba492cf8e3bd1f489 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 083ca5b2834d42b982e578de508ecf81 in term 1.
I20260807 10:41:00.777822 6888 leader_election.cc:302] T 65e0311316a2475696f18e1aaa8f8591 P 083ca5b2834d42b982e578de508ecf81 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 083ca5b2834d42b982e578de508ecf81, bd9079434d8a48abb6b2c92aa80eeb8e; no voters:
I20260807 10:41:00.778160 7300 raft_consensus.cc:2781] T 65e0311316a2475696f18e1aaa8f8591 P 083ca5b2834d42b982e578de508ecf81 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:41:00.778661 7300 raft_consensus.cc:686] T 65e0311316a2475696f18e1aaa8f8591 P 083ca5b2834d42b982e578de508ecf81 [term 1 LEADER]: Becoming Leader. State: Replica: 083ca5b2834d42b982e578de508ecf81, State: Running, Role: LEADER
I20260807 10:41:00.779147 7300 consensus_queue.cc:237] T 65e0311316a2475696f18e1aaa8f8591 P 083ca5b2834d42b982e578de508ecf81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9079434d8a48abb6b2c92aa80eeb8e" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 38515 } } peers { permanent_uuid: "70795fe22ec34d5ba492cf8e3bd1f489" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 46055 } } peers { permanent_uuid: "083ca5b2834d42b982e578de508ecf81" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 44085 } }
I20260807 10:41:00.784090 6810 catalog_manager.cc:5495] T 65e0311316a2475696f18e1aaa8f8591 P 083ca5b2834d42b982e578de508ecf81 reported cstate change: term changed from 0 to 1, leader changed from <none> to 083ca5b2834d42b982e578de508ecf81 (127.20.171.65). New cstate: current_term: 1 leader_uuid: "083ca5b2834d42b982e578de508ecf81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd9079434d8a48abb6b2c92aa80eeb8e" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 38515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "70795fe22ec34d5ba492cf8e3bd1f489" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 46055 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "083ca5b2834d42b982e578de508ecf81" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 44085 } health_report { overall_health: HEALTHY } } }
W20260807 10:41:00.803143 7275 tablet.cc:2369] T 65e0311316a2475696f18e1aaa8f8591 P 70795fe22ec34d5ba492cf8e3bd1f489: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 10:41:00.814846 7292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:00.808045 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40026 (local address 127.20.171.65:44085)
0807 10:41:00.808227 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0807 10:41:00.808232 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:41:00.808247 (+ 15us) server_negotiation.cc:407] Connection header received
0807 10:41:00.808407 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:41:00.808411 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:41:00.808505 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:41:00.808665 (+ 160us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 10:41:00.809076 (+ 411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:00.809794 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:00.812036 (+ 2242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:00.812806 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:00.812950 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:00.813564 (+ 614us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 10:41:00.814203 (+ 639us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 10:41:00.814328 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0807 10:41:00.814480 (+ 152us) server_negotiation.cc:299] Negotiation successful
0807 10:41:00.814549 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260807 10:41:00.825409 7229 raft_consensus.cc:1261] T 65e0311316a2475696f18e1aaa8f8591 P 70795fe22ec34d5ba492cf8e3bd1f489 [term 1 FOLLOWER]: Refusing update from remote peer 083ca5b2834d42b982e578de508ecf81: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 10:41:00.825466 7095 raft_consensus.cc:1261] T 65e0311316a2475696f18e1aaa8f8591 P bd9079434d8a48abb6b2c92aa80eeb8e [term 1 FOLLOWER]: Refusing update from remote peer 083ca5b2834d42b982e578de508ecf81: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 10:41:00.826632 7304 consensus_queue.cc:1035] T 65e0311316a2475696f18e1aaa8f8591 P 083ca5b2834d42b982e578de508ecf81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd9079434d8a48abb6b2c92aa80eeb8e" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 38515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 10:41:00.827042 7300 consensus_queue.cc:1035] T 65e0311316a2475696f18e1aaa8f8591 P 083ca5b2834d42b982e578de508ecf81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70795fe22ec34d5ba492cf8e3bd1f489" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 46055 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260807 10:41:00.829427 7141 tablet.cc:2369] T 65e0311316a2475696f18e1aaa8f8591 P bd9079434d8a48abb6b2c92aa80eeb8e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 10:41:00.838460 7307 mvcc.cc:205] Tried to move back new op lower bound from 7315862572328775680 to 7315862572155531264. Current Snapshot: MvccSnapshot[applied={T|T < 7315862572328775680}]
I20260807 10:41:00.851055 6810 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:35032:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 10:41:00.852140 6810 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:35032:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 10:41:00.860160 7073 tablet_service.cc:1514] Processing DeleteTablet for tablet 65e0311316a2475696f18e1aaa8f8591 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:41:00 UTC) from {username='slave'} at 127.0.0.1:33078
I20260807 10:41:00.862349 6935 tablet_service.cc:1514] Processing DeleteTablet for tablet 65e0311316a2475696f18e1aaa8f8591 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:41:00 UTC) from {username='slave'} at 127.0.0.1:40024
I20260807 10:41:00.863919 7318 tablet_replica.cc:330] T 65e0311316a2475696f18e1aaa8f8591 P 083ca5b2834d42b982e578de508ecf81: stopping tablet replica
I20260807 10:41:00.864524 7318 raft_consensus.cc:2229] T 65e0311316a2475696f18e1aaa8f8591 P 083ca5b2834d42b982e578de508ecf81 [term 1 LEADER]: Raft consensus shutting down.
I20260807 10:41:00.864673 6810 catalog_manager.cc:5782] T 00000000000000000000000000000000 P d0ddc7819887417e88eab04e64d51c88: Sending DeleteTablet for 3 replicas of tablet 65e0311316a2475696f18e1aaa8f8591
I20260807 10:41:00.865211 7317 tablet_replica.cc:330] T 65e0311316a2475696f18e1aaa8f8591 P bd9079434d8a48abb6b2c92aa80eeb8e: stopping tablet replica
I20260807 10:41:00.865458 7073 tablet_service.cc:1514] Processing DeleteTablet for tablet 65e0311316a2475696f18e1aaa8f8591 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:41:00 UTC) from {username='slave'} at 127.0.0.1:33078
I20260807 10:41:00.866475 6935 tablet_service.cc:1514] Processing DeleteTablet for tablet 65e0311316a2475696f18e1aaa8f8591 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:41:00 UTC) from {username='slave'} at 127.0.0.1:40024
I20260807 10:41:00.866590 7208 tablet_service.cc:1514] Processing DeleteTablet for tablet 65e0311316a2475696f18e1aaa8f8591 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:41:00 UTC) from {username='slave'} at 127.0.0.1:39588
I20260807 10:41:00.867599 7319 tablet_replica.cc:330] T 65e0311316a2475696f18e1aaa8f8591 P 70795fe22ec34d5ba492cf8e3bd1f489: stopping tablet replica
I20260807 10:41:00.867991 7319 raft_consensus.cc:2229] T 65e0311316a2475696f18e1aaa8f8591 P 70795fe22ec34d5ba492cf8e3bd1f489 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 10:41:00.868604 7319 raft_consensus.cc:2258] T 65e0311316a2475696f18e1aaa8f8591 P 70795fe22ec34d5ba492cf8e3bd1f489 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:41:00.871160 7319 ts_tablet_manager.cc:1905] T 65e0311316a2475696f18e1aaa8f8591 P 70795fe22ec34d5ba492cf8e3bd1f489: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 10:41:00.872546 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 6871
I20260807 10:41:00.875851 7318 raft_consensus.cc:2258] T 65e0311316a2475696f18e1aaa8f8591 P 083ca5b2834d42b982e578de508ecf81 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:41:00.877645 7318 ts_tablet_manager.cc:1905] T 65e0311316a2475696f18e1aaa8f8591 P 083ca5b2834d42b982e578de508ecf81: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 10:41:00.879643 7317 raft_consensus.cc:2229] T 65e0311316a2475696f18e1aaa8f8591 P bd9079434d8a48abb6b2c92aa80eeb8e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 10:41:00.879817 7319 ts_tablet_manager.cc:1918] T 65e0311316a2475696f18e1aaa8f8591 P 70795fe22ec34d5ba492cf8e3bd1f489: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 10:41:00.879999 7319 log.cc:1196] T 65e0311316a2475696f18e1aaa8f8591 P 70795fe22ec34d5ba492cf8e3bd1f489: Deleting WAL directory at /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786098956060137-21165-0/minicluster-data/ts-2/wal/wals/65e0311316a2475696f18e1aaa8f8591
I20260807 10:41:00.880584 7319 ts_tablet_manager.cc:1939] T 65e0311316a2475696f18e1aaa8f8591 P 70795fe22ec34d5ba492cf8e3bd1f489: Deleting consensus metadata
I20260807 10:41:00.881116 7317 raft_consensus.cc:2258] T 65e0311316a2475696f18e1aaa8f8591 P bd9079434d8a48abb6b2c92aa80eeb8e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:41:00.882543 6794 catalog_manager.cc:4841] TS 70795fe22ec34d5ba492cf8e3bd1f489 (127.20.171.67:46055): tablet 65e0311316a2475696f18e1aaa8f8591 (table test-table [id=f85bc6c4524d4b5f98a7f2ff0519eebc]) successfully deleted
I20260807 10:41:00.883368 7317 ts_tablet_manager.cc:1905] T 65e0311316a2475696f18e1aaa8f8591 P bd9079434d8a48abb6b2c92aa80eeb8e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 10:41:00.884498 7318 ts_tablet_manager.cc:1918] T 65e0311316a2475696f18e1aaa8f8591 P 083ca5b2834d42b982e578de508ecf81: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 10:41:00.884685 7318 log.cc:1196] T 65e0311316a2475696f18e1aaa8f8591 P 083ca5b2834d42b982e578de508ecf81: Deleting WAL directory at /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786098956060137-21165-0/minicluster-data/ts-0/wal/wals/65e0311316a2475696f18e1aaa8f8591
I20260807 10:41:00.885198 7318 ts_tablet_manager.cc:1939] T 65e0311316a2475696f18e1aaa8f8591 P 083ca5b2834d42b982e578de508ecf81: Deleting consensus metadata
W20260807 10:41:00.890424 6796 catalog_manager.cc:4808] TS 083ca5b2834d42b982e578de508ecf81 (127.20.171.65:44085): delete failed for tablet 65e0311316a2475696f18e1aaa8f8591 because the tablet was not found. No further retry: Not found: Tablet not found: 65e0311316a2475696f18e1aaa8f8591
I20260807 10:41:00.890902 7317 ts_tablet_manager.cc:1918] T 65e0311316a2475696f18e1aaa8f8591 P bd9079434d8a48abb6b2c92aa80eeb8e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 10:41:00.891163 7317 log.cc:1196] T 65e0311316a2475696f18e1aaa8f8591 P bd9079434d8a48abb6b2c92aa80eeb8e: Deleting WAL directory at /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786098956060137-21165-0/minicluster-data/ts-1/wal/wals/65e0311316a2475696f18e1aaa8f8591
I20260807 10:41:00.891752 7317 ts_tablet_manager.cc:1939] T 65e0311316a2475696f18e1aaa8f8591 P bd9079434d8a48abb6b2c92aa80eeb8e: Deleting consensus metadata
W20260807 10:41:00.893934 6796 catalog_manager.cc:4808] TS bd9079434d8a48abb6b2c92aa80eeb8e (127.20.171.66:38515): delete failed for tablet 65e0311316a2475696f18e1aaa8f8591 because the tablet was not found. No further retry: Not found: Tablet not found: 65e0311316a2475696f18e1aaa8f8591
I20260807 10:41:00.894699 7292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:00.875186 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40040 (local address 127.20.171.65:44085)
0807 10:41:00.875389 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0807 10:41:00.875396 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:41:00.886405 (+ 11009us) server_negotiation.cc:407] Connection header received
0807 10:41:00.886602 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:41:00.886609 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:41:00.886728 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:41:00.886877 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:41:00.887828 (+ 951us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:00.889095 (+ 1267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:00.891045 (+ 1950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:00.891583 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:00.891736 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:00.893006 (+ 1270us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:41:00.893015 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:41:00.893027 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:41:00.893770 (+ 743us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:41:00.893828 (+ 58us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:41:00.893854 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:41:00.893966 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0807 10:41:00.894201 (+ 235us) server_negotiation.cc:299] Negotiation successful
0807 10:41:00.894328 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260807 10:41:00.895440 6998 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:41:00.993978 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 6871
I20260807 10:41:01.014873 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 7007
I20260807 10:41:01.022044 7288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:01.015672 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33080 (local address 127.20.171.66:38515)
0807 10:41:01.015890 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0807 10:41:01.015897 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:41:01.015918 (+ 21us) server_negotiation.cc:407] Connection header received
0807 10:41:01.016123 (+ 205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:41:01.016132 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:41:01.016216 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:41:01.016369 (+ 153us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:41:01.016769 (+ 400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:01.017526 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:01.018864 (+ 1338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:01.019272 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:01.019410 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:01.020632 (+ 1222us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:41:01.020642 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:41:01.020657 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:41:01.021263 (+ 606us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:41:01.021317 (+ 54us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:41:01.021337 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:41:01.021469 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0807 10:41:01.021605 (+ 136us) server_negotiation.cc:299] Negotiation successful
0807 10:41:01.021715 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260807 10:41:01.022747 7135 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:41:01.118563 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 7007
I20260807 10:41:01.139828 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 7143
I20260807 10:41:01.147262 7289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:01.140669 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39604 (local address 127.20.171.67:46055)
0807 10:41:01.140844 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0807 10:41:01.140848 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 10:41:01.140870 (+ 22us) server_negotiation.cc:407] Connection header received
0807 10:41:01.141022 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:41:01.141026 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:41:01.141124 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:41:01.141237 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:41:01.141707 (+ 470us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:01.142462 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:01.143792 (+ 1330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:01.144209 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:01.144672 (+ 463us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:01.145937 (+ 1265us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:41:01.145946 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:41:01.145962 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:41:01.146560 (+ 598us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:41:01.146608 (+ 48us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:41:01.146627 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:41:01.146723 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0807 10:41:01.146819 (+ 96us) server_negotiation.cc:299] Negotiation successful
0807 10:41:01.146917 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260807 10:41:01.147897 7269 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:41:01.237834 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 7143
I20260807 10:41:01.258240 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 6779
I20260807 10:41:01.259341 6841 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:41:01.371121 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 6779
2026-08-07T10:41:01Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (2879 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786098956060137-21165-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 10:41:01 dist-test-slave-0b58 krb5kdc[7327](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 10:41:01 dist-test-slave-0b58 krb5kdc[7327](info): set up 2 sockets
Aug 07 10:41:01 dist-test-slave-0b58 krb5kdc[7327](info): commencing operation
krb5kdc: starting...
W20260807 10:41:02.542647 21165 mini_kdc.cc:121] Time spent starting KDC: real 1.125s user 0.005s sys 0.044s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786098956060137-21165-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786098956060137-21165-0/krb5kdc/test-user.keytab.
Aug 07 10:41:02 dist-test-slave-0b58 krb5kdc[7327](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099262, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T10:41:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T10:41:02Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.171.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.171.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.171.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.126.keytab.
Entry for principal kudu/127.20.171.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.126.keytab.
I20260807 10:41:02.893283 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786098956060137-21165-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786098956060137-21165-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786098956060137-21165-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.171.126:43997
--webserver_interface=127.20.171.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.126.keytab
--principal=kudu/127.20.171.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.171.84:44415
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.171.126:43997
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786098956060137-21165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786098956060137-21165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786098956060137-21165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:41:03.241940 7342 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:41:03.242213 7342 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:41:03.242398 7342 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:41:03.249684 7342 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 10:41:03.249816 7342 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:41:03.249905 7342 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:41:03.250013 7342 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 10:41:03.250095 7342 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 10:41:03.259876 7342 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.171.84:44415
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786098956060137-21165-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786098956060137-21165-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.171.126:43997
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.126.keytab
--principal=kudu/127.20.171.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.171.126:43997
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.171.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786098956060137-21165-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:41:03.261274 7342 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:41:03.262648 7342 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:41:03.275168 7348 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:41:03.275133 7350 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:41:03.275238 7347 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:41:03.277587 7342 server_base.cc:1034] running on GCE node
I20260807 10:41:03.278373 7342 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:41:03.279805 7342 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:41:03.281029 7342 hybrid_clock.cc:648] HybridClock initialized: now 1786099263280971 us; error 46 us; skew 500 ppm
I20260807 10:41:03.281385 7342 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:41:03 dist-test-slave-0b58 krb5kdc[7327](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099263, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:41:03.284541 7342 init.cc:377] Logged in from keytab as kudu/127.20.171.126@KRBTEST.COM (short username kudu)
I20260807 10:41:03.286005 7342 webserver.cc:460] Webserver started at http://127.20.171.126:46583/ using document root <none> and password file <none>
I20260807 10:41:03.286775 7342 fs_manager.cc:359] Metadata directory not provided
I20260807 10:41:03.286931 7342 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:41:03.287237 7342 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:41:03.290311 7342 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786098956060137-21165-0/minicluster-data/master-0/data/instance:
uuid: "16b7782e0f51400b9947ae7c6066fc77"
format_stamp: "Formatted at 2026-08-07 10:41:03 on dist-test-slave-0b58"
server_key: "d99c6e1adbc709be8c0196432c64e57d"
server_key_iv: "605e2dbceaa0bfcd8a9123b1bc1fed5b"
server_key_version: "encryptionkey@0"
I20260807 10:41:03.291065 7342 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786098956060137-21165-0/minicluster-data/master-0/wal/instance:
uuid: "16b7782e0f51400b9947ae7c6066fc77"
format_stamp: "Formatted at 2026-08-07 10:41:03 on dist-test-slave-0b58"
server_key: "d99c6e1adbc709be8c0196432c64e57d"
server_key_iv: "605e2dbceaa0bfcd8a9123b1bc1fed5b"
server_key_version: "encryptionkey@0"
I20260807 10:41:03.296461 7342 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.004s
I20260807 10:41:03.299839 7357 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:41:03.301194 7342 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 10:41:03.301393 7342 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786098956060137-21165-0/minicluster-data/master-0/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786098956060137-21165-0/minicluster-data/master-0/wal
uuid: "16b7782e0f51400b9947ae7c6066fc77"
format_stamp: "Formatted at 2026-08-07 10:41:03 on dist-test-slave-0b58"
server_key: "d99c6e1adbc709be8c0196432c64e57d"
server_key_iv: "605e2dbceaa0bfcd8a9123b1bc1fed5b"
server_key_version: "encryptionkey@0"
I20260807 10:41:03.301652 7342 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786098956060137-21165-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786098956060137-21165-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786098956060137-21165-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:41:03.313253 7342 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:41:03.317212 7342 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:41:03.317543 7342 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:41:03.336809 7342 rpc_server.cc:307] RPC server started. Bound to: 127.20.171.126:43997
I20260807 10:41:03.336848 7410 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.171.126:43997 every 8 connection(s)
I20260807 10:41:03.338213 7342 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
I20260807 10:41:03.342067 7411 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:41:03.347618 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 7342
I20260807 10:41:03.347815 21165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786098956060137-21165-0/minicluster-data/master-0/wal/instance
I20260807 10:41:03.348243 21165 external_mini_cluster.cc:1428] Setting key f3b64430f1ed2394a62bbc69064ecf57
I20260807 10:41:03.354250 7411 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 16b7782e0f51400b9947ae7c6066fc77: Bootstrap starting.
I20260807 10:41:03.358028 7411 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 16b7782e0f51400b9947ae7c6066fc77: Neither blocks nor log segments found. Creating new log.
I20260807 10:41:03.359045 7411 log.cc:824] T 00000000000000000000000000000000 P 16b7782e0f51400b9947ae7c6066fc77: Log is configured to *not* fsync() on all Append() calls
I20260807 10:41:03.361985 7411 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 16b7782e0f51400b9947ae7c6066fc77: No bootstrap required, opened a new log
Aug 07 10:41:03 dist-test-slave-0b58 krb5kdc[7327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099262, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.171.126@KRBTEST.COM
I20260807 10:41:03.372375 7411 raft_consensus.cc:348] T 00000000000000000000000000000000 P 16b7782e0f51400b9947ae7c6066fc77 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "16b7782e0f51400b9947ae7c6066fc77" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 43997 } }
I20260807 10:41:03.372830 7411 raft_consensus.cc:374] T 00000000000000000000000000000000 P 16b7782e0f51400b9947ae7c6066fc77 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:41:03.372942 7411 raft_consensus.cc:729] T 00000000000000000000000000000000 P 16b7782e0f51400b9947ae7c6066fc77 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16b7782e0f51400b9947ae7c6066fc77, State: Initialized, Role: FOLLOWER
I20260807 10:41:03.373409 7414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:03.350132 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46448 (local address 127.20.171.126:43997)
0807 10:41:03.351240 (+ 1108us) server_negotiation.cc:206] Beginning negotiation
0807 10:41:03.351254 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0807 10:41:03.351309 (+ 55us) server_negotiation.cc:407] Connection header received
0807 10:41:03.353774 (+ 2465us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:41:03.353806 (+ 32us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:41:03.354296 (+ 490us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:41:03.354776 (+ 480us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:41:03.356184 (+ 1408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:03.358160 (+ 1976us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:03.359482 (+ 1322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:03.360336 (+ 854us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:03.360521 (+ 185us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:03.364701 (+ 4180us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:41:03.364711 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:41:03.364729 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:41:03.364776 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:41:03.368901 (+ 4125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:41:03.369587 (+ 686us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:41:03.369601 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:41:03.369610 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:41:03.369828 (+ 218us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:41:03.370190 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:41:03.370196 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:41:03.370199 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:41:03.370932 (+ 733us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:41:03.371227 (+ 295us) server_negotiation.cc:1035] Waiting for connection context
0807 10:41:03.371631 (+ 404us) server_negotiation.cc:299] Negotiation successful
0807 10:41:03.372045 (+ 414us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":852,"thread_start_us":513,"threads_started":1}
I20260807 10:41:03.373570 7411 consensus_queue.cc:260] T 00000000000000000000000000000000 P 16b7782e0f51400b9947ae7c6066fc77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "16b7782e0f51400b9947ae7c6066fc77" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 43997 } }
I20260807 10:41:03.373896 7411 raft_consensus.cc:388] T 00000000000000000000000000000000 P 16b7782e0f51400b9947ae7c6066fc77 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 10:41:03.374076 7411 raft_consensus.cc:482] T 00000000000000000000000000000000 P 16b7782e0f51400b9947ae7c6066fc77 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 10:41:03.374270 7411 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 16b7782e0f51400b9947ae7c6066fc77 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:41:03.376787 7411 raft_consensus.cc:504] T 00000000000000000000000000000000 P 16b7782e0f51400b9947ae7c6066fc77 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "16b7782e0f51400b9947ae7c6066fc77" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 43997 } }
I20260807 10:41:03.377275 7411 leader_election.cc:302] T 00000000000000000000000000000000 P 16b7782e0f51400b9947ae7c6066fc77 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 16b7782e0f51400b9947ae7c6066fc77; no voters:
I20260807 10:41:03.377861 7411 leader_election.cc:288] T 00000000000000000000000000000000 P 16b7782e0f51400b9947ae7c6066fc77 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 10:41:03.378005 7416 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 16b7782e0f51400b9947ae7c6066fc77 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:41:03.378697 7416 raft_consensus.cc:686] T 00000000000000000000000000000000 P 16b7782e0f51400b9947ae7c6066fc77 [term 1 LEADER]: Becoming Leader. State: Replica: 16b7782e0f51400b9947ae7c6066fc77, State: Running, Role: LEADER
I20260807 10:41:03.379186 7416 consensus_queue.cc:237] T 00000000000000000000000000000000 P 16b7782e0f51400b9947ae7c6066fc77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "16b7782e0f51400b9947ae7c6066fc77" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 43997 } }
I20260807 10:41:03.379856 7411 sys_catalog.cc:564] T 00000000000000000000000000000000 P 16b7782e0f51400b9947ae7c6066fc77 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 10:41:03.381880 7418 sys_catalog.cc:455] T 00000000000000000000000000000000 P 16b7782e0f51400b9947ae7c6066fc77 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 16b7782e0f51400b9947ae7c6066fc77. Latest consensus state: current_term: 1 leader_uuid: "16b7782e0f51400b9947ae7c6066fc77" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "16b7782e0f51400b9947ae7c6066fc77" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 43997 } } }
I20260807 10:41:03.382280 7418 sys_catalog.cc:458] T 00000000000000000000000000000000 P 16b7782e0f51400b9947ae7c6066fc77 [sys.catalog]: This master's current role is: LEADER
I20260807 10:41:03.383251 7417 sys_catalog.cc:455] T 00000000000000000000000000000000 P 16b7782e0f51400b9947ae7c6066fc77 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "16b7782e0f51400b9947ae7c6066fc77" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "16b7782e0f51400b9947ae7c6066fc77" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 43997 } } }
I20260807 10:41:03.383623 7417 sys_catalog.cc:458] T 00000000000000000000000000000000 P 16b7782e0f51400b9947ae7c6066fc77 [sys.catalog]: This master's current role is: LEADER
I20260807 10:41:03.389745 7421 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 10:41:03.394529 7421 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 10:41:03.404392 7421 catalog_manager.cc:1347] Generated new cluster ID: cc1e0bcff01041a88a19d7e70d222942
I20260807 10:41:03.404536 7421 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 10:41:03.420343 7421 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 10:41:03.421633 7421 catalog_manager.cc:1504] Loading token signing keys...
I20260807 10:41:03.430627 7421 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 16b7782e0f51400b9947ae7c6066fc77: Generated new TSK 0
I20260807 10:41:03.431635 7421 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.171.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.171.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.171.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.65.keytab.
Entry for principal kudu/127.20.171.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.65.keytab.
I20260807 10:41:03.519163 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786098956060137-21165-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786098956060137-21165-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786098956060137-21165-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786098956060137-21165-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.171.65:0
--local_ip_for_outbound_sockets=127.20.171.65
--webserver_interface=127.20.171.65
--webserver_port=0
--tserver_master_addrs=127.20.171.126:43997
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.65.keytab
--principal=kudu/127.20.171.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.171.84:44415
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786098956060137-21165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786098956060137-21165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786098956060137-21165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:41:03.907680 7438 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:41:03.908018 7438 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:41:03.908201 7438 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:41:03.915582 7438 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:41:03.915752 7438 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:41:03.915934 7438 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.171.65
I20260807 10:41:03.925978 7438 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.171.84:44415
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786098956060137-21165-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786098956060137-21165-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.65.keytab
--principal=kudu/127.20.171.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.171.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786098956060137-21165-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.171.65
--webserver_port=0
--tserver_master_addrs=127.20.171.126:43997
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.171.65
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786098956060137-21165-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:41:03.927330 7438 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:41:03.928663 7438 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:41:03.941886 7444 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:41:03.942384 7446 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:41:03.942561 7443 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:41:03.942898 7438 server_base.cc:1034] running on GCE node
I20260807 10:41:03.943498 7438 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:41:03.944458 7438 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:41:03.945654 7438 hybrid_clock.cc:648] HybridClock initialized: now 1786099263945622 us; error 28 us; skew 500 ppm
I20260807 10:41:03.945971 7438 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:41:03 dist-test-slave-0b58 krb5kdc[7327](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099263, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:41:03.949282 7438 init.cc:377] Logged in from keytab as kudu/127.20.171.65@KRBTEST.COM (short username kudu)
I20260807 10:41:03.950685 7438 webserver.cc:460] Webserver started at http://127.20.171.65:36331/ using document root <none> and password file <none>
I20260807 10:41:03.951357 7438 fs_manager.cc:359] Metadata directory not provided
I20260807 10:41:03.951501 7438 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:41:03.951829 7438 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:41:03.955123 7438 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786098956060137-21165-0/minicluster-data/ts-0/data/instance:
uuid: "90d08c5ce82845019fe3e50700ab3cb3"
format_stamp: "Formatted at 2026-08-07 10:41:03 on dist-test-slave-0b58"
server_key: "6d0cabaf29194105db232ef2b8b258b4"
server_key_iv: "3e62766500fbdc447319adb698168b8c"
server_key_version: "encryptionkey@0"
I20260807 10:41:03.955900 7438 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786098956060137-21165-0/minicluster-data/ts-0/wal/instance:
uuid: "90d08c5ce82845019fe3e50700ab3cb3"
format_stamp: "Formatted at 2026-08-07 10:41:03 on dist-test-slave-0b58"
server_key: "6d0cabaf29194105db232ef2b8b258b4"
server_key_iv: "3e62766500fbdc447319adb698168b8c"
server_key_version: "encryptionkey@0"
I20260807 10:41:03.960994 7438 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260807 10:41:03.964519 7453 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:41:03.965780 7438 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260807 10:41:03.965943 7438 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786098956060137-21165-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786098956060137-21165-0/minicluster-data/ts-0/wal
uuid: "90d08c5ce82845019fe3e50700ab3cb3"
format_stamp: "Formatted at 2026-08-07 10:41:03 on dist-test-slave-0b58"
server_key: "6d0cabaf29194105db232ef2b8b258b4"
server_key_iv: "3e62766500fbdc447319adb698168b8c"
server_key_version: "encryptionkey@0"
I20260807 10:41:03.966151 7438 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786098956060137-21165-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786098956060137-21165-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786098956060137-21165-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:41:03.982988 7438 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:41:03.987205 7438 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:41:03.987527 7438 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:41:03.988543 7438 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:41:03.989969 7438 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:41:03.990041 7438 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:41:03.990206 7438 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:41:03.990271 7438 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:41:04.023046 7438 rpc_server.cc:307] RPC server started. Bound to: 127.20.171.65:46759
I20260807 10:41:04.023083 7567 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.171.65:46759 every 8 connection(s)
I20260807 10:41:04.024405 7438 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786098956060137-21165-0/minicluster-data/ts-0/data/info.pb
I20260807 10:41:04.030850 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 7438
I20260807 10:41:04.031040 21165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786098956060137-21165-0/minicluster-data/ts-0/wal/instance
I20260807 10:41:04.031502 21165 external_mini_cluster.cc:1428] Setting key 4726818503336b2ff10904d89298729e
Aug 07 10:41:04 dist-test-slave-0b58 krb5kdc[7327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099263, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.65@KRBTEST.COM for kudu/127.20.171.126@KRBTEST.COM
I20260807 10:41:04.046581 7570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:04.026942 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.65:43577 (local address 127.20.171.126:43997)
0807 10:41:04.027427 (+ 485us) server_negotiation.cc:206] Beginning negotiation
0807 10:41:04.027432 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:41:04.028211 (+ 779us) server_negotiation.cc:407] Connection header received
0807 10:41:04.030069 (+ 1858us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:41:04.030075 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:41:04.030169 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:41:04.030290 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:41:04.031965 (+ 1675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:04.032997 (+ 1032us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:04.035401 (+ 2404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:04.035813 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:04.035914 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:04.040158 (+ 4244us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:41:04.040163 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:41:04.040168 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:41:04.040201 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:41:04.043249 (+ 3048us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:41:04.044044 (+ 795us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:41:04.044052 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:41:04.044057 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:41:04.044208 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:41:04.044708 (+ 500us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:41:04.044715 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:41:04.044718 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:41:04.045014 (+ 296us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:41:04.045175 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0807 10:41:04.045924 (+ 749us) server_negotiation.cc:299] Negotiation successful
0807 10:41:04.046180 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":374,"thread_start_us":271,"threads_started":1}
I20260807 10:41:04.047611 7571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:04.027344 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:43997 (local address 127.20.171.65:43577)
0807 10:41:04.028035 (+ 691us) negotiation.cc:107] Waiting for socket to connect
0807 10:41:04.028081 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0807 10:41:04.029800 (+ 1719us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:41:04.030524 (+ 724us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:41:04.030533 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:41:04.031181 (+ 648us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:41:04.031793 (+ 612us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:41:04.031812 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:41:04.033150 (+ 1338us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:41:04.033154 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:41:04.035232 (+ 2078us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:41:04.035251 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:41:04.036063 (+ 812us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:41:04.036074 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:41:04.036439 (+ 365us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:04.037200 (+ 761us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:41:04.037245 (+ 45us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:41:04.039929 (+ 2684us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:41:04.043419 (+ 3490us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:41:04.043429 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:41:04.043446 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:41:04.043911 (+ 465us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:41:04.044368 (+ 457us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:41:04.044373 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:41:04.044377 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:41:04.044577 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:41:04.045161 (+ 584us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:41:04.045169 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:41:04.045543 (+ 374us) client_negotiation.cc:769] Sending connection context
0807 10:41:04.045842 (+ 299us) client_negotiation.cc:240] Negotiation successful
0807 10:41:04.046420 (+ 578us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":472,"thread_start_us":282,"threads_started":1}
I20260807 10:41:04.049297 7568 heartbeater.cc:347] Connected to a master server at 127.20.171.126:43997
I20260807 10:41:04.049662 7568 heartbeater.cc:464] Registering TS with master...
I20260807 10:41:04.050477 7568 heartbeater.cc:511] Master 127.20.171.126:43997 requested a full tablet report, sending...
I20260807 10:41:04.052639 7375 ts_manager.cc:194] Registered new tserver with Master: 90d08c5ce82845019fe3e50700ab3cb3 (127.20.171.65:46759)
I20260807 10:41:04.054101 7375 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.171.65@KRBTEST.COM'} at 127.20.171.65:43577
WARNING: no policy specified for kudu/127.20.171.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.171.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.171.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.66.keytab.
Entry for principal kudu/127.20.171.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.66.keytab.
I20260807 10:41:04.107087 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786098956060137-21165-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786098956060137-21165-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786098956060137-21165-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786098956060137-21165-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.171.66:0
--local_ip_for_outbound_sockets=127.20.171.66
--webserver_interface=127.20.171.66
--webserver_port=0
--tserver_master_addrs=127.20.171.126:43997
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.66.keytab
--principal=kudu/127.20.171.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.171.84:44415
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786098956060137-21165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786098956060137-21165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786098956060137-21165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:41:04.454404 7574 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:41:04.454746 7574 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:41:04.454934 7574 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:41:04.462647 7574 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:41:04.462818 7574 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:41:04.463020 7574 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.171.66
I20260807 10:41:04.473542 7574 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.171.84:44415
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786098956060137-21165-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786098956060137-21165-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.66.keytab
--principal=kudu/127.20.171.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.171.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786098956060137-21165-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.171.66
--webserver_port=0
--tserver_master_addrs=127.20.171.126:43997
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.171.66
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786098956060137-21165-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:41:04.474943 7574 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:41:04.476378 7574 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:41:04.489825 7582 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:41:04.489873 7580 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:41:04.489925 7579 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:41:04.496203 7574 server_base.cc:1034] running on GCE node
I20260807 10:41:04.496995 7574 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:41:04.498032 7574 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:41:04.499259 7574 hybrid_clock.cc:648] HybridClock initialized: now 1786099264499210 us; error 72 us; skew 500 ppm
I20260807 10:41:04.499591 7574 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:41:04 dist-test-slave-0b58 krb5kdc[7327](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099264, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:41:04.502691 7574 init.cc:377] Logged in from keytab as kudu/127.20.171.66@KRBTEST.COM (short username kudu)
I20260807 10:41:04.504185 7574 webserver.cc:460] Webserver started at http://127.20.171.66:39169/ using document root <none> and password file <none>
I20260807 10:41:04.504992 7574 fs_manager.cc:359] Metadata directory not provided
I20260807 10:41:04.505100 7574 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:41:04.505365 7574 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:41:04.508410 7574 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786098956060137-21165-0/minicluster-data/ts-1/data/instance:
uuid: "ec7b302eab0a4d379ce613bb2340990d"
format_stamp: "Formatted at 2026-08-07 10:41:04 on dist-test-slave-0b58"
server_key: "3e5505282c9ff71d5e630478bc2726ae"
server_key_iv: "b13fc7c042a24990090a5d8cf3cdeafd"
server_key_version: "encryptionkey@0"
I20260807 10:41:04.509159 7574 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786098956060137-21165-0/minicluster-data/ts-1/wal/instance:
uuid: "ec7b302eab0a4d379ce613bb2340990d"
format_stamp: "Formatted at 2026-08-07 10:41:04 on dist-test-slave-0b58"
server_key: "3e5505282c9ff71d5e630478bc2726ae"
server_key_iv: "b13fc7c042a24990090a5d8cf3cdeafd"
server_key_version: "encryptionkey@0"
I20260807 10:41:04.514281 7574 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260807 10:41:04.517748 7589 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:41:04.519096 7574 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260807 10:41:04.519235 7574 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786098956060137-21165-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786098956060137-21165-0/minicluster-data/ts-1/wal
uuid: "ec7b302eab0a4d379ce613bb2340990d"
format_stamp: "Formatted at 2026-08-07 10:41:04 on dist-test-slave-0b58"
server_key: "3e5505282c9ff71d5e630478bc2726ae"
server_key_iv: "b13fc7c042a24990090a5d8cf3cdeafd"
server_key_version: "encryptionkey@0"
I20260807 10:41:04.519418 7574 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786098956060137-21165-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786098956060137-21165-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786098956060137-21165-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:41:04.530965 7574 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:41:04.535175 7574 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:41:04.535442 7574 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:41:04.536507 7574 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:41:04.538085 7574 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:41:04.538162 7574 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:41:04.538249 7574 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:41:04.538296 7574 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:41:04.572872 7574 rpc_server.cc:307] RPC server started. Bound to: 127.20.171.66:35021
I20260807 10:41:04.572922 7702 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.171.66:35021 every 8 connection(s)
I20260807 10:41:04.574213 7574 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786098956060137-21165-0/minicluster-data/ts-1/data/info.pb
I20260807 10:41:04.581476 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 7574
I20260807 10:41:04.581683 21165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786098956060137-21165-0/minicluster-data/ts-1/wal/instance
I20260807 10:41:04.582271 21165 external_mini_cluster.cc:1428] Setting key 147f2f0206b5dd3774492e52960d0c84
Aug 07 10:41:04 dist-test-slave-0b58 krb5kdc[7327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099264, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.66@KRBTEST.COM for kudu/127.20.171.126@KRBTEST.COM
I20260807 10:41:04.596593 7706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:04.576836 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.66:54153 (local address 127.20.171.126:43997)
0807 10:41:04.577292 (+ 456us) server_negotiation.cc:206] Beginning negotiation
0807 10:41:04.577296 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 10:41:04.578266 (+ 970us) server_negotiation.cc:407] Connection header received
0807 10:41:04.580138 (+ 1872us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:41:04.580144 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:41:04.580243 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:41:04.580434 (+ 191us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:41:04.582364 (+ 1930us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:04.583134 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:04.585174 (+ 2040us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:04.585602 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:04.585707 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:04.590280 (+ 4573us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:41:04.590285 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:41:04.590288 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:41:04.590322 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:41:04.593092 (+ 2770us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:41:04.594076 (+ 984us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:41:04.594080 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:41:04.594082 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:41:04.594210 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:41:04.594699 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:41:04.594702 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:41:04.594704 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:41:04.594972 (+ 268us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:41:04.595086 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0807 10:41:04.595998 (+ 912us) server_negotiation.cc:299] Negotiation successful
0807 10:41:04.596174 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":341,"thread_start_us":225,"threads_started":1}
I20260807 10:41:04.598181 7707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:04.577425 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:43997 (local address 127.20.171.66:54153)
0807 10:41:04.578115 (+ 690us) negotiation.cc:107] Waiting for socket to connect
0807 10:41:04.578152 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0807 10:41:04.579865 (+ 1713us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:41:04.580665 (+ 800us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:41:04.580673 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:41:04.581352 (+ 679us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:41:04.582167 (+ 815us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:41:04.582190 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:41:04.583298 (+ 1108us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:41:04.583304 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:41:04.585024 (+ 1720us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:41:04.585045 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:41:04.585838 (+ 793us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:41:04.585847 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:41:04.586190 (+ 343us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:04.586948 (+ 758us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:41:04.586984 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:41:04.590017 (+ 3033us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:41:04.593244 (+ 3227us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:41:04.593256 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:41:04.593275 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:41:04.593956 (+ 681us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:41:04.594320 (+ 364us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:41:04.594327 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:41:04.594333 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:41:04.594589 (+ 256us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:41:04.595097 (+ 508us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:41:04.595108 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:41:04.595580 (+ 472us) client_negotiation.cc:769] Sending connection context
0807 10:41:04.595919 (+ 339us) client_negotiation.cc:240] Negotiation successful
0807 10:41:04.596559 (+ 640us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":477,"thread_start_us":272,"threads_started":1}
I20260807 10:41:04.599709 7704 heartbeater.cc:347] Connected to a master server at 127.20.171.126:43997
I20260807 10:41:04.600103 7704 heartbeater.cc:464] Registering TS with master...
I20260807 10:41:04.601086 7704 heartbeater.cc:511] Master 127.20.171.126:43997 requested a full tablet report, sending...
I20260807 10:41:04.602605 7375 ts_manager.cc:194] Registered new tserver with Master: ec7b302eab0a4d379ce613bb2340990d (127.20.171.66:35021)
I20260807 10:41:04.603487 7375 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.171.66@KRBTEST.COM'} at 127.20.171.66:54153
WARNING: no policy specified for kudu/127.20.171.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.171.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.171.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.67.keytab.
Entry for principal kudu/127.20.171.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.67.keytab.
I20260807 10:41:04.659415 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786098956060137-21165-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786098956060137-21165-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786098956060137-21165-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786098956060137-21165-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.171.67:0
--local_ip_for_outbound_sockets=127.20.171.67
--webserver_interface=127.20.171.67
--webserver_port=0
--tserver_master_addrs=127.20.171.126:43997
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.67.keytab
--principal=kudu/127.20.171.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.171.84:44415
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786098956060137-21165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786098956060137-21165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786098956060137-21165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:41:05.022724 7710 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:41:05.023043 7710 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:41:05.023244 7710 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:41:05.030797 7710 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:41:05.030944 7710 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:41:05.031124 7710 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.171.67
I20260807 10:41:05.041091 7710 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.171.84:44415
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786098956060137-21165-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786098956060137-21165-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.67.keytab
--principal=kudu/127.20.171.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.171.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786098956060137-21165-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.171.67
--webserver_port=0
--tserver_master_addrs=127.20.171.126:43997
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.171.67
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786098956060137-21165-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:41:05.042475 7710 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:41:05.043905 7710 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 10:41:05.057288 7568 heartbeater.cc:503] Master 127.20.171.126:43997 was elected leader, sending a full tablet report...
W20260807 10:41:05.057942 7715 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:41:05.058266 7716 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:41:05.058768 7718 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:41:05.059916 7710 server_base.cc:1034] running on GCE node
I20260807 10:41:05.060606 7710 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:41:05.061580 7710 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:41:05.062848 7710 hybrid_clock.cc:648] HybridClock initialized: now 1786099265062784 us; error 48 us; skew 500 ppm
I20260807 10:41:05.063230 7710 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:41:05 dist-test-slave-0b58 krb5kdc[7327](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099265, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:41:05.066425 7710 init.cc:377] Logged in from keytab as kudu/127.20.171.67@KRBTEST.COM (short username kudu)
I20260807 10:41:05.067904 7710 webserver.cc:460] Webserver started at http://127.20.171.67:43751/ using document root <none> and password file <none>
I20260807 10:41:05.068624 7710 fs_manager.cc:359] Metadata directory not provided
I20260807 10:41:05.068730 7710 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:41:05.068987 7710 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:41:05.072023 7710 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786098956060137-21165-0/minicluster-data/ts-2/data/instance:
uuid: "bb50cba4a8d545afa1424f32743e7e28"
format_stamp: "Formatted at 2026-08-07 10:41:05 on dist-test-slave-0b58"
server_key: "0ab74b896a79ff5aa420415226bc3a48"
server_key_iv: "5ada2f022f2b7241bdb85bcd845cdf17"
server_key_version: "encryptionkey@0"
I20260807 10:41:05.072885 7710 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786098956060137-21165-0/minicluster-data/ts-2/wal/instance:
uuid: "bb50cba4a8d545afa1424f32743e7e28"
format_stamp: "Formatted at 2026-08-07 10:41:05 on dist-test-slave-0b58"
server_key: "0ab74b896a79ff5aa420415226bc3a48"
server_key_iv: "5ada2f022f2b7241bdb85bcd845cdf17"
server_key_version: "encryptionkey@0"
I20260807 10:41:05.078119 7710 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260807 10:41:05.081626 7726 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:41:05.082929 7710 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260807 10:41:05.083102 7710 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786098956060137-21165-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786098956060137-21165-0/minicluster-data/ts-2/wal
uuid: "bb50cba4a8d545afa1424f32743e7e28"
format_stamp: "Formatted at 2026-08-07 10:41:05 on dist-test-slave-0b58"
server_key: "0ab74b896a79ff5aa420415226bc3a48"
server_key_iv: "5ada2f022f2b7241bdb85bcd845cdf17"
server_key_version: "encryptionkey@0"
I20260807 10:41:05.083288 7710 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786098956060137-21165-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786098956060137-21165-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786098956060137-21165-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:41:05.095451 7710 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:41:05.099716 7710 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:41:05.100024 7710 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:41:05.101029 7710 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:41:05.102387 7710 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:41:05.102464 7710 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:41:05.102626 7710 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:41:05.102677 7710 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:41:05.137250 7710 rpc_server.cc:307] RPC server started. Bound to: 127.20.171.67:41717
I20260807 10:41:05.137356 7843 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.171.67:41717 every 8 connection(s)
I20260807 10:41:05.138780 7710 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786098956060137-21165-0/minicluster-data/ts-2/data/info.pb
I20260807 10:41:05.144050 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 7710
I20260807 10:41:05.144207 21165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786098956060137-21165-0/minicluster-data/ts-2/wal/instance
I20260807 10:41:05.144838 21165 external_mini_cluster.cc:1428] Setting key 209d61a34053d5708e0a6b780c961062
Aug 07 10:41:05 dist-test-slave-0b58 krb5kdc[7327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099265, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.67@KRBTEST.COM for kudu/127.20.171.126@KRBTEST.COM
I20260807 10:41:05.160162 7846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:05.141569 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.67:49733 (local address 127.20.171.126:43997)
0807 10:41:05.142016 (+ 447us) server_negotiation.cc:206] Beginning negotiation
0807 10:41:05.142020 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 10:41:05.143039 (+ 1019us) server_negotiation.cc:407] Connection header received
0807 10:41:05.145987 (+ 2948us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:41:05.145991 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:41:05.146104 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:41:05.146228 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:41:05.148228 (+ 2000us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:05.149050 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:05.150536 (+ 1486us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:05.150913 (+ 377us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:05.151005 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:05.154429 (+ 3424us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:41:05.154434 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:41:05.154437 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:41:05.154469 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:41:05.157008 (+ 2539us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:41:05.157655 (+ 647us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:41:05.157658 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:41:05.157661 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:41:05.157783 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:41:05.158179 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:41:05.158183 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:41:05.158186 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:41:05.158553 (+ 367us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:41:05.158718 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0807 10:41:05.159543 (+ 825us) server_negotiation.cc:299] Negotiation successful
0807 10:41:05.159786 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":329,"thread_start_us":222,"threads_started":1}
I20260807 10:41:05.161144 7847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:05.142163 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:43997 (local address 127.20.171.67:49733)
0807 10:41:05.142864 (+ 701us) negotiation.cc:107] Waiting for socket to connect
0807 10:41:05.142908 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0807 10:41:05.145681 (+ 2773us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:41:05.146497 (+ 816us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:41:05.146506 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:41:05.147256 (+ 750us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:41:05.148076 (+ 820us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:41:05.148095 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:41:05.149190 (+ 1095us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:41:05.149194 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:41:05.150417 (+ 1223us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:41:05.150429 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:41:05.151095 (+ 666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:41:05.151100 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:41:05.151284 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:05.151987 (+ 703us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:41:05.152009 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:41:05.154233 (+ 2224us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:41:05.157130 (+ 2897us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:41:05.157136 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:41:05.157148 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:41:05.157555 (+ 407us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:41:05.157878 (+ 323us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:41:05.157881 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:41:05.157883 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:41:05.158057 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:41:05.158693 (+ 636us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:41:05.158699 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:41:05.159131 (+ 432us) client_negotiation.cc:769] Sending connection context
0807 10:41:05.159418 (+ 287us) client_negotiation.cc:240] Negotiation successful
0807 10:41:05.159941 (+ 523us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":468,"thread_start_us":257,"threads_started":1}
I20260807 10:41:05.162442 7844 heartbeater.cc:347] Connected to a master server at 127.20.171.126:43997
I20260807 10:41:05.162709 7844 heartbeater.cc:464] Registering TS with master...
I20260807 10:41:05.163407 7844 heartbeater.cc:511] Master 127.20.171.126:43997 requested a full tablet report, sending...
I20260807 10:41:05.164887 7375 ts_manager.cc:194] Registered new tserver with Master: bb50cba4a8d545afa1424f32743e7e28 (127.20.171.67:41717)
I20260807 10:41:05.165678 7375 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.171.67@KRBTEST.COM'} at 127.20.171.67:49733
I20260807 10:41:05.172379 21165 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 10:41:05.190065 7846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:05.176534 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46454 (local address 127.20.171.126:43997)
0807 10:41:05.176719 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0807 10:41:05.176744 (+ 25us) server_negotiation.cc:399] Waiting for connection header
0807 10:41:05.177233 (+ 489us) server_negotiation.cc:407] Connection header received
0807 10:41:05.177438 (+ 205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:41:05.177443 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:41:05.177524 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:41:05.177626 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:41:05.178984 (+ 1358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:05.179834 (+ 850us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:05.181239 (+ 1405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:05.181679 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:05.181818 (+ 139us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:05.184592 (+ 2774us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:41:05.184598 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:41:05.184603 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:41:05.184642 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:41:05.187067 (+ 2425us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:41:05.187980 (+ 913us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:41:05.187985 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:41:05.187993 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:41:05.188129 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:41:05.188619 (+ 490us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:41:05.188622 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:41:05.188624 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:41:05.188921 (+ 297us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:41:05.189214 (+ 293us) server_negotiation.cc:1035] Waiting for connection context
0807 10:41:05.189584 (+ 370us) server_negotiation.cc:299] Negotiation successful
0807 10:41:05.189772 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260807 10:41:05.194017 7375 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46454:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 10:41:05.201212 7375 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 10:41:05.232637 7860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:05.213604 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.65:46759 (local address 127.0.0.1:34354)
0807 10:41:05.216217 (+ 2613us) negotiation.cc:107] Waiting for socket to connect
0807 10:41:05.216282 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0807 10:41:05.216503 (+ 221us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:41:05.219100 (+ 2597us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:41:05.219110 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:41:05.219149 (+ 39us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:41:05.219692 (+ 543us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:41:05.219708 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:41:05.223436 (+ 3728us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:41:05.223444 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:41:05.228155 (+ 4711us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:41:05.228180 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:41:05.231445 (+ 3265us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:41:05.231455 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:41:05.231726 (+ 271us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:05.231883 (+ 157us) client_negotiation.cc:769] Sending connection context
0807 10:41:05.232023 (+ 140us) client_negotiation.cc:240] Negotiation successful
0807 10:41:05.232223 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2278,"thread_start_us":16819,"threads_started":1}
I20260807 10:41:05.233044 7859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:05.213927 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34354 (local address 127.20.171.65:46759)
0807 10:41:05.215527 (+ 1600us) server_negotiation.cc:206] Beginning negotiation
0807 10:41:05.215540 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 10:41:05.216499 (+ 959us) server_negotiation.cc:407] Connection header received
0807 10:41:05.216834 (+ 335us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:41:05.216847 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:41:05.218540 (+ 1693us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:41:05.218744 (+ 204us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:41:05.219924 (+ 1180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:05.223238 (+ 3314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:05.228479 (+ 5241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:05.230877 (+ 2398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:05.231018 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:05.231278 (+ 260us) server_negotiation.cc:1035] Waiting for connection context
0807 10:41:05.232144 (+ 866us) server_negotiation.cc:299] Negotiation successful
0807 10:41:05.232400 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1393,"thread_start_us":1237,"threads_started":1}
I20260807 10:41:05.237044 7502 tablet_service.cc:1467] Processing CreateTablet for tablet 3d1630616caa4add90cedea257a5250b (DEFAULT_TABLE table=test-table [id=9ef154d8827d4d278d11b3129dce7888]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:41:05.238544 7502 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3d1630616caa4add90cedea257a5250b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:41:05.239660 7858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:05.214051 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.67:41717 (local address 127.0.0.1:45580)
0807 10:41:05.230739 (+ 16688us) negotiation.cc:107] Waiting for socket to connect
0807 10:41:05.230759 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0807 10:41:05.231499 (+ 740us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:41:05.232877 (+ 1378us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:41:05.232884 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:41:05.232910 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:41:05.233399 (+ 489us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:41:05.233415 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:41:05.235245 (+ 1830us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:41:05.235251 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:41:05.236956 (+ 1705us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:41:05.236972 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:41:05.238830 (+ 1858us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:41:05.238837 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:41:05.239012 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:05.239042 (+ 30us) client_negotiation.cc:769] Sending connection context
0807 10:41:05.239138 (+ 96us) client_negotiation.cc:240] Negotiation successful
0807 10:41:05.239262 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":16535,"mutex_wait_us":4,"thread_start_us":1654,"threads_started":1}
I20260807 10:41:05.239732 7861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:05.214787 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45580 (local address 127.20.171.67:41717)
0807 10:41:05.224876 (+ 10089us) server_negotiation.cc:206] Beginning negotiation
0807 10:41:05.224887 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 10:41:05.230870 (+ 5983us) server_negotiation.cc:407] Connection header received
0807 10:41:05.231910 (+ 1040us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:41:05.231921 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:41:05.232181 (+ 260us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:41:05.232421 (+ 240us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:41:05.233596 (+ 1175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:05.235091 (+ 1495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:05.237137 (+ 2046us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:05.238573 (+ 1436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:05.238698 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:05.238943 (+ 245us) server_negotiation.cc:1035] Waiting for connection context
0807 10:41:05.239209 (+ 266us) server_negotiation.cc:299] Negotiation successful
0807 10:41:05.239369 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":9856,"thread_start_us":9645,"threads_started":1}
I20260807 10:41:05.240706 7862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:05.217420 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.66:35021 (local address 127.0.0.1:58708)
0807 10:41:05.231812 (+ 14392us) negotiation.cc:107] Waiting for socket to connect
0807 10:41:05.231831 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 10:41:05.231954 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:41:05.232760 (+ 806us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:41:05.232766 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:41:05.232798 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:41:05.234242 (+ 1444us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:41:05.234251 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:41:05.235661 (+ 1410us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:41:05.235666 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:41:05.237796 (+ 2130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:41:05.237811 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:41:05.239839 (+ 2028us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:41:05.239847 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:41:05.240015 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:05.240079 (+ 64us) client_negotiation.cc:769] Sending connection context
0807 10:41:05.240180 (+ 101us) client_negotiation.cc:240] Negotiation successful
0807 10:41:05.240346 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14283,"mutex_wait_us":903,"spinlock_wait_cycles":2432,"thread_start_us":14164,"threads_started":1}
I20260807 10:41:05.240940 7863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:05.217694 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58708 (local address 127.20.171.66:35021)
0807 10:41:05.231165 (+ 13471us) server_negotiation.cc:206] Beginning negotiation
0807 10:41:05.231173 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 10:41:05.231950 (+ 777us) server_negotiation.cc:407] Connection header received
0807 10:41:05.232082 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:41:05.232088 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:41:05.232337 (+ 249us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:41:05.232512 (+ 175us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:41:05.234402 (+ 1890us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:05.235512 (+ 1110us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:05.237974 (+ 2462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:05.239383 (+ 1409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:05.239524 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:05.239701 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0807 10:41:05.240242 (+ 541us) server_negotiation.cc:299] Negotiation successful
0807 10:41:05.240440 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13314,"thread_start_us":13505,"threads_started":1}
I20260807 10:41:05.243291 7778 tablet_service.cc:1467] Processing CreateTablet for tablet 3d1630616caa4add90cedea257a5250b (DEFAULT_TABLE table=test-table [id=9ef154d8827d4d278d11b3129dce7888]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:41:05.244751 7778 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3d1630616caa4add90cedea257a5250b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:41:05.244551 7637 tablet_service.cc:1467] Processing CreateTablet for tablet 3d1630616caa4add90cedea257a5250b (DEFAULT_TABLE table=test-table [id=9ef154d8827d4d278d11b3129dce7888]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:41:05.245882 7637 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3d1630616caa4add90cedea257a5250b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:41:05.254555 7864 tablet_bootstrap.cc:492] T 3d1630616caa4add90cedea257a5250b P 90d08c5ce82845019fe3e50700ab3cb3: Bootstrap starting.
I20260807 10:41:05.256476 7865 tablet_bootstrap.cc:492] T 3d1630616caa4add90cedea257a5250b P bb50cba4a8d545afa1424f32743e7e28: Bootstrap starting.
I20260807 10:41:05.258193 7864 tablet_bootstrap.cc:654] T 3d1630616caa4add90cedea257a5250b P 90d08c5ce82845019fe3e50700ab3cb3: Neither blocks nor log segments found. Creating new log.
I20260807 10:41:05.259215 7864 log.cc:824] T 3d1630616caa4add90cedea257a5250b P 90d08c5ce82845019fe3e50700ab3cb3: Log is configured to *not* fsync() on all Append() calls
I20260807 10:41:05.259835 7865 tablet_bootstrap.cc:654] T 3d1630616caa4add90cedea257a5250b P bb50cba4a8d545afa1424f32743e7e28: Neither blocks nor log segments found. Creating new log.
I20260807 10:41:05.260519 7866 tablet_bootstrap.cc:492] T 3d1630616caa4add90cedea257a5250b P ec7b302eab0a4d379ce613bb2340990d: Bootstrap starting.
I20260807 10:41:05.261026 7865 log.cc:824] T 3d1630616caa4add90cedea257a5250b P bb50cba4a8d545afa1424f32743e7e28: Log is configured to *not* fsync() on all Append() calls
I20260807 10:41:05.263541 7864 tablet_bootstrap.cc:492] T 3d1630616caa4add90cedea257a5250b P 90d08c5ce82845019fe3e50700ab3cb3: No bootstrap required, opened a new log
I20260807 10:41:05.263827 7864 ts_tablet_manager.cc:1397] T 3d1630616caa4add90cedea257a5250b P 90d08c5ce82845019fe3e50700ab3cb3: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.007s
I20260807 10:41:05.263865 7866 tablet_bootstrap.cc:654] T 3d1630616caa4add90cedea257a5250b P ec7b302eab0a4d379ce613bb2340990d: Neither blocks nor log segments found. Creating new log.
I20260807 10:41:05.264029 7865 tablet_bootstrap.cc:492] T 3d1630616caa4add90cedea257a5250b P bb50cba4a8d545afa1424f32743e7e28: No bootstrap required, opened a new log
I20260807 10:41:05.264353 7865 ts_tablet_manager.cc:1397] T 3d1630616caa4add90cedea257a5250b P bb50cba4a8d545afa1424f32743e7e28: Time spent bootstrapping tablet: real 0.008s user 0.008s sys 0.000s
I20260807 10:41:05.265280 7866 log.cc:824] T 3d1630616caa4add90cedea257a5250b P ec7b302eab0a4d379ce613bb2340990d: Log is configured to *not* fsync() on all Append() calls
I20260807 10:41:05.267699 7866 tablet_bootstrap.cc:492] T 3d1630616caa4add90cedea257a5250b P ec7b302eab0a4d379ce613bb2340990d: No bootstrap required, opened a new log
I20260807 10:41:05.267961 7866 ts_tablet_manager.cc:1397] T 3d1630616caa4add90cedea257a5250b P ec7b302eab0a4d379ce613bb2340990d: Time spent bootstrapping tablet: real 0.008s user 0.005s sys 0.000s
I20260807 10:41:05.275162 7865 raft_consensus.cc:348] T 3d1630616caa4add90cedea257a5250b P bb50cba4a8d545afa1424f32743e7e28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90d08c5ce82845019fe3e50700ab3cb3" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 46759 } } peers { permanent_uuid: "bb50cba4a8d545afa1424f32743e7e28" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 41717 } } peers { permanent_uuid: "ec7b302eab0a4d379ce613bb2340990d" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 35021 } }
I20260807 10:41:05.275162 7864 raft_consensus.cc:348] T 3d1630616caa4add90cedea257a5250b P 90d08c5ce82845019fe3e50700ab3cb3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90d08c5ce82845019fe3e50700ab3cb3" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 46759 } } peers { permanent_uuid: "bb50cba4a8d545afa1424f32743e7e28" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 41717 } } peers { permanent_uuid: "ec7b302eab0a4d379ce613bb2340990d" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 35021 } }
I20260807 10:41:05.275640 7864 raft_consensus.cc:374] T 3d1630616caa4add90cedea257a5250b P 90d08c5ce82845019fe3e50700ab3cb3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:41:05.275640 7865 raft_consensus.cc:374] T 3d1630616caa4add90cedea257a5250b P bb50cba4a8d545afa1424f32743e7e28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:41:05.275745 7865 raft_consensus.cc:729] T 3d1630616caa4add90cedea257a5250b P bb50cba4a8d545afa1424f32743e7e28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb50cba4a8d545afa1424f32743e7e28, State: Initialized, Role: FOLLOWER
I20260807 10:41:05.275745 7864 raft_consensus.cc:729] T 3d1630616caa4add90cedea257a5250b P 90d08c5ce82845019fe3e50700ab3cb3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 90d08c5ce82845019fe3e50700ab3cb3, State: Initialized, Role: FOLLOWER
I20260807 10:41:05.275889 7866 raft_consensus.cc:348] T 3d1630616caa4add90cedea257a5250b P ec7b302eab0a4d379ce613bb2340990d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90d08c5ce82845019fe3e50700ab3cb3" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 46759 } } peers { permanent_uuid: "bb50cba4a8d545afa1424f32743e7e28" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 41717 } } peers { permanent_uuid: "ec7b302eab0a4d379ce613bb2340990d" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 35021 } }
I20260807 10:41:05.276400 7866 raft_consensus.cc:374] T 3d1630616caa4add90cedea257a5250b P ec7b302eab0a4d379ce613bb2340990d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:41:05.276410 7865 consensus_queue.cc:260] T 3d1630616caa4add90cedea257a5250b P bb50cba4a8d545afa1424f32743e7e28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90d08c5ce82845019fe3e50700ab3cb3" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 46759 } } peers { permanent_uuid: "bb50cba4a8d545afa1424f32743e7e28" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 41717 } } peers { permanent_uuid: "ec7b302eab0a4d379ce613bb2340990d" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 35021 } }
I20260807 10:41:05.276410 7864 consensus_queue.cc:260] T 3d1630616caa4add90cedea257a5250b P 90d08c5ce82845019fe3e50700ab3cb3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90d08c5ce82845019fe3e50700ab3cb3" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 46759 } } peers { permanent_uuid: "bb50cba4a8d545afa1424f32743e7e28" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 41717 } } peers { permanent_uuid: "ec7b302eab0a4d379ce613bb2340990d" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 35021 } }
I20260807 10:41:05.276607 7866 raft_consensus.cc:729] T 3d1630616caa4add90cedea257a5250b P ec7b302eab0a4d379ce613bb2340990d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec7b302eab0a4d379ce613bb2340990d, State: Initialized, Role: FOLLOWER
I20260807 10:41:05.277261 7866 consensus_queue.cc:260] T 3d1630616caa4add90cedea257a5250b P ec7b302eab0a4d379ce613bb2340990d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90d08c5ce82845019fe3e50700ab3cb3" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 46759 } } peers { permanent_uuid: "bb50cba4a8d545afa1424f32743e7e28" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 41717 } } peers { permanent_uuid: "ec7b302eab0a4d379ce613bb2340990d" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 35021 } }
I20260807 10:41:05.279780 7704 heartbeater.cc:503] Master 127.20.171.126:43997 was elected leader, sending a full tablet report...
I20260807 10:41:05.280851 7866 ts_tablet_manager.cc:1428] T 3d1630616caa4add90cedea257a5250b P ec7b302eab0a4d379ce613bb2340990d: Time spent starting tablet: real 0.013s user 0.006s sys 0.007s
I20260807 10:41:05.282405 7865 ts_tablet_manager.cc:1428] T 3d1630616caa4add90cedea257a5250b P bb50cba4a8d545afa1424f32743e7e28: Time spent starting tablet: real 0.018s user 0.010s sys 0.007s
I20260807 10:41:05.282780 7864 ts_tablet_manager.cc:1428] T 3d1630616caa4add90cedea257a5250b P 90d08c5ce82845019fe3e50700ab3cb3: Time spent starting tablet: real 0.019s user 0.015s sys 0.005s
I20260807 10:41:05.282958 7844 heartbeater.cc:503] Master 127.20.171.126:43997 was elected leader, sending a full tablet report...
W20260807 10:41:05.326243 7705 tablet.cc:2369] T 3d1630616caa4add90cedea257a5250b P ec7b302eab0a4d379ce613bb2340990d: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 10:41:05.390561 7845 tablet.cc:2369] T 3d1630616caa4add90cedea257a5250b P bb50cba4a8d545afa1424f32743e7e28: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 10:41:05.504774 7871 raft_consensus.cc:482] T 3d1630616caa4add90cedea257a5250b P 90d08c5ce82845019fe3e50700ab3cb3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 10:41:05.505074 7871 raft_consensus.cc:504] T 3d1630616caa4add90cedea257a5250b P 90d08c5ce82845019fe3e50700ab3cb3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90d08c5ce82845019fe3e50700ab3cb3" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 46759 } } peers { permanent_uuid: "bb50cba4a8d545afa1424f32743e7e28" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 41717 } } peers { permanent_uuid: "ec7b302eab0a4d379ce613bb2340990d" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 35021 } }
I20260807 10:41:05.506767 7871 leader_election.cc:288] T 3d1630616caa4add90cedea257a5250b P 90d08c5ce82845019fe3e50700ab3cb3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb50cba4a8d545afa1424f32743e7e28 (127.20.171.67:41717), ec7b302eab0a4d379ce613bb2340990d (127.20.171.66:35021)
I20260807 10:41:05.514213 7861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:05.507159 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.65:60493 (local address 127.20.171.67:41717)
0807 10:41:05.507351 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0807 10:41:05.507356 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:41:05.507792 (+ 436us) server_negotiation.cc:407] Connection header received
0807 10:41:05.508194 (+ 402us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:41:05.508204 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:41:05.508334 (+ 130us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:41:05.508402 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:41:05.509471 (+ 1069us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:05.510462 (+ 991us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:05.512344 (+ 1882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:05.513210 (+ 866us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:05.513328 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:05.513381 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0807 10:41:05.513802 (+ 421us) server_negotiation.cc:299] Negotiation successful
0807 10:41:05.513956 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260807 10:41:05.514302 7863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:05.508109 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.65:49795 (local address 127.20.171.66:35021)
0807 10:41:05.508339 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0807 10:41:05.508345 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:41:05.508995 (+ 650us) server_negotiation.cc:407] Connection header received
0807 10:41:05.509231 (+ 236us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:41:05.509237 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:41:05.509364 (+ 127us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:41:05.509453 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:41:05.510052 (+ 599us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:05.510874 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:05.512592 (+ 1718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:05.513386 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:05.513530 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:05.513600 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0807 10:41:05.513932 (+ 332us) server_negotiation.cc:299] Negotiation successful
0807 10:41:05.514065 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260807 10:41:05.514407 7874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:05.507820 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.66:35021 (local address 127.20.171.65:49795)
0807 10:41:05.508883 (+ 1063us) negotiation.cc:107] Waiting for socket to connect
0807 10:41:05.508904 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0807 10:41:05.509043 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:41:05.509487 (+ 444us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:41:05.509491 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:41:05.509521 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:41:05.509904 (+ 383us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:41:05.509916 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:41:05.511006 (+ 1090us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:41:05.511010 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:41:05.512451 (+ 1441us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:41:05.512465 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:41:05.513585 (+ 1120us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:41:05.513589 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:41:05.513769 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:05.513799 (+ 30us) client_negotiation.cc:769] Sending connection context
0807 10:41:05.513889 (+ 90us) client_negotiation.cc:240] Negotiation successful
0807 10:41:05.514005 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":896,"mutex_wait_us":4,"thread_start_us":965,"threads_started":1}
I20260807 10:41:05.514648 7873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:05.507030 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.67:41717 (local address 127.20.171.65:60493)
0807 10:41:05.507683 (+ 653us) negotiation.cc:107] Waiting for socket to connect
0807 10:41:05.507704 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0807 10:41:05.507939 (+ 235us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:41:05.508656 (+ 717us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:41:05.508660 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:41:05.508688 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:41:05.509199 (+ 511us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:41:05.509230 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:41:05.510591 (+ 1361us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:41:05.510596 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:41:05.512179 (+ 1583us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:41:05.512190 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:41:05.513415 (+ 1225us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:41:05.513423 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:41:05.513634 (+ 211us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:05.513665 (+ 31us) client_negotiation.cc:769] Sending connection context
0807 10:41:05.513741 (+ 76us) client_negotiation.cc:240] Negotiation successful
0807 10:41:05.513835 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":519,"mutex_wait_us":27,"thread_start_us":347,"threads_started":1}
I20260807 10:41:05.515458 7657 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d1630616caa4add90cedea257a5250b" candidate_uuid: "90d08c5ce82845019fe3e50700ab3cb3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec7b302eab0a4d379ce613bb2340990d" is_pre_election: true
I20260807 10:41:05.515486 7798 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d1630616caa4add90cedea257a5250b" candidate_uuid: "90d08c5ce82845019fe3e50700ab3cb3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb50cba4a8d545afa1424f32743e7e28" is_pre_election: true
I20260807 10:41:05.515954 7798 raft_consensus.cc:2454] T 3d1630616caa4add90cedea257a5250b P bb50cba4a8d545afa1424f32743e7e28 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 90d08c5ce82845019fe3e50700ab3cb3 in term 0.
I20260807 10:41:05.515969 7657 raft_consensus.cc:2454] T 3d1630616caa4add90cedea257a5250b P ec7b302eab0a4d379ce613bb2340990d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 90d08c5ce82845019fe3e50700ab3cb3 in term 0.
I20260807 10:41:05.516664 7457 leader_election.cc:302] T 3d1630616caa4add90cedea257a5250b P 90d08c5ce82845019fe3e50700ab3cb3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 90d08c5ce82845019fe3e50700ab3cb3, bb50cba4a8d545afa1424f32743e7e28; no voters:
I20260807 10:41:05.517009 7871 raft_consensus.cc:2781] T 3d1630616caa4add90cedea257a5250b P 90d08c5ce82845019fe3e50700ab3cb3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 10:41:05.517132 7871 raft_consensus.cc:482] T 3d1630616caa4add90cedea257a5250b P 90d08c5ce82845019fe3e50700ab3cb3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 10:41:05.517258 7871 raft_consensus.cc:3037] T 3d1630616caa4add90cedea257a5250b P 90d08c5ce82845019fe3e50700ab3cb3 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:41:05.519476 7871 raft_consensus.cc:504] T 3d1630616caa4add90cedea257a5250b P 90d08c5ce82845019fe3e50700ab3cb3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90d08c5ce82845019fe3e50700ab3cb3" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 46759 } } peers { permanent_uuid: "bb50cba4a8d545afa1424f32743e7e28" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 41717 } } peers { permanent_uuid: "ec7b302eab0a4d379ce613bb2340990d" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 35021 } }
I20260807 10:41:05.520026 7871 leader_election.cc:288] T 3d1630616caa4add90cedea257a5250b P 90d08c5ce82845019fe3e50700ab3cb3 [CANDIDATE]: Term 1 election: Requested vote from peers bb50cba4a8d545afa1424f32743e7e28 (127.20.171.67:41717), ec7b302eab0a4d379ce613bb2340990d (127.20.171.66:35021)
I20260807 10:41:05.520483 7798 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d1630616caa4add90cedea257a5250b" candidate_uuid: "90d08c5ce82845019fe3e50700ab3cb3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb50cba4a8d545afa1424f32743e7e28"
I20260807 10:41:05.520610 7657 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d1630616caa4add90cedea257a5250b" candidate_uuid: "90d08c5ce82845019fe3e50700ab3cb3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec7b302eab0a4d379ce613bb2340990d"
I20260807 10:41:05.520660 7798 raft_consensus.cc:3037] T 3d1630616caa4add90cedea257a5250b P bb50cba4a8d545afa1424f32743e7e28 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:41:05.520813 7657 raft_consensus.cc:3037] T 3d1630616caa4add90cedea257a5250b P ec7b302eab0a4d379ce613bb2340990d [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:41:05.522984 7798 raft_consensus.cc:2454] T 3d1630616caa4add90cedea257a5250b P bb50cba4a8d545afa1424f32743e7e28 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 90d08c5ce82845019fe3e50700ab3cb3 in term 1.
I20260807 10:41:05.523188 7657 raft_consensus.cc:2454] T 3d1630616caa4add90cedea257a5250b P ec7b302eab0a4d379ce613bb2340990d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 90d08c5ce82845019fe3e50700ab3cb3 in term 1.
I20260807 10:41:05.523358 7457 leader_election.cc:302] T 3d1630616caa4add90cedea257a5250b P 90d08c5ce82845019fe3e50700ab3cb3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 90d08c5ce82845019fe3e50700ab3cb3, bb50cba4a8d545afa1424f32743e7e28; no voters:
I20260807 10:41:05.523715 7871 raft_consensus.cc:2781] T 3d1630616caa4add90cedea257a5250b P 90d08c5ce82845019fe3e50700ab3cb3 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:41:05.524209 7871 raft_consensus.cc:686] T 3d1630616caa4add90cedea257a5250b P 90d08c5ce82845019fe3e50700ab3cb3 [term 1 LEADER]: Becoming Leader. State: Replica: 90d08c5ce82845019fe3e50700ab3cb3, State: Running, Role: LEADER
I20260807 10:41:05.524787 7871 consensus_queue.cc:237] T 3d1630616caa4add90cedea257a5250b P 90d08c5ce82845019fe3e50700ab3cb3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90d08c5ce82845019fe3e50700ab3cb3" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 46759 } } peers { permanent_uuid: "bb50cba4a8d545afa1424f32743e7e28" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 41717 } } peers { permanent_uuid: "ec7b302eab0a4d379ce613bb2340990d" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 35021 } }
W20260807 10:41:05.526944 7569 tablet.cc:2369] T 3d1630616caa4add90cedea257a5250b P 90d08c5ce82845019fe3e50700ab3cb3: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 10:41:05.529706 7374 catalog_manager.cc:5495] T 3d1630616caa4add90cedea257a5250b P 90d08c5ce82845019fe3e50700ab3cb3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 90d08c5ce82845019fe3e50700ab3cb3 (127.20.171.65). New cstate: current_term: 1 leader_uuid: "90d08c5ce82845019fe3e50700ab3cb3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90d08c5ce82845019fe3e50700ab3cb3" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 46759 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bb50cba4a8d545afa1424f32743e7e28" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 41717 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec7b302eab0a4d379ce613bb2340990d" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 35021 } health_report { overall_health: UNKNOWN } } }
I20260807 10:41:05.593104 7859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:05.587421 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34364 (local address 127.20.171.65:46759)
0807 10:41:05.587662 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0807 10:41:05.587670 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 10:41:05.587695 (+ 25us) server_negotiation.cc:407] Connection header received
0807 10:41:05.587961 (+ 266us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:41:05.587966 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:41:05.588046 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:41:05.588204 (+ 158us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 10:41:05.588690 (+ 486us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:05.589403 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:05.590759 (+ 1356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:05.591150 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:05.591287 (+ 137us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:05.591869 (+ 582us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 10:41:05.592405 (+ 536us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 10:41:05.592585 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0807 10:41:05.592746 (+ 161us) server_negotiation.cc:299] Negotiation successful
0807 10:41:05.592795 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260807 10:41:05.601318 7657 raft_consensus.cc:1261] T 3d1630616caa4add90cedea257a5250b P ec7b302eab0a4d379ce613bb2340990d [term 1 FOLLOWER]: Refusing update from remote peer 90d08c5ce82845019fe3e50700ab3cb3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 10:41:05.601356 7798 raft_consensus.cc:1261] T 3d1630616caa4add90cedea257a5250b P bb50cba4a8d545afa1424f32743e7e28 [term 1 FOLLOWER]: Refusing update from remote peer 90d08c5ce82845019fe3e50700ab3cb3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 10:41:05.602280 7875 consensus_queue.cc:1035] T 3d1630616caa4add90cedea257a5250b P 90d08c5ce82845019fe3e50700ab3cb3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb50cba4a8d545afa1424f32743e7e28" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 41717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 10:41:05.602648 7871 consensus_queue.cc:1035] T 3d1630616caa4add90cedea257a5250b P 90d08c5ce82845019fe3e50700ab3cb3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec7b302eab0a4d379ce613bb2340990d" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 35021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 10:41:05.614187 7878 mvcc.cc:205] Tried to move back new op lower bound from 7315862591893381120 to 7315862591593713664. Current Snapshot: MvccSnapshot[applied={T|T < 7315862591893381120}]
I20260807 10:41:05.626348 7375 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46454:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 10:41:05.626632 7375 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46454:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 10:41:05.630255 7375 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 16b7782e0f51400b9947ae7c6066fc77: Sending DeleteTablet for 3 replicas of tablet 3d1630616caa4add90cedea257a5250b
I20260807 10:41:05.631419 7502 tablet_service.cc:1514] Processing DeleteTablet for tablet 3d1630616caa4add90cedea257a5250b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:41:05 UTC) from {username='kudu', principal='kudu/127.20.171.126@KRBTEST.COM'} at 127.0.0.1:34354
I20260807 10:41:05.631611 7778 tablet_service.cc:1514] Processing DeleteTablet for tablet 3d1630616caa4add90cedea257a5250b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:41:05 UTC) from {username='kudu', principal='kudu/127.20.171.126@KRBTEST.COM'} at 127.0.0.1:45580
I20260807 10:41:05.632136 7637 tablet_service.cc:1514] Processing DeleteTablet for tablet 3d1630616caa4add90cedea257a5250b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:41:05 UTC) from {username='kudu', principal='kudu/127.20.171.126@KRBTEST.COM'} at 127.0.0.1:58708
I20260807 10:41:05.632668 7890 tablet_replica.cc:330] T 3d1630616caa4add90cedea257a5250b P bb50cba4a8d545afa1424f32743e7e28: stopping tablet replica
I20260807 10:41:05.632985 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 7438
I20260807 10:41:05.633226 7890 raft_consensus.cc:2229] T 3d1630616caa4add90cedea257a5250b P bb50cba4a8d545afa1424f32743e7e28 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 10:41:05.633834 7890 raft_consensus.cc:2258] T 3d1630616caa4add90cedea257a5250b P bb50cba4a8d545afa1424f32743e7e28 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:41:05.636210 7890 ts_tablet_manager.cc:1905] T 3d1630616caa4add90cedea257a5250b P bb50cba4a8d545afa1424f32743e7e28: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 10:41:05.643563 7890 ts_tablet_manager.cc:1918] T 3d1630616caa4add90cedea257a5250b P bb50cba4a8d545afa1424f32743e7e28: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 10:41:05.643816 7890 log.cc:1196] T 3d1630616caa4add90cedea257a5250b P bb50cba4a8d545afa1424f32743e7e28: Deleting WAL directory at /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786098956060137-21165-0/minicluster-data/ts-2/wal/wals/3d1630616caa4add90cedea257a5250b
I20260807 10:41:05.644510 7890 ts_tablet_manager.cc:1939] T 3d1630616caa4add90cedea257a5250b P bb50cba4a8d545afa1424f32743e7e28: Deleting consensus metadata
I20260807 10:41:05.646744 7362 catalog_manager.cc:4841] TS bb50cba4a8d545afa1424f32743e7e28 (127.20.171.67:41717): tablet 3d1630616caa4add90cedea257a5250b (table test-table [id=9ef154d8827d4d278d11b3129dce7888]) successfully deleted
I20260807 10:41:05.648824 7891 tablet_replica.cc:330] T 3d1630616caa4add90cedea257a5250b P ec7b302eab0a4d379ce613bb2340990d: stopping tablet replica
I20260807 10:41:05.649386 7891 raft_consensus.cc:2229] T 3d1630616caa4add90cedea257a5250b P ec7b302eab0a4d379ce613bb2340990d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 10:41:05.650048 7891 raft_consensus.cc:2258] T 3d1630616caa4add90cedea257a5250b P ec7b302eab0a4d379ce613bb2340990d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:41:05.650722 7889 tablet_replica.cc:330] T 3d1630616caa4add90cedea257a5250b P 90d08c5ce82845019fe3e50700ab3cb3: stopping tablet replica
I20260807 10:41:05.651172 7889 raft_consensus.cc:2229] T 3d1630616caa4add90cedea257a5250b P 90d08c5ce82845019fe3e50700ab3cb3 [term 1 LEADER]: Raft consensus shutting down.
I20260807 10:41:05.651939 7889 raft_consensus.cc:2258] T 3d1630616caa4add90cedea257a5250b P 90d08c5ce82845019fe3e50700ab3cb3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:41:05.654685 7891 ts_tablet_manager.cc:1905] T 3d1630616caa4add90cedea257a5250b P ec7b302eab0a4d379ce613bb2340990d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 10:41:05.655118 7889 ts_tablet_manager.cc:1905] T 3d1630616caa4add90cedea257a5250b P 90d08c5ce82845019fe3e50700ab3cb3: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 07 10:41:05 dist-test-slave-0b58 krb5kdc[7327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099262, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.171.65@KRBTEST.COM
I20260807 10:41:05.661888 7891 ts_tablet_manager.cc:1918] T 3d1630616caa4add90cedea257a5250b P ec7b302eab0a4d379ce613bb2340990d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 10:41:05.662065 7891 log.cc:1196] T 3d1630616caa4add90cedea257a5250b P ec7b302eab0a4d379ce613bb2340990d: Deleting WAL directory at /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786098956060137-21165-0/minicluster-data/ts-1/wal/wals/3d1630616caa4add90cedea257a5250b
I20260807 10:41:05.662632 7891 ts_tablet_manager.cc:1939] T 3d1630616caa4add90cedea257a5250b P ec7b302eab0a4d379ce613bb2340990d: Deleting consensus metadata
I20260807 10:41:05.664328 7889 ts_tablet_manager.cc:1918] T 3d1630616caa4add90cedea257a5250b P 90d08c5ce82845019fe3e50700ab3cb3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 10:41:05.664567 7889 log.cc:1196] T 3d1630616caa4add90cedea257a5250b P 90d08c5ce82845019fe3e50700ab3cb3: Deleting WAL directory at /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786098956060137-21165-0/minicluster-data/ts-0/wal/wals/3d1630616caa4add90cedea257a5250b
I20260807 10:41:05.664681 7362 catalog_manager.cc:4841] TS ec7b302eab0a4d379ce613bb2340990d (127.20.171.66:35021): tablet 3d1630616caa4add90cedea257a5250b (table test-table [id=9ef154d8827d4d278d11b3129dce7888]) successfully deleted
I20260807 10:41:05.665247 7889 ts_tablet_manager.cc:1939] T 3d1630616caa4add90cedea257a5250b P 90d08c5ce82845019fe3e50700ab3cb3: Deleting consensus metadata
I20260807 10:41:05.666858 7359 catalog_manager.cc:4841] TS 90d08c5ce82845019fe3e50700ab3cb3 (127.20.171.65:46759): tablet 3d1630616caa4add90cedea257a5250b (table test-table [id=9ef154d8827d4d278d11b3129dce7888]) successfully deleted
I20260807 10:41:05.667689 7859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:05.634589 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34380 (local address 127.20.171.65:46759)
0807 10:41:05.634803 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0807 10:41:05.634822 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0807 10:41:05.646590 (+ 11768us) server_negotiation.cc:407] Connection header received
0807 10:41:05.647112 (+ 522us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:41:05.647121 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:41:05.647229 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:41:05.647312 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:41:05.649695 (+ 2383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:05.651007 (+ 1312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:05.652608 (+ 1601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:05.653345 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:05.653453 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:05.659330 (+ 5877us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:41:05.659346 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:41:05.659367 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:41:05.659415 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:41:05.663982 (+ 4567us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:41:05.665063 (+ 1081us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:41:05.665076 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:41:05.665083 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:41:05.665296 (+ 213us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:41:05.665831 (+ 535us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:41:05.665837 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:41:05.665840 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:41:05.666363 (+ 523us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:41:05.666665 (+ 302us) server_negotiation.cc:1035] Waiting for connection context
0807 10:41:05.667082 (+ 417us) server_negotiation.cc:299] Negotiation successful
0807 10:41:05.667340 (+ 258us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260807 10:41:05.668439 7563 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:41:05.769809 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 7438
I20260807 10:41:05.792325 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 7574
Aug 07 10:41:05 dist-test-slave-0b58 krb5kdc[7327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099262, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.171.66@KRBTEST.COM
I20260807 10:41:05.807220 7863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:05.793083 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58722 (local address 127.20.171.66:35021)
0807 10:41:05.793293 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0807 10:41:05.793297 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 10:41:05.793315 (+ 18us) server_negotiation.cc:407] Connection header received
0807 10:41:05.793498 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:41:05.793502 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:41:05.793567 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:41:05.793660 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:41:05.795000 (+ 1340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:05.795724 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:05.797369 (+ 1645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:05.797874 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:05.797984 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:05.802007 (+ 4023us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:41:05.802020 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:41:05.802035 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:41:05.802070 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:41:05.804721 (+ 2651us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:41:05.805406 (+ 685us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:41:05.805413 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:41:05.805415 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:41:05.805546 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:41:05.805905 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:41:05.805908 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:41:05.805910 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:41:05.806275 (+ 365us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:41:05.806562 (+ 287us) server_negotiation.cc:1035] Waiting for connection context
0807 10:41:05.806794 (+ 232us) server_negotiation.cc:299] Negotiation successful
0807 10:41:05.806952 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260807 10:41:05.807897 7698 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:41:05.899060 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 7574
I20260807 10:41:05.919691 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 7710
Aug 07 10:41:05 dist-test-slave-0b58 krb5kdc[7327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099262, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.171.67@KRBTEST.COM
I20260807 10:41:05.934824 7861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:05.920500 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45596 (local address 127.20.171.67:41717)
0807 10:41:05.920685 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0807 10:41:05.920690 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:41:05.920708 (+ 18us) server_negotiation.cc:407] Connection header received
0807 10:41:05.920821 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:41:05.920825 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:41:05.920899 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:41:05.920987 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:41:05.922294 (+ 1307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:05.923023 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:05.924252 (+ 1229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:05.924707 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:05.924805 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:05.929357 (+ 4552us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:41:05.929380 (+ 23us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:41:05.929406 (+ 26us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:41:05.929455 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:41:05.932134 (+ 2679us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:41:05.932862 (+ 728us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:41:05.932869 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:41:05.932871 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:41:05.933019 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:41:05.933418 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:41:05.933421 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:41:05.933423 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:41:05.933792 (+ 369us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:41:05.934009 (+ 217us) server_negotiation.cc:1035] Waiting for connection context
0807 10:41:05.934292 (+ 283us) server_negotiation.cc:299] Negotiation successful
0807 10:41:05.934462 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260807 10:41:05.935487 7839 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:41:06.024634 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 7710
I20260807 10:41:06.044868 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 7342
I20260807 10:41:06.046017 7406 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:41:06.161026 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 7342
2026-08-07T10:41:06Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (4789 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-08-07T10:41:06Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T10:41:06Z Disabled control of system clock
I20260807 10:41:06.263718 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786098956060137-21165-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786098956060137-21165-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786098956060137-21165-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.171.126:37889
--webserver_interface=127.20.171.126
--webserver_port=0
--builtin_ntp_servers=127.20.171.84:43903
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.171.126:37889
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260807 10:41:06.607056 7900 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:41:06.607359 7900 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:41:06.607513 7900 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:41:06.614835 7900 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 10:41:06.614938 7900 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:41:06.614988 7900 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:41:06.615039 7900 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 10:41:06.615124 7900 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 10:41:06.624318 7900 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.171.84:43903
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786098956060137-21165-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786098956060137-21165-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.171.126:37889
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.171.126:37889
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.171.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786098956060137-21165-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:41:06.625660 7900 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:41:06.627473 7900 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:41:06.639209 7905 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:41:06.639185 7908 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:41:06.639238 7906 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:41:06.640324 7900 server_base.cc:1034] running on GCE node
I20260807 10:41:06.641074 7900 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:41:06.642407 7900 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:41:06.643602 7900 hybrid_clock.cc:648] HybridClock initialized: now 1786099266643566 us; error 27 us; skew 500 ppm
I20260807 10:41:06.643967 7900 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 10:41:06.651291 7900 webserver.cc:460] Webserver started at http://127.20.171.126:38959/ using document root <none> and password file <none>
I20260807 10:41:06.652004 7900 fs_manager.cc:359] Metadata directory not provided
I20260807 10:41:06.652123 7900 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:41:06.652555 7900 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:41:06.655527 7900 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786098956060137-21165-0/minicluster-data/master-0/data/instance:
uuid: "2204c4db669b4a8496c97c43d0d07396"
format_stamp: "Formatted at 2026-08-07 10:41:06 on dist-test-slave-0b58"
server_key: "36b4fd5fcd62ad00c90d34ef3891d632"
server_key_iv: "a3ce647234716983411462506e4fa15c"
server_key_version: "encryptionkey@0"
I20260807 10:41:06.656495 7900 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786098956060137-21165-0/minicluster-data/master-0/wal/instance:
uuid: "2204c4db669b4a8496c97c43d0d07396"
format_stamp: "Formatted at 2026-08-07 10:41:06 on dist-test-slave-0b58"
server_key: "36b4fd5fcd62ad00c90d34ef3891d632"
server_key_iv: "a3ce647234716983411462506e4fa15c"
server_key_version: "encryptionkey@0"
I20260807 10:41:06.661571 7900 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260807 10:41:06.665006 7914 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:41:06.666348 7900 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260807 10:41:06.666523 7900 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786098956060137-21165-0/minicluster-data/master-0/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786098956060137-21165-0/minicluster-data/master-0/wal
uuid: "2204c4db669b4a8496c97c43d0d07396"
format_stamp: "Formatted at 2026-08-07 10:41:06 on dist-test-slave-0b58"
server_key: "36b4fd5fcd62ad00c90d34ef3891d632"
server_key_iv: "a3ce647234716983411462506e4fa15c"
server_key_version: "encryptionkey@0"
I20260807 10:41:06.666743 7900 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786098956060137-21165-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786098956060137-21165-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786098956060137-21165-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:41:06.681738 7900 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:41:06.682538 7900 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:41:06.682840 7900 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:41:06.701869 7900 rpc_server.cc:307] RPC server started. Bound to: 127.20.171.126:37889
I20260807 10:41:06.701889 7967 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.171.126:37889 every 8 connection(s)
I20260807 10:41:06.703145 7900 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
I20260807 10:41:06.706341 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 7900
I20260807 10:41:06.706537 21165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786098956060137-21165-0/minicluster-data/master-0/wal/instance
I20260807 10:41:06.707041 7968 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:41:06.707132 21165 external_mini_cluster.cc:1428] Setting key 1c9ed775e748872ae3271ec512bbfc18
I20260807 10:41:06.719764 7971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:06.708857 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36448 (local address 127.20.171.126:37889)
0807 10:41:06.709701 (+ 844us) server_negotiation.cc:206] Beginning negotiation
0807 10:41:06.709711 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 10:41:06.709768 (+ 57us) server_negotiation.cc:407] Connection header received
0807 10:41:06.711361 (+ 1593us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:41:06.711381 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:41:06.711798 (+ 417us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:41:06.712190 (+ 392us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:41:06.712748 (+ 558us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:06.714078 (+ 1330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:06.715464 (+ 1386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:06.716113 (+ 649us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:06.716349 (+ 236us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:06.717587 (+ 1238us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:41:06.717595 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:41:06.717607 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:41:06.718161 (+ 554us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:41:06.718228 (+ 67us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:41:06.718247 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:41:06.718431 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0807 10:41:06.718645 (+ 214us) server_negotiation.cc:299] Negotiation successful
0807 10:41:06.718932 (+ 287us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":463,"thread_start_us":287,"threads_started":1}
I20260807 10:41:06.720103 7968 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2204c4db669b4a8496c97c43d0d07396: Bootstrap starting.
I20260807 10:41:06.723201 7968 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2204c4db669b4a8496c97c43d0d07396: Neither blocks nor log segments found. Creating new log.
I20260807 10:41:06.724385 7968 log.cc:824] T 00000000000000000000000000000000 P 2204c4db669b4a8496c97c43d0d07396: Log is configured to *not* fsync() on all Append() calls
I20260807 10:41:06.727016 7968 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2204c4db669b4a8496c97c43d0d07396: No bootstrap required, opened a new log
I20260807 10:41:06.734678 7968 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2204c4db669b4a8496c97c43d0d07396 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2204c4db669b4a8496c97c43d0d07396" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 37889 } }
I20260807 10:41:06.735023 7968 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2204c4db669b4a8496c97c43d0d07396 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:41:06.735095 7968 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2204c4db669b4a8496c97c43d0d07396 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2204c4db669b4a8496c97c43d0d07396, State: Initialized, Role: FOLLOWER
I20260807 10:41:06.735630 7968 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2204c4db669b4a8496c97c43d0d07396 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2204c4db669b4a8496c97c43d0d07396" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 37889 } }
I20260807 10:41:06.735827 7968 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2204c4db669b4a8496c97c43d0d07396 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 10:41:06.735932 7968 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2204c4db669b4a8496c97c43d0d07396 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 10:41:06.736055 7968 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2204c4db669b4a8496c97c43d0d07396 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:41:06.738512 7968 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2204c4db669b4a8496c97c43d0d07396 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2204c4db669b4a8496c97c43d0d07396" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 37889 } }
I20260807 10:41:06.738967 7968 leader_election.cc:302] T 00000000000000000000000000000000 P 2204c4db669b4a8496c97c43d0d07396 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2204c4db669b4a8496c97c43d0d07396; no voters:
I20260807 10:41:06.739503 7968 leader_election.cc:288] T 00000000000000000000000000000000 P 2204c4db669b4a8496c97c43d0d07396 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 10:41:06.739717 7973 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2204c4db669b4a8496c97c43d0d07396 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:41:06.741496 7968 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2204c4db669b4a8496c97c43d0d07396 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 10:41:06.741931 7973 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2204c4db669b4a8496c97c43d0d07396 [term 1 LEADER]: Becoming Leader. State: Replica: 2204c4db669b4a8496c97c43d0d07396, State: Running, Role: LEADER
I20260807 10:41:06.742425 7973 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2204c4db669b4a8496c97c43d0d07396 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2204c4db669b4a8496c97c43d0d07396" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 37889 } }
I20260807 10:41:06.745610 7974 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2204c4db669b4a8496c97c43d0d07396 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2204c4db669b4a8496c97c43d0d07396" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2204c4db669b4a8496c97c43d0d07396" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 37889 } } }
I20260807 10:41:06.746096 7974 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2204c4db669b4a8496c97c43d0d07396 [sys.catalog]: This master's current role is: LEADER
I20260807 10:41:06.746752 7975 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2204c4db669b4a8496c97c43d0d07396 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2204c4db669b4a8496c97c43d0d07396. Latest consensus state: current_term: 1 leader_uuid: "2204c4db669b4a8496c97c43d0d07396" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2204c4db669b4a8496c97c43d0d07396" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 37889 } } }
I20260807 10:41:06.747126 7975 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2204c4db669b4a8496c97c43d0d07396 [sys.catalog]: This master's current role is: LEADER
I20260807 10:41:06.749352 7982 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 10:41:06.754756 7982 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 10:41:06.763113 7982 catalog_manager.cc:1347] Generated new cluster ID: 5adbbecdd979411ca9110743f4b7aa42
I20260807 10:41:06.763240 7982 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 10:41:06.776930 7982 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 10:41:06.778659 7982 catalog_manager.cc:1504] Loading token signing keys...
I20260807 10:41:06.792833 7982 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2204c4db669b4a8496c97c43d0d07396: Generated new TSK 0
I20260807 10:41:06.793655 7982 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 10:41:06.801180 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786098956060137-21165-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786098956060137-21165-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786098956060137-21165-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786098956060137-21165-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.171.65:0
--local_ip_for_outbound_sockets=127.20.171.65
--webserver_interface=127.20.171.65
--webserver_port=0
--tserver_master_addrs=127.20.171.126:37889
--builtin_ntp_servers=127.20.171.84:43903
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260807 10:41:07.157152 7992 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:41:07.157433 7992 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:41:07.157599 7992 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:41:07.165058 7992 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:41:07.165158 7992 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:41:07.165361 7992 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.171.65
I20260807 10:41:07.174556 7992 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.171.84:43903
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786098956060137-21165-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786098956060137-21165-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.171.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786098956060137-21165-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.171.65
--webserver_port=0
--tserver_master_addrs=127.20.171.126:37889
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.171.65
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786098956060137-21165-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:41:07.175879 7992 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:41:07.177739 7992 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:41:07.190955 7997 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:41:07.190927 7998 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:41:07.190889 8000 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:41:07.192162 7992 server_base.cc:1034] running on GCE node
I20260807 10:41:07.192828 7992 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:41:07.193764 7992 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:41:07.194974 7992 hybrid_clock.cc:648] HybridClock initialized: now 1786099267194933 us; error 36 us; skew 500 ppm
I20260807 10:41:07.195314 7992 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 10:41:07.197625 7992 webserver.cc:460] Webserver started at http://127.20.171.65:34035/ using document root <none> and password file <none>
I20260807 10:41:07.198328 7992 fs_manager.cc:359] Metadata directory not provided
I20260807 10:41:07.198446 7992 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:41:07.198774 7992 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:41:07.201692 7992 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786098956060137-21165-0/minicluster-data/ts-0/data/instance:
uuid: "7c9e124d462f4a96b6bf4de0cd627709"
format_stamp: "Formatted at 2026-08-07 10:41:07 on dist-test-slave-0b58"
server_key: "7ac84c7ac7f38481fb7d3bedc613daa9"
server_key_iv: "0215110c6e8f1429f9eba09cf484522e"
server_key_version: "encryptionkey@0"
I20260807 10:41:07.202455 7992 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786098956060137-21165-0/minicluster-data/ts-0/wal/instance:
uuid: "7c9e124d462f4a96b6bf4de0cd627709"
format_stamp: "Formatted at 2026-08-07 10:41:07 on dist-test-slave-0b58"
server_key: "7ac84c7ac7f38481fb7d3bedc613daa9"
server_key_iv: "0215110c6e8f1429f9eba09cf484522e"
server_key_version: "encryptionkey@0"
I20260807 10:41:07.207535 7992 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.005s
I20260807 10:41:07.210968 8006 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:41:07.212177 7992 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260807 10:41:07.212381 7992 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786098956060137-21165-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786098956060137-21165-0/minicluster-data/ts-0/wal
uuid: "7c9e124d462f4a96b6bf4de0cd627709"
format_stamp: "Formatted at 2026-08-07 10:41:07 on dist-test-slave-0b58"
server_key: "7ac84c7ac7f38481fb7d3bedc613daa9"
server_key_iv: "0215110c6e8f1429f9eba09cf484522e"
server_key_version: "encryptionkey@0"
I20260807 10:41:07.212590 7992 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786098956060137-21165-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786098956060137-21165-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786098956060137-21165-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:41:07.247255 7992 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:41:07.248566 7992 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:41:07.248924 7992 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:41:07.250011 7992 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:41:07.251428 7992 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:41:07.251516 7992 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:41:07.251593 7992 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:41:07.251657 7992 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:41:07.285647 7992 rpc_server.cc:307] RPC server started. Bound to: 127.20.171.65:37627
I20260807 10:41:07.285739 8122 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.171.65:37627 every 8 connection(s)
I20260807 10:41:07.287003 7992 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786098956060137-21165-0/minicluster-data/ts-0/data/info.pb
I20260807 10:41:07.290254 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 7992
I20260807 10:41:07.290426 21165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786098956060137-21165-0/minicluster-data/ts-0/wal/instance
I20260807 10:41:07.290947 21165 external_mini_cluster.cc:1428] Setting key 50e26650edd9aeabd15711c7ec39f083
I20260807 10:41:07.294054 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786098956060137-21165-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786098956060137-21165-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786098956060137-21165-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786098956060137-21165-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.171.66:0
--local_ip_for_outbound_sockets=127.20.171.66
--webserver_interface=127.20.171.66
--webserver_port=0
--tserver_master_addrs=127.20.171.126:37889
--builtin_ntp_servers=127.20.171.84:43903
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260807 10:41:07.299988 8125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:07.289587 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.65:47639 (local address 127.20.171.126:37889)
0807 10:41:07.290077 (+ 490us) server_negotiation.cc:206] Beginning negotiation
0807 10:41:07.290084 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:41:07.291403 (+ 1319us) server_negotiation.cc:407] Connection header received
0807 10:41:07.293649 (+ 2246us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:41:07.293656 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:41:07.293740 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:41:07.293866 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:41:07.294921 (+ 1055us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:07.295659 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:07.297251 (+ 1592us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:07.297650 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:07.297798 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:07.299135 (+ 1337us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:41:07.299140 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:41:07.299143 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:41:07.299159 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:41:07.299198 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:41:07.299210 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:41:07.299304 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0807 10:41:07.299523 (+ 219us) server_negotiation.cc:299] Negotiation successful
0807 10:41:07.299616 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":357,"thread_start_us":224,"threads_started":1}
I20260807 10:41:07.300963 8126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:07.290148 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:37889 (local address 127.20.171.65:47639)
0807 10:41:07.291198 (+ 1050us) negotiation.cc:107] Waiting for socket to connect
0807 10:41:07.291252 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0807 10:41:07.293404 (+ 2152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:41:07.294046 (+ 642us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:41:07.294053 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:41:07.294132 (+ 79us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:41:07.294759 (+ 627us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:41:07.294775 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:41:07.295832 (+ 1057us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:41:07.295837 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:41:07.297101 (+ 1264us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:41:07.297113 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:41:07.297877 (+ 764us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:41:07.297885 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:41:07.298108 (+ 223us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:07.298793 (+ 685us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 10:41:07.298796 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:41:07.298846 (+ 50us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 10:41:07.298922 (+ 76us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:41:07.299313 (+ 391us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:41:07.299327 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:41:07.299341 (+ 14us) client_negotiation.cc:769] Sending connection context
0807 10:41:07.299509 (+ 168us) client_negotiation.cc:240] Negotiation successful
0807 10:41:07.299877 (+ 368us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":532,"thread_start_us":359,"threads_started":1}
I20260807 10:41:07.302446 8123 heartbeater.cc:347] Connected to a master server at 127.20.171.126:37889
I20260807 10:41:07.302771 8123 heartbeater.cc:464] Registering TS with master...
I20260807 10:41:07.303620 8123 heartbeater.cc:511] Master 127.20.171.126:37889 requested a full tablet report, sending...
I20260807 10:41:07.306001 7932 ts_manager.cc:194] Registered new tserver with Master: 7c9e124d462f4a96b6bf4de0cd627709 (127.20.171.65:37627)
I20260807 10:41:07.308168 7932 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.20.171.65:47639
W20260807 10:41:07.640075 8127 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:41:07.640475 8127 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:41:07.640635 8127 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:41:07.648448 8127 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:41:07.648591 8127 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:41:07.648849 8127 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.171.66
I20260807 10:41:07.658433 8127 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.171.84:43903
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786098956060137-21165-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786098956060137-21165-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.171.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786098956060137-21165-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.171.66
--webserver_port=0
--tserver_master_addrs=127.20.171.126:37889
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.171.66
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786098956060137-21165-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:41:07.659708 8127 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:41:07.661500 8127 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:41:07.675581 8132 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:41:07.675554 8135 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:41:07.675527 8133 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:41:07.676450 8127 server_base.cc:1034] running on GCE node
I20260807 10:41:07.677160 8127 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:41:07.678162 8127 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:41:07.679404 8127 hybrid_clock.cc:648] HybridClock initialized: now 1786099267679342 us; error 55 us; skew 500 ppm
I20260807 10:41:07.679764 8127 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 10:41:07.682229 8127 webserver.cc:460] Webserver started at http://127.20.171.66:41433/ using document root <none> and password file <none>
I20260807 10:41:07.682979 8127 fs_manager.cc:359] Metadata directory not provided
I20260807 10:41:07.683117 8127 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:41:07.683447 8127 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:41:07.686574 8127 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786098956060137-21165-0/minicluster-data/ts-1/data/instance:
uuid: "823766fc730345d28368b7330f05f86e"
format_stamp: "Formatted at 2026-08-07 10:41:07 on dist-test-slave-0b58"
server_key: "593a89efd2164fb8a6ad23604debac09"
server_key_iv: "e9beba0cf32cae08031349e7d50ff315"
server_key_version: "encryptionkey@0"
I20260807 10:41:07.687439 8127 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786098956060137-21165-0/minicluster-data/ts-1/wal/instance:
uuid: "823766fc730345d28368b7330f05f86e"
format_stamp: "Formatted at 2026-08-07 10:41:07 on dist-test-slave-0b58"
server_key: "593a89efd2164fb8a6ad23604debac09"
server_key_iv: "e9beba0cf32cae08031349e7d50ff315"
server_key_version: "encryptionkey@0"
I20260807 10:41:07.692898 8127 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260807 10:41:07.696523 8141 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:41:07.697795 8127 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260807 10:41:07.697999 8127 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786098956060137-21165-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786098956060137-21165-0/minicluster-data/ts-1/wal
uuid: "823766fc730345d28368b7330f05f86e"
format_stamp: "Formatted at 2026-08-07 10:41:07 on dist-test-slave-0b58"
server_key: "593a89efd2164fb8a6ad23604debac09"
server_key_iv: "e9beba0cf32cae08031349e7d50ff315"
server_key_version: "encryptionkey@0"
I20260807 10:41:07.698220 8127 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786098956060137-21165-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786098956060137-21165-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786098956060137-21165-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:41:07.728849 8127 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:41:07.729759 8127 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:41:07.730111 8127 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:41:07.731142 8127 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:41:07.732702 8127 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:41:07.732836 8127 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:41:07.732963 8127 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:41:07.733057 8127 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:41:07.767580 8127 rpc_server.cc:307] RPC server started. Bound to: 127.20.171.66:36135
I20260807 10:41:07.767670 8259 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.171.66:36135 every 8 connection(s)
I20260807 10:41:07.768951 8127 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786098956060137-21165-0/minicluster-data/ts-1/data/info.pb
I20260807 10:41:07.770396 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 8127
I20260807 10:41:07.770594 21165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786098956060137-21165-0/minicluster-data/ts-1/wal/instance
I20260807 10:41:07.771181 21165 external_mini_cluster.cc:1428] Setting key 7310a3c5f83c65928c87094a67c18623
I20260807 10:41:07.774554 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786098956060137-21165-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786098956060137-21165-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786098956060137-21165-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786098956060137-21165-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.171.67:0
--local_ip_for_outbound_sockets=127.20.171.67
--webserver_interface=127.20.171.67
--webserver_port=0
--tserver_master_addrs=127.20.171.126:37889
--builtin_ntp_servers=127.20.171.84:43903
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260807 10:41:07.782346 8125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:07.772309 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.66:53599 (local address 127.20.171.126:37889)
0807 10:41:07.772490 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0807 10:41:07.772494 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 10:41:07.774130 (+ 1636us) server_negotiation.cc:407] Connection header received
0807 10:41:07.776025 (+ 1895us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:41:07.776030 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:41:07.776114 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:41:07.776226 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:41:07.777317 (+ 1091us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:07.778041 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:07.779570 (+ 1529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:07.779973 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:07.780104 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:07.781549 (+ 1445us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:41:07.781554 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:41:07.781557 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:41:07.781574 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:41:07.781605 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:41:07.781617 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:41:07.781707 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0807 10:41:07.781938 (+ 231us) server_negotiation.cc:299] Negotiation successful
0807 10:41:07.782032 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260807 10:41:07.783355 8262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:07.773034 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:37889 (local address 127.20.171.66:53599)
0807 10:41:07.773980 (+ 946us) negotiation.cc:107] Waiting for socket to connect
0807 10:41:07.774023 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0807 10:41:07.775765 (+ 1742us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:41:07.776482 (+ 717us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:41:07.776490 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:41:07.776579 (+ 89us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:41:07.777137 (+ 558us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:41:07.777152 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:41:07.778201 (+ 1049us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:41:07.778211 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:41:07.779427 (+ 1216us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:41:07.779439 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:41:07.780208 (+ 769us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:41:07.780217 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:41:07.780507 (+ 290us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:07.781221 (+ 714us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 10:41:07.781224 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:41:07.781260 (+ 36us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 10:41:07.781344 (+ 84us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:41:07.781720 (+ 376us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:41:07.781733 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:41:07.781746 (+ 13us) client_negotiation.cc:769] Sending connection context
0807 10:41:07.781909 (+ 163us) client_negotiation.cc:240] Negotiation successful
0807 10:41:07.782287 (+ 378us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":534,"thread_start_us":336,"threads_started":1}
I20260807 10:41:07.784777 8260 heartbeater.cc:347] Connected to a master server at 127.20.171.126:37889
I20260807 10:41:07.785100 8260 heartbeater.cc:464] Registering TS with master...
I20260807 10:41:07.785818 8260 heartbeater.cc:511] Master 127.20.171.126:37889 requested a full tablet report, sending...
I20260807 10:41:07.787330 7932 ts_manager.cc:194] Registered new tserver with Master: 823766fc730345d28368b7330f05f86e (127.20.171.66:36135)
I20260807 10:41:07.788655 7932 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.20.171.66:53599
W20260807 10:41:08.123960 8263 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:41:08.124248 8263 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:41:08.124445 8263 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:41:08.131845 8263 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:41:08.131948 8263 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:41:08.132129 8263 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.171.67
I20260807 10:41:08.141422 8263 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.171.84:43903
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786098956060137-21165-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786098956060137-21165-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.171.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786098956060137-21165-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.171.67
--webserver_port=0
--tserver_master_addrs=127.20.171.126:37889
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.171.67
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786098956060137-21165-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:41:08.142943 8263 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:41:08.144798 8263 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:41:08.158855 8269 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:41:08.158982 8271 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:41:08.160106 8268 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:41:08.160992 8263 server_base.cc:1034] running on GCE node
I20260807 10:41:08.161710 8263 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:41:08.162714 8263 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:41:08.163964 8263 hybrid_clock.cc:648] HybridClock initialized: now 1786099268163910 us; error 69 us; skew 500 ppm
I20260807 10:41:08.164363 8263 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 10:41:08.166743 8263 webserver.cc:460] Webserver started at http://127.20.171.67:37727/ using document root <none> and password file <none>
I20260807 10:41:08.167472 8263 fs_manager.cc:359] Metadata directory not provided
I20260807 10:41:08.167610 8263 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:41:08.167946 8263 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:41:08.171043 8263 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786098956060137-21165-0/minicluster-data/ts-2/data/instance:
uuid: "84626ecff84d4dd081d621031dec1719"
format_stamp: "Formatted at 2026-08-07 10:41:08 on dist-test-slave-0b58"
server_key: "05925f4e030793f52654485d2c65e836"
server_key_iv: "511c0980c56a5b6171b6d3a57f0f3723"
server_key_version: "encryptionkey@0"
I20260807 10:41:08.171851 8263 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786098956060137-21165-0/minicluster-data/ts-2/wal/instance:
uuid: "84626ecff84d4dd081d621031dec1719"
format_stamp: "Formatted at 2026-08-07 10:41:08 on dist-test-slave-0b58"
server_key: "05925f4e030793f52654485d2c65e836"
server_key_iv: "511c0980c56a5b6171b6d3a57f0f3723"
server_key_version: "encryptionkey@0"
I20260807 10:41:08.177047 8263 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260807 10:41:08.180557 8277 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:41:08.181862 8263 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260807 10:41:08.182055 8263 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786098956060137-21165-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786098956060137-21165-0/minicluster-data/ts-2/wal
uuid: "84626ecff84d4dd081d621031dec1719"
format_stamp: "Formatted at 2026-08-07 10:41:08 on dist-test-slave-0b58"
server_key: "05925f4e030793f52654485d2c65e836"
server_key_iv: "511c0980c56a5b6171b6d3a57f0f3723"
server_key_version: "encryptionkey@0"
I20260807 10:41:08.182291 8263 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786098956060137-21165-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786098956060137-21165-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786098956060137-21165-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:41:08.209784 8263 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:41:08.210711 8263 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:41:08.211107 8263 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:41:08.212814 8263 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:41:08.214744 8263 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:41:08.214895 8263 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:41:08.215029 8263 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:41:08.215123 8263 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:41:08.256026 8263 rpc_server.cc:307] RPC server started. Bound to: 127.20.171.67:42573
I20260807 10:41:08.256116 8398 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.171.67:42573 every 8 connection(s)
I20260807 10:41:08.257376 8263 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786098956060137-21165-0/minicluster-data/ts-2/data/info.pb
I20260807 10:41:08.259963 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 8263
I20260807 10:41:08.260166 21165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786098956060137-21165-0/minicluster-data/ts-2/wal/instance
I20260807 10:41:08.260705 21165 external_mini_cluster.cc:1428] Setting key 2fb87564292db9df0c7e6277064fc21c
I20260807 10:41:08.270272 8125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:08.259787 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.67:60057 (local address 127.20.171.126:37889)
0807 10:41:08.260005 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0807 10:41:08.260010 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:41:08.261713 (+ 1703us) server_negotiation.cc:407] Connection header received
0807 10:41:08.263987 (+ 2274us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:41:08.263991 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:41:08.264056 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:41:08.264144 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:41:08.265235 (+ 1091us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:08.265965 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:08.267493 (+ 1528us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:08.267891 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:08.267982 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:08.269339 (+ 1357us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:41:08.269344 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:41:08.269347 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:41:08.269366 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:41:08.269399 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:41:08.269411 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:41:08.269483 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0807 10:41:08.269815 (+ 332us) server_negotiation.cc:299] Negotiation successful
0807 10:41:08.269909 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":94}
I20260807 10:41:08.271239 8401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:08.260436 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:37889 (local address 127.20.171.67:60057)
0807 10:41:08.261544 (+ 1108us) negotiation.cc:107] Waiting for socket to connect
0807 10:41:08.261595 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0807 10:41:08.263712 (+ 2117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:41:08.264412 (+ 700us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:41:08.264421 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:41:08.264508 (+ 87us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:41:08.265087 (+ 579us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:41:08.265105 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:41:08.266093 (+ 988us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:41:08.266097 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:41:08.267359 (+ 1262us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:41:08.267372 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:41:08.268079 (+ 707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:41:08.268083 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:41:08.268358 (+ 275us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:08.269037 (+ 679us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 10:41:08.269040 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:41:08.269085 (+ 45us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 10:41:08.269163 (+ 78us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:41:08.269518 (+ 355us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:41:08.269531 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:41:08.269543 (+ 12us) client_negotiation.cc:769] Sending connection context
0807 10:41:08.269757 (+ 214us) client_negotiation.cc:240] Negotiation successful
0807 10:41:08.270116 (+ 359us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":552,"thread_start_us":329,"threads_started":1}
I20260807 10:41:08.272670 8399 heartbeater.cc:347] Connected to a master server at 127.20.171.126:37889
I20260807 10:41:08.272979 8399 heartbeater.cc:464] Registering TS with master...
I20260807 10:41:08.273736 8399 heartbeater.cc:511] Master 127.20.171.126:37889 requested a full tablet report, sending...
I20260807 10:41:08.275316 7932 ts_manager.cc:194] Registered new tserver with Master: 84626ecff84d4dd081d621031dec1719 (127.20.171.67:42573)
I20260807 10:41:08.276322 21165 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 10:41:08.276552 7932 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.20.171.67:60057
I20260807 10:41:08.288430 8125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:08.281393 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36450 (local address 127.20.171.126:37889)
0807 10:41:08.281562 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0807 10:41:08.281566 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 10:41:08.282069 (+ 503us) server_negotiation.cc:407] Connection header received
0807 10:41:08.282208 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:41:08.282212 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:41:08.282266 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:41:08.282348 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:41:08.282911 (+ 563us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:08.284005 (+ 1094us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:08.285562 (+ 1557us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:08.286071 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:08.286236 (+ 165us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:08.287556 (+ 1320us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:41:08.287562 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:41:08.287565 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:41:08.287588 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:41:08.287632 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:41:08.287645 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:41:08.287809 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0807 10:41:08.288019 (+ 210us) server_negotiation.cc:299] Negotiation successful
0807 10:41:08.288082 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260807 10:41:08.292861 7932 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36450:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 10:41:08.299737 7932 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 10:41:08.311084 8123 heartbeater.cc:503] Master 127.20.171.126:37889 was elected leader, sending a full tablet report...
I20260807 10:41:08.323406 8416 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:08.314729 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.67:42573 (local address 127.0.0.1:39514)
0807 10:41:08.315273 (+ 544us) negotiation.cc:107] Waiting for socket to connect
0807 10:41:08.315293 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0807 10:41:08.315454 (+ 161us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:41:08.316813 (+ 1359us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:41:08.316820 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:41:08.316848 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:41:08.317289 (+ 441us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:41:08.317303 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:41:08.318965 (+ 1662us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:41:08.318973 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:41:08.320854 (+ 1881us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:41:08.320872 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:41:08.322302 (+ 1430us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:41:08.322317 (+ 15us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:41:08.322537 (+ 220us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:08.322600 (+ 63us) client_negotiation.cc:769] Sending connection context
0807 10:41:08.322761 (+ 161us) client_negotiation.cc:240] Negotiation successful
0807 10:41:08.322966 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":423,"mutex_wait_us":5,"thread_start_us":898,"threads_started":1}
I20260807 10:41:08.323797 8413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:08.312635 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35568 (local address 127.20.171.66:36135)
0807 10:41:08.313252 (+ 617us) server_negotiation.cc:206] Beginning negotiation
0807 10:41:08.313260 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 10:41:08.314471 (+ 1211us) server_negotiation.cc:407] Connection header received
0807 10:41:08.314848 (+ 377us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:41:08.314859 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:41:08.315159 (+ 300us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:41:08.315354 (+ 195us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:41:08.316573 (+ 1219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:08.318186 (+ 1613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:08.321159 (+ 2973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:08.322623 (+ 1464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:08.322777 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:08.323021 (+ 244us) server_negotiation.cc:1035] Waiting for connection context
0807 10:41:08.323233 (+ 212us) server_negotiation.cc:299] Negotiation successful
0807 10:41:08.323432 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":432,"thread_start_us":712,"threads_started":1}
I20260807 10:41:08.324090 8417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:08.315324 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39514 (local address 127.20.171.67:42573)
0807 10:41:08.316097 (+ 773us) server_negotiation.cc:206] Beginning negotiation
0807 10:41:08.316108 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 10:41:08.316143 (+ 35us) server_negotiation.cc:407] Connection header received
0807 10:41:08.316298 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:41:08.316315 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:41:08.316606 (+ 291us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:41:08.316836 (+ 230us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:41:08.317449 (+ 613us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:08.318829 (+ 1380us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:08.321121 (+ 2292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:08.322102 (+ 981us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:08.322266 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:08.322566 (+ 300us) server_negotiation.cc:1035] Waiting for connection context
0807 10:41:08.323510 (+ 944us) server_negotiation.cc:299] Negotiation successful
0807 10:41:08.323693 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":598,"thread_start_us":424,"threads_started":1}
I20260807 10:41:08.324571 8414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:08.313100 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.66:36135 (local address 127.0.0.1:35568)
0807 10:41:08.314317 (+ 1217us) negotiation.cc:107] Waiting for socket to connect
0807 10:41:08.314365 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0807 10:41:08.314556 (+ 191us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:41:08.315698 (+ 1142us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:41:08.315703 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:41:08.315734 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:41:08.316352 (+ 618us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:41:08.316366 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:41:08.318318 (+ 1952us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:41:08.318322 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:41:08.320881 (+ 2559us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:41:08.320895 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:41:08.322837 (+ 1942us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:41:08.322843 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:41:08.323027 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:08.323057 (+ 30us) client_negotiation.cc:769] Sending connection context
0807 10:41:08.323139 (+ 82us) client_negotiation.cc:240] Negotiation successful
0807 10:41:08.323263 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":889,"mutex_wait_us":30,"thread_start_us":706,"threads_started":1}
I20260807 10:41:08.325683 8415 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:08.313290 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.65:37627 (local address 127.0.0.1:51950)
0807 10:41:08.314312 (+ 1022us) negotiation.cc:107] Waiting for socket to connect
0807 10:41:08.314366 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0807 10:41:08.314556 (+ 190us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:41:08.315612 (+ 1056us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:41:08.315621 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:41:08.315657 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:41:08.318376 (+ 2719us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:41:08.318391 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:41:08.320420 (+ 2029us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:41:08.320426 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:41:08.322596 (+ 2170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:41:08.322612 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:41:08.324924 (+ 2312us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:41:08.324932 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:41:08.325095 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:08.325117 (+ 22us) client_negotiation.cc:769] Sending connection context
0807 10:41:08.325227 (+ 110us) client_negotiation.cc:240] Negotiation successful
0807 10:41:08.325356 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":827,"mutex_wait_us":43,"thread_start_us":1126,"threads_started":1}
I20260807 10:41:08.325814 8412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:08.312171 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51950 (local address 127.20.171.65:37627)
0807 10:41:08.312844 (+ 673us) server_negotiation.cc:206] Beginning negotiation
0807 10:41:08.312855 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 10:41:08.314744 (+ 1889us) server_negotiation.cc:407] Connection header received
0807 10:41:08.314853 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:41:08.314880 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:41:08.315153 (+ 273us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:41:08.315349 (+ 196us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:41:08.318594 (+ 3245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:08.320202 (+ 1608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:08.322824 (+ 2622us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:08.324383 (+ 1559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:08.324522 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:08.324783 (+ 261us) server_negotiation.cc:1035] Waiting for connection context
0807 10:41:08.325273 (+ 490us) server_negotiation.cc:299] Negotiation successful
0807 10:41:08.325447 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":488,"thread_start_us":330,"threads_started":1}
I20260807 10:41:08.328624 8327 tablet_service.cc:1467] Processing CreateTablet for tablet b62abef4ed8747caa0b3386953827153 (DEFAULT_TABLE table=test-table [id=d5ca1a2e5df9449fa80d3800182ffb16]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:41:08.328624 8190 tablet_service.cc:1467] Processing CreateTablet for tablet b62abef4ed8747caa0b3386953827153 (DEFAULT_TABLE table=test-table [id=d5ca1a2e5df9449fa80d3800182ffb16]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:41:08.328936 8056 tablet_service.cc:1467] Processing CreateTablet for tablet b62abef4ed8747caa0b3386953827153 (DEFAULT_TABLE table=test-table [id=d5ca1a2e5df9449fa80d3800182ffb16]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:41:08.330174 8190 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b62abef4ed8747caa0b3386953827153. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:41:08.330166 8327 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b62abef4ed8747caa0b3386953827153. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:41:08.330271 8056 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b62abef4ed8747caa0b3386953827153. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:41:08.342595 8418 tablet_bootstrap.cc:492] T b62abef4ed8747caa0b3386953827153 P 7c9e124d462f4a96b6bf4de0cd627709: Bootstrap starting.
I20260807 10:41:08.346375 8418 tablet_bootstrap.cc:654] T b62abef4ed8747caa0b3386953827153 P 7c9e124d462f4a96b6bf4de0cd627709: Neither blocks nor log segments found. Creating new log.
I20260807 10:41:08.348316 8418 log.cc:824] T b62abef4ed8747caa0b3386953827153 P 7c9e124d462f4a96b6bf4de0cd627709: Log is configured to *not* fsync() on all Append() calls
I20260807 10:41:08.350960 8419 tablet_bootstrap.cc:492] T b62abef4ed8747caa0b3386953827153 P 84626ecff84d4dd081d621031dec1719: Bootstrap starting.
I20260807 10:41:08.351580 8418 tablet_bootstrap.cc:492] T b62abef4ed8747caa0b3386953827153 P 7c9e124d462f4a96b6bf4de0cd627709: No bootstrap required, opened a new log
I20260807 10:41:08.351861 8418 ts_tablet_manager.cc:1397] T b62abef4ed8747caa0b3386953827153 P 7c9e124d462f4a96b6bf4de0cd627709: Time spent bootstrapping tablet: real 0.009s user 0.003s sys 0.003s
I20260807 10:41:08.354230 8419 tablet_bootstrap.cc:654] T b62abef4ed8747caa0b3386953827153 P 84626ecff84d4dd081d621031dec1719: Neither blocks nor log segments found. Creating new log.
I20260807 10:41:08.354447 8421 tablet_bootstrap.cc:492] T b62abef4ed8747caa0b3386953827153 P 823766fc730345d28368b7330f05f86e: Bootstrap starting.
I20260807 10:41:08.355275 8419 log.cc:824] T b62abef4ed8747caa0b3386953827153 P 84626ecff84d4dd081d621031dec1719: Log is configured to *not* fsync() on all Append() calls
I20260807 10:41:08.358662 8421 tablet_bootstrap.cc:654] T b62abef4ed8747caa0b3386953827153 P 823766fc730345d28368b7330f05f86e: Neither blocks nor log segments found. Creating new log.
I20260807 10:41:08.359200 8419 tablet_bootstrap.cc:492] T b62abef4ed8747caa0b3386953827153 P 84626ecff84d4dd081d621031dec1719: No bootstrap required, opened a new log
I20260807 10:41:08.359472 8419 ts_tablet_manager.cc:1397] T b62abef4ed8747caa0b3386953827153 P 84626ecff84d4dd081d621031dec1719: Time spent bootstrapping tablet: real 0.009s user 0.005s sys 0.000s
I20260807 10:41:08.359905 8421 log.cc:824] T b62abef4ed8747caa0b3386953827153 P 823766fc730345d28368b7330f05f86e: Log is configured to *not* fsync() on all Append() calls
I20260807 10:41:08.361498 8418 raft_consensus.cc:348] T b62abef4ed8747caa0b3386953827153 P 7c9e124d462f4a96b6bf4de0cd627709 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c9e124d462f4a96b6bf4de0cd627709" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 37627 } } peers { permanent_uuid: "823766fc730345d28368b7330f05f86e" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 36135 } } peers { permanent_uuid: "84626ecff84d4dd081d621031dec1719" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 42573 } }
I20260807 10:41:08.361976 8418 raft_consensus.cc:374] T b62abef4ed8747caa0b3386953827153 P 7c9e124d462f4a96b6bf4de0cd627709 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:41:08.362092 8418 raft_consensus.cc:729] T b62abef4ed8747caa0b3386953827153 P 7c9e124d462f4a96b6bf4de0cd627709 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c9e124d462f4a96b6bf4de0cd627709, State: Initialized, Role: FOLLOWER
I20260807 10:41:08.362779 8418 consensus_queue.cc:260] T b62abef4ed8747caa0b3386953827153 P 7c9e124d462f4a96b6bf4de0cd627709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c9e124d462f4a96b6bf4de0cd627709" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 37627 } } peers { permanent_uuid: "823766fc730345d28368b7330f05f86e" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 36135 } } peers { permanent_uuid: "84626ecff84d4dd081d621031dec1719" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 42573 } }
I20260807 10:41:08.363184 8421 tablet_bootstrap.cc:492] T b62abef4ed8747caa0b3386953827153 P 823766fc730345d28368b7330f05f86e: No bootstrap required, opened a new log
I20260807 10:41:08.363509 8421 ts_tablet_manager.cc:1397] T b62abef4ed8747caa0b3386953827153 P 823766fc730345d28368b7330f05f86e: Time spent bootstrapping tablet: real 0.014s user 0.003s sys 0.003s
I20260807 10:41:08.364727 8418 ts_tablet_manager.cc:1428] T b62abef4ed8747caa0b3386953827153 P 7c9e124d462f4a96b6bf4de0cd627709: Time spent starting tablet: real 0.013s user 0.014s sys 0.001s
I20260807 10:41:08.369764 8419 raft_consensus.cc:348] T b62abef4ed8747caa0b3386953827153 P 84626ecff84d4dd081d621031dec1719 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c9e124d462f4a96b6bf4de0cd627709" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 37627 } } peers { permanent_uuid: "823766fc730345d28368b7330f05f86e" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 36135 } } peers { permanent_uuid: "84626ecff84d4dd081d621031dec1719" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 42573 } }
I20260807 10:41:08.370343 8419 raft_consensus.cc:374] T b62abef4ed8747caa0b3386953827153 P 84626ecff84d4dd081d621031dec1719 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:41:08.370462 8419 raft_consensus.cc:729] T b62abef4ed8747caa0b3386953827153 P 84626ecff84d4dd081d621031dec1719 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84626ecff84d4dd081d621031dec1719, State: Initialized, Role: FOLLOWER
I20260807 10:41:08.371088 8419 consensus_queue.cc:260] T b62abef4ed8747caa0b3386953827153 P 84626ecff84d4dd081d621031dec1719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c9e124d462f4a96b6bf4de0cd627709" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 37627 } } peers { permanent_uuid: "823766fc730345d28368b7330f05f86e" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 36135 } } peers { permanent_uuid: "84626ecff84d4dd081d621031dec1719" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 42573 } }
I20260807 10:41:08.372277 8399 heartbeater.cc:503] Master 127.20.171.126:37889 was elected leader, sending a full tablet report...
I20260807 10:41:08.372025 8421 raft_consensus.cc:348] T b62abef4ed8747caa0b3386953827153 P 823766fc730345d28368b7330f05f86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c9e124d462f4a96b6bf4de0cd627709" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 37627 } } peers { permanent_uuid: "823766fc730345d28368b7330f05f86e" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 36135 } } peers { permanent_uuid: "84626ecff84d4dd081d621031dec1719" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 42573 } }
I20260807 10:41:08.372514 8421 raft_consensus.cc:374] T b62abef4ed8747caa0b3386953827153 P 823766fc730345d28368b7330f05f86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:41:08.372632 8421 raft_consensus.cc:729] T b62abef4ed8747caa0b3386953827153 P 823766fc730345d28368b7330f05f86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 823766fc730345d28368b7330f05f86e, State: Initialized, Role: FOLLOWER
I20260807 10:41:08.372857 8419 ts_tablet_manager.cc:1428] T b62abef4ed8747caa0b3386953827153 P 84626ecff84d4dd081d621031dec1719: Time spent starting tablet: real 0.013s user 0.009s sys 0.005s
I20260807 10:41:08.373216 8421 consensus_queue.cc:260] T b62abef4ed8747caa0b3386953827153 P 823766fc730345d28368b7330f05f86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c9e124d462f4a96b6bf4de0cd627709" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 37627 } } peers { permanent_uuid: "823766fc730345d28368b7330f05f86e" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 36135 } } peers { permanent_uuid: "84626ecff84d4dd081d621031dec1719" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 42573 } }
I20260807 10:41:08.374282 8260 heartbeater.cc:503] Master 127.20.171.126:37889 was elected leader, sending a full tablet report...
I20260807 10:41:08.374861 8421 ts_tablet_manager.cc:1428] T b62abef4ed8747caa0b3386953827153 P 823766fc730345d28368b7330f05f86e: Time spent starting tablet: real 0.011s user 0.010s sys 0.000s
W20260807 10:41:08.509155 8400 tablet.cc:2369] T b62abef4ed8747caa0b3386953827153 P 84626ecff84d4dd081d621031dec1719: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 10:41:08.521049 8261 tablet.cc:2369] T b62abef4ed8747caa0b3386953827153 P 823766fc730345d28368b7330f05f86e: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 10:41:08.539639 8124 tablet.cc:2369] T b62abef4ed8747caa0b3386953827153 P 7c9e124d462f4a96b6bf4de0cd627709: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 10:41:08.558954 8426 raft_consensus.cc:482] T b62abef4ed8747caa0b3386953827153 P 84626ecff84d4dd081d621031dec1719 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 10:41:08.559291 8426 raft_consensus.cc:504] T b62abef4ed8747caa0b3386953827153 P 84626ecff84d4dd081d621031dec1719 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c9e124d462f4a96b6bf4de0cd627709" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 37627 } } peers { permanent_uuid: "823766fc730345d28368b7330f05f86e" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 36135 } } peers { permanent_uuid: "84626ecff84d4dd081d621031dec1719" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 42573 } }
I20260807 10:41:08.561086 8426 leader_election.cc:288] T b62abef4ed8747caa0b3386953827153 P 84626ecff84d4dd081d621031dec1719 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7c9e124d462f4a96b6bf4de0cd627709 (127.20.171.65:37627), 823766fc730345d28368b7330f05f86e (127.20.171.66:36135)
I20260807 10:41:08.567911 8401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:08.561452 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.66:36135 (local address 127.20.171.67:58785)
0807 10:41:08.561830 (+ 378us) negotiation.cc:107] Waiting for socket to connect
0807 10:41:08.561855 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0807 10:41:08.562035 (+ 180us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:41:08.562522 (+ 487us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:41:08.562525 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:41:08.562550 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:41:08.562825 (+ 275us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:41:08.562836 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:41:08.564102 (+ 1266us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:41:08.564108 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:41:08.565748 (+ 1640us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:41:08.565774 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:41:08.567084 (+ 1310us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:41:08.567091 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:41:08.567263 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:08.567317 (+ 54us) client_negotiation.cc:769] Sending connection context
0807 10:41:08.567432 (+ 115us) client_negotiation.cc:240] Negotiation successful
0807 10:41:08.567586 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":249,"mutex_wait_us":1,"spinlock_wait_cycles":48768}
I20260807 10:41:08.567899 8413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:08.561699 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.67:58785 (local address 127.20.171.66:36135)
0807 10:41:08.561912 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0807 10:41:08.561920 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 10:41:08.561941 (+ 21us) server_negotiation.cc:407] Connection header received
0807 10:41:08.562236 (+ 295us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:41:08.562242 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:41:08.562349 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:41:08.562474 (+ 125us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:41:08.562992 (+ 518us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:08.563978 (+ 986us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:08.565934 (+ 1956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:08.566934 (+ 1000us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:08.567053 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:08.567104 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0807 10:41:08.567466 (+ 362us) server_negotiation.cc:299] Negotiation successful
0807 10:41:08.567596 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260807 10:41:08.568496 8412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:08.561699 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.67:37827 (local address 127.20.171.65:37627)
0807 10:41:08.561894 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0807 10:41:08.561899 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:41:08.562637 (+ 738us) server_negotiation.cc:407] Connection header received
0807 10:41:08.562836 (+ 199us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:41:08.562842 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:41:08.562948 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:41:08.563030 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:41:08.563673 (+ 643us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:08.564567 (+ 894us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:08.566484 (+ 1917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:08.567484 (+ 1000us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:08.567630 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:08.567693 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0807 10:41:08.568148 (+ 455us) server_negotiation.cc:299] Negotiation successful
0807 10:41:08.568323 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260807 10:41:08.569032 8428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:08.561667 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.65:37627 (local address 127.20.171.67:37827)
0807 10:41:08.562516 (+ 849us) negotiation.cc:107] Waiting for socket to connect
0807 10:41:08.562534 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 10:41:08.562686 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:41:08.563074 (+ 388us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:41:08.563080 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:41:08.563109 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:41:08.563500 (+ 391us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:41:08.563512 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:41:08.564712 (+ 1200us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:41:08.564716 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:41:08.566283 (+ 1567us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:41:08.566298 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:41:08.567665 (+ 1367us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:41:08.567671 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:41:08.567939 (+ 268us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:08.567978 (+ 39us) client_negotiation.cc:769] Sending connection context
0807 10:41:08.568682 (+ 704us) client_negotiation.cc:240] Negotiation successful
0807 10:41:08.568803 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":696,"spinlock_wait_cycles":768,"thread_start_us":411,"threads_started":1}
I20260807 10:41:08.569072 8212 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b62abef4ed8747caa0b3386953827153" candidate_uuid: "84626ecff84d4dd081d621031dec1719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "823766fc730345d28368b7330f05f86e" is_pre_election: true
I20260807 10:41:08.569764 8212 raft_consensus.cc:2454] T b62abef4ed8747caa0b3386953827153 P 823766fc730345d28368b7330f05f86e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 84626ecff84d4dd081d621031dec1719 in term 0.
I20260807 10:41:08.570178 8077 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b62abef4ed8747caa0b3386953827153" candidate_uuid: "84626ecff84d4dd081d621031dec1719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c9e124d462f4a96b6bf4de0cd627709" is_pre_election: true
I20260807 10:41:08.570569 8280 leader_election.cc:302] T b62abef4ed8747caa0b3386953827153 P 84626ecff84d4dd081d621031dec1719 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 823766fc730345d28368b7330f05f86e, 84626ecff84d4dd081d621031dec1719; no voters:
I20260807 10:41:08.570757 8077 raft_consensus.cc:2454] T b62abef4ed8747caa0b3386953827153 P 7c9e124d462f4a96b6bf4de0cd627709 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 84626ecff84d4dd081d621031dec1719 in term 0.
I20260807 10:41:08.571009 8426 raft_consensus.cc:2781] T b62abef4ed8747caa0b3386953827153 P 84626ecff84d4dd081d621031dec1719 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 10:41:08.571153 8426 raft_consensus.cc:482] T b62abef4ed8747caa0b3386953827153 P 84626ecff84d4dd081d621031dec1719 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 10:41:08.571291 8426 raft_consensus.cc:3037] T b62abef4ed8747caa0b3386953827153 P 84626ecff84d4dd081d621031dec1719 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:41:08.573668 8426 raft_consensus.cc:504] T b62abef4ed8747caa0b3386953827153 P 84626ecff84d4dd081d621031dec1719 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c9e124d462f4a96b6bf4de0cd627709" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 37627 } } peers { permanent_uuid: "823766fc730345d28368b7330f05f86e" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 36135 } } peers { permanent_uuid: "84626ecff84d4dd081d621031dec1719" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 42573 } }
I20260807 10:41:08.574290 8426 leader_election.cc:288] T b62abef4ed8747caa0b3386953827153 P 84626ecff84d4dd081d621031dec1719 [CANDIDATE]: Term 1 election: Requested vote from peers 7c9e124d462f4a96b6bf4de0cd627709 (127.20.171.65:37627), 823766fc730345d28368b7330f05f86e (127.20.171.66:36135)
I20260807 10:41:08.574700 8077 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b62abef4ed8747caa0b3386953827153" candidate_uuid: "84626ecff84d4dd081d621031dec1719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c9e124d462f4a96b6bf4de0cd627709"
I20260807 10:41:08.574769 8212 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b62abef4ed8747caa0b3386953827153" candidate_uuid: "84626ecff84d4dd081d621031dec1719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "823766fc730345d28368b7330f05f86e"
I20260807 10:41:08.574921 8077 raft_consensus.cc:3037] T b62abef4ed8747caa0b3386953827153 P 7c9e124d462f4a96b6bf4de0cd627709 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:41:08.575011 8212 raft_consensus.cc:3037] T b62abef4ed8747caa0b3386953827153 P 823766fc730345d28368b7330f05f86e [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:41:08.577278 8077 raft_consensus.cc:2454] T b62abef4ed8747caa0b3386953827153 P 7c9e124d462f4a96b6bf4de0cd627709 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 84626ecff84d4dd081d621031dec1719 in term 1.
I20260807 10:41:08.577322 8212 raft_consensus.cc:2454] T b62abef4ed8747caa0b3386953827153 P 823766fc730345d28368b7330f05f86e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 84626ecff84d4dd081d621031dec1719 in term 1.
I20260807 10:41:08.577704 8281 leader_election.cc:302] T b62abef4ed8747caa0b3386953827153 P 84626ecff84d4dd081d621031dec1719 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c9e124d462f4a96b6bf4de0cd627709, 84626ecff84d4dd081d621031dec1719; no voters:
I20260807 10:41:08.578028 8426 raft_consensus.cc:2781] T b62abef4ed8747caa0b3386953827153 P 84626ecff84d4dd081d621031dec1719 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:41:08.578595 8426 raft_consensus.cc:686] T b62abef4ed8747caa0b3386953827153 P 84626ecff84d4dd081d621031dec1719 [term 1 LEADER]: Becoming Leader. State: Replica: 84626ecff84d4dd081d621031dec1719, State: Running, Role: LEADER
I20260807 10:41:08.579144 8426 consensus_queue.cc:237] T b62abef4ed8747caa0b3386953827153 P 84626ecff84d4dd081d621031dec1719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c9e124d462f4a96b6bf4de0cd627709" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 37627 } } peers { permanent_uuid: "823766fc730345d28368b7330f05f86e" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 36135 } } peers { permanent_uuid: "84626ecff84d4dd081d621031dec1719" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 42573 } }
I20260807 10:41:08.583701 7931 catalog_manager.cc:5495] T b62abef4ed8747caa0b3386953827153 P 84626ecff84d4dd081d621031dec1719 reported cstate change: term changed from 0 to 1, leader changed from <none> to 84626ecff84d4dd081d621031dec1719 (127.20.171.67). New cstate: current_term: 1 leader_uuid: "84626ecff84d4dd081d621031dec1719" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c9e124d462f4a96b6bf4de0cd627709" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 37627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "823766fc730345d28368b7330f05f86e" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 36135 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "84626ecff84d4dd081d621031dec1719" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 42573 } health_report { overall_health: HEALTHY } } }
I20260807 10:41:08.624935 8417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:08.619740 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39516 (local address 127.20.171.67:42573)
0807 10:41:08.619947 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0807 10:41:08.619951 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 10:41:08.619970 (+ 19us) server_negotiation.cc:407] Connection header received
0807 10:41:08.620056 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:41:08.620059 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:41:08.620136 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:41:08.620325 (+ 189us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 10:41:08.620670 (+ 345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:08.621393 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:08.622784 (+ 1391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:08.623175 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:08.623273 (+ 98us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:08.623776 (+ 503us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 10:41:08.624292 (+ 516us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 10:41:08.624433 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0807 10:41:08.624579 (+ 146us) server_negotiation.cc:299] Negotiation successful
0807 10:41:08.624616 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260807 10:41:08.633316 8212 raft_consensus.cc:1261] T b62abef4ed8747caa0b3386953827153 P 823766fc730345d28368b7330f05f86e [term 1 FOLLOWER]: Refusing update from remote peer 84626ecff84d4dd081d621031dec1719: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 10:41:08.633342 8077 raft_consensus.cc:1261] T b62abef4ed8747caa0b3386953827153 P 7c9e124d462f4a96b6bf4de0cd627709 [term 1 FOLLOWER]: Refusing update from remote peer 84626ecff84d4dd081d621031dec1719: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 10:41:08.634290 8426 consensus_queue.cc:1035] T b62abef4ed8747caa0b3386953827153 P 84626ecff84d4dd081d621031dec1719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "823766fc730345d28368b7330f05f86e" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 36135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 10:41:08.634603 8429 consensus_queue.cc:1035] T b62abef4ed8747caa0b3386953827153 P 84626ecff84d4dd081d621031dec1719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c9e124d462f4a96b6bf4de0cd627709" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 37627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 10:41:08.648500 8433 mvcc.cc:205] Tried to move back new op lower bound from 7315862604311400448 to 7315862604104458240. Current Snapshot: MvccSnapshot[applied={T|T < 7315862604311400448}]
I20260807 10:41:08.650941 8434 mvcc.cc:205] Tried to move back new op lower bound from 7315862604311400448 to 7315862604104458240. Current Snapshot: MvccSnapshot[applied={T|T < 7315862604311400448}]
I20260807 10:41:08.661422 7932 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:36450:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 10:41:08.661729 7932 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:36450:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 10:41:08.665524 7932 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2204c4db669b4a8496c97c43d0d07396: Sending DeleteTablet for 3 replicas of tablet b62abef4ed8747caa0b3386953827153
I20260807 10:41:08.666855 8056 tablet_service.cc:1514] Processing DeleteTablet for tablet b62abef4ed8747caa0b3386953827153 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:41:08 UTC) from {username='slave'} at 127.0.0.1:51950
I20260807 10:41:08.666855 8190 tablet_service.cc:1514] Processing DeleteTablet for tablet b62abef4ed8747caa0b3386953827153 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:41:08 UTC) from {username='slave'} at 127.0.0.1:35568
I20260807 10:41:08.667318 8327 tablet_service.cc:1514] Processing DeleteTablet for tablet b62abef4ed8747caa0b3386953827153 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:41:08 UTC) from {username='slave'} at 127.0.0.1:39514
I20260807 10:41:08.669032 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 7992
I20260807 10:41:08.679265 8442 tablet_replica.cc:330] T b62abef4ed8747caa0b3386953827153 P 7c9e124d462f4a96b6bf4de0cd627709: stopping tablet replica
I20260807 10:41:08.680014 8442 raft_consensus.cc:2229] T b62abef4ed8747caa0b3386953827153 P 7c9e124d462f4a96b6bf4de0cd627709 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 10:41:08.680787 8442 raft_consensus.cc:2258] T b62abef4ed8747caa0b3386953827153 P 7c9e124d462f4a96b6bf4de0cd627709 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:41:08.681535 8443 tablet_replica.cc:330] T b62abef4ed8747caa0b3386953827153 P 84626ecff84d4dd081d621031dec1719: stopping tablet replica
I20260807 10:41:08.681778 8441 tablet_replica.cc:330] T b62abef4ed8747caa0b3386953827153 P 823766fc730345d28368b7330f05f86e: stopping tablet replica
I20260807 10:41:08.682261 8441 raft_consensus.cc:2229] T b62abef4ed8747caa0b3386953827153 P 823766fc730345d28368b7330f05f86e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 10:41:08.682773 8441 raft_consensus.cc:2258] T b62abef4ed8747caa0b3386953827153 P 823766fc730345d28368b7330f05f86e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:41:08.685052 8441 ts_tablet_manager.cc:1905] T b62abef4ed8747caa0b3386953827153 P 823766fc730345d28368b7330f05f86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 10:41:08.685084 8442 ts_tablet_manager.cc:1905] T b62abef4ed8747caa0b3386953827153 P 7c9e124d462f4a96b6bf4de0cd627709: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 10:41:08.682358 8443 raft_consensus.cc:2229] T b62abef4ed8747caa0b3386953827153 P 84626ecff84d4dd081d621031dec1719 [term 1 LEADER]: Raft consensus shutting down.
I20260807 10:41:08.685873 8443 raft_consensus.cc:2258] T b62abef4ed8747caa0b3386953827153 P 84626ecff84d4dd081d621031dec1719 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:41:08.692071 8443 ts_tablet_manager.cc:1905] T b62abef4ed8747caa0b3386953827153 P 84626ecff84d4dd081d621031dec1719: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 10:41:08.693969 8441 ts_tablet_manager.cc:1918] T b62abef4ed8747caa0b3386953827153 P 823766fc730345d28368b7330f05f86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 10:41:08.694214 8441 log.cc:1196] T b62abef4ed8747caa0b3386953827153 P 823766fc730345d28368b7330f05f86e: Deleting WAL directory at /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786098956060137-21165-0/minicluster-data/ts-1/wal/wals/b62abef4ed8747caa0b3386953827153
I20260807 10:41:08.694842 8441 ts_tablet_manager.cc:1939] T b62abef4ed8747caa0b3386953827153 P 823766fc730345d28368b7330f05f86e: Deleting consensus metadata
I20260807 10:41:08.695142 8442 ts_tablet_manager.cc:1918] T b62abef4ed8747caa0b3386953827153 P 7c9e124d462f4a96b6bf4de0cd627709: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 10:41:08.695339 8442 log.cc:1196] T b62abef4ed8747caa0b3386953827153 P 7c9e124d462f4a96b6bf4de0cd627709: Deleting WAL directory at /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786098956060137-21165-0/minicluster-data/ts-0/wal/wals/b62abef4ed8747caa0b3386953827153
I20260807 10:41:08.695946 8442 ts_tablet_manager.cc:1939] T b62abef4ed8747caa0b3386953827153 P 7c9e124d462f4a96b6bf4de0cd627709: Deleting consensus metadata
I20260807 10:41:08.696409 8412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:08.670661 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51966 (local address 127.20.171.65:37627)
0807 10:41:08.670843 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0807 10:41:08.670849 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:41:08.686030 (+ 15181us) server_negotiation.cc:407] Connection header received
0807 10:41:08.686379 (+ 349us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:41:08.686387 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:41:08.686504 (+ 117us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:41:08.686599 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:41:08.687360 (+ 761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:08.688483 (+ 1123us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:08.690397 (+ 1914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:08.691075 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:08.691174 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:08.694342 (+ 3168us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:41:08.694354 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:41:08.694372 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:41:08.695174 (+ 802us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:41:08.695258 (+ 84us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:41:08.695284 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:41:08.695410 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0807 10:41:08.695810 (+ 400us) server_negotiation.cc:299] Negotiation successful
0807 10:41:08.695942 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260807 10:41:08.696959 7917 catalog_manager.cc:4841] TS 823766fc730345d28368b7330f05f86e (127.20.171.66:36135): tablet b62abef4ed8747caa0b3386953827153 (table test-table [id=d5ca1a2e5df9449fa80d3800182ffb16]) successfully deleted
I20260807 10:41:08.697660 8118 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:41:08.704571 8443 ts_tablet_manager.cc:1918] T b62abef4ed8747caa0b3386953827153 P 84626ecff84d4dd081d621031dec1719: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 10:41:08.704861 8443 log.cc:1196] T b62abef4ed8747caa0b3386953827153 P 84626ecff84d4dd081d621031dec1719: Deleting WAL directory at /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786098956060137-21165-0/minicluster-data/ts-2/wal/wals/b62abef4ed8747caa0b3386953827153
I20260807 10:41:08.705497 8443 ts_tablet_manager.cc:1939] T b62abef4ed8747caa0b3386953827153 P 84626ecff84d4dd081d621031dec1719: Deleting consensus metadata
I20260807 10:41:08.707542 7918 catalog_manager.cc:4841] TS 84626ecff84d4dd081d621031dec1719 (127.20.171.67:42573): tablet b62abef4ed8747caa0b3386953827153 (table test-table [id=d5ca1a2e5df9449fa80d3800182ffb16]) successfully deleted
I20260807 10:41:08.801117 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 7992
I20260807 10:41:08.801194 7918 catalog_manager.cc:4841] TS 7c9e124d462f4a96b6bf4de0cd627709 (127.20.171.65:37627): tablet b62abef4ed8747caa0b3386953827153 (table test-table [id=d5ca1a2e5df9449fa80d3800182ffb16]) successfully deleted
I20260807 10:41:08.823899 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 8127
I20260807 10:41:08.831645 8413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:08.824817 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35570 (local address 127.20.171.66:36135)
0807 10:41:08.825023 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0807 10:41:08.825029 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:41:08.825052 (+ 23us) server_negotiation.cc:407] Connection header received
0807 10:41:08.825200 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:41:08.825206 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:41:08.825336 (+ 130us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:41:08.825446 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:41:08.825831 (+ 385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:08.826998 (+ 1167us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:08.828385 (+ 1387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:08.828912 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:08.829055 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:08.830229 (+ 1174us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:41:08.830239 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:41:08.830255 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:41:08.830843 (+ 588us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:41:08.830892 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:41:08.830912 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:41:08.831050 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0807 10:41:08.831186 (+ 136us) server_negotiation.cc:299] Negotiation successful
0807 10:41:08.831299 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260807 10:41:08.832393 8255 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:41:08.923019 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 8127
I20260807 10:41:08.943843 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 8263
I20260807 10:41:08.952548 8417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:08.944754 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39528 (local address 127.20.171.67:42573)
0807 10:41:08.944963 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0807 10:41:08.944973 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 10:41:08.944998 (+ 25us) server_negotiation.cc:407] Connection header received
0807 10:41:08.945136 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:41:08.945141 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:41:08.945267 (+ 126us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:41:08.945384 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:41:08.945935 (+ 551us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:08.947173 (+ 1238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:08.948637 (+ 1464us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:08.949324 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:08.949454 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:08.950590 (+ 1136us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:41:08.950603 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:41:08.950624 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:41:08.951626 (+ 1002us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:41:08.951700 (+ 74us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:41:08.951735 (+ 35us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:41:08.951852 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0807 10:41:08.951987 (+ 135us) server_negotiation.cc:299] Negotiation successful
0807 10:41:08.952104 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260807 10:41:08.953459 8394 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:41:09.077587 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 8263
I20260807 10:41:09.101442 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 7900
I20260807 10:41:09.102581 7963 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:41:09.214686 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 7900
2026-08-07T10:41:09Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (3054 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786098956060137-21165-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 10:41:09 dist-test-slave-0b58 krb5kdc[8451](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 10:41:09 dist-test-slave-0b58 krb5kdc[8451](info): set up 2 sockets
Aug 07 10:41:09 dist-test-slave-0b58 krb5kdc[8451](info): commencing operation
krb5kdc: starting...
W20260807 10:41:10.390187 21165 mini_kdc.cc:121] Time spent starting KDC: real 1.128s user 0.007s sys 0.044s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786098956060137-21165-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786098956060137-21165-0/krb5kdc/test-user.keytab.
Aug 07 10:41:10 dist-test-slave-0b58 krb5kdc[8451](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099270, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T10:41:10Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T10:41:10Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.171.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.171.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.171.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.126.keytab.
Entry for principal kudu/127.20.171.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.126.keytab.
I20260807 10:41:10.740542 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786098956060137-21165-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786098956060137-21165-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786098956060137-21165-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.171.126:37853
--webserver_interface=127.20.171.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.126.keytab
--principal=kudu/127.20.171.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.171.84:33597
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.171.126:37853
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786098956060137-21165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786098956060137-21165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786098956060137-21165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:41:11.100137 8464 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:41:11.100451 8464 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:41:11.100637 8464 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:41:11.107947 8464 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 10:41:11.108052 8464 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:41:11.108098 8464 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:41:11.108199 8464 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 10:41:11.108284 8464 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 10:41:11.118223 8464 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.171.84:33597
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786098956060137-21165-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786098956060137-21165-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.171.126:37853
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.126.keytab
--principal=kudu/127.20.171.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.171.126:37853
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.171.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786098956060137-21165-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:41:11.119513 8464 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:41:11.120826 8464 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:41:11.132712 8470 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:41:11.132702 8472 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:41:11.133193 8469 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:41:11.133661 8464 server_base.cc:1034] running on GCE node
I20260807 10:41:11.134400 8464 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:41:11.135751 8464 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:41:11.136976 8464 hybrid_clock.cc:648] HybridClock initialized: now 1786099271136940 us; error 47 us; skew 500 ppm
I20260807 10:41:11.137349 8464 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:41:11 dist-test-slave-0b58 krb5kdc[8451](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099271, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:41:11.140573 8464 init.cc:377] Logged in from keytab as kudu/127.20.171.126@KRBTEST.COM (short username kudu)
I20260807 10:41:11.141973 8464 webserver.cc:460] Webserver started at http://127.20.171.126:46575/ using document root <none> and password file <none>
I20260807 10:41:11.142617 8464 fs_manager.cc:359] Metadata directory not provided
I20260807 10:41:11.142719 8464 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:41:11.142966 8464 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:41:11.145965 8464 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786098956060137-21165-0/minicluster-data/master-0/data/instance:
uuid: "726f931f082142dd8a906969f49c5e6b"
format_stamp: "Formatted at 2026-08-07 10:41:11 on dist-test-slave-0b58"
server_key: "468e25aeb4558d4bcda51db15f4adc2e"
server_key_iv: "e1a113638e89f69da0aa6cb062ceb2cf"
server_key_version: "encryptionkey@0"
I20260807 10:41:11.146672 8464 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786098956060137-21165-0/minicluster-data/master-0/wal/instance:
uuid: "726f931f082142dd8a906969f49c5e6b"
format_stamp: "Formatted at 2026-08-07 10:41:11 on dist-test-slave-0b58"
server_key: "468e25aeb4558d4bcda51db15f4adc2e"
server_key_iv: "e1a113638e89f69da0aa6cb062ceb2cf"
server_key_version: "encryptionkey@0"
I20260807 10:41:11.151837 8464 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260807 10:41:11.155892 8480 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:41:11.157296 8464 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 10:41:11.157480 8464 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786098956060137-21165-0/minicluster-data/master-0/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786098956060137-21165-0/minicluster-data/master-0/wal
uuid: "726f931f082142dd8a906969f49c5e6b"
format_stamp: "Formatted at 2026-08-07 10:41:11 on dist-test-slave-0b58"
server_key: "468e25aeb4558d4bcda51db15f4adc2e"
server_key_iv: "e1a113638e89f69da0aa6cb062ceb2cf"
server_key_version: "encryptionkey@0"
I20260807 10:41:11.157687 8464 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786098956060137-21165-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786098956060137-21165-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786098956060137-21165-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:41:11.200165 8464 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:41:11.205067 8464 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:41:11.205399 8464 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:41:11.225132 8464 rpc_server.cc:307] RPC server started. Bound to: 127.20.171.126:37853
I20260807 10:41:11.225193 8534 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.171.126:37853 every 8 connection(s)
I20260807 10:41:11.226538 8464 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
I20260807 10:41:11.230149 8535 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:41:11.235589 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 8464
I20260807 10:41:11.235791 21165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786098956060137-21165-0/minicluster-data/master-0/wal/instance
I20260807 10:41:11.236434 21165 external_mini_cluster.cc:1428] Setting key 6ca40f849e7fa761e78f379b7560f604
I20260807 10:41:11.241698 8535 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 726f931f082142dd8a906969f49c5e6b: Bootstrap starting.
I20260807 10:41:11.244868 8535 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 726f931f082142dd8a906969f49c5e6b: Neither blocks nor log segments found. Creating new log.
I20260807 10:41:11.246281 8535 log.cc:824] T 00000000000000000000000000000000 P 726f931f082142dd8a906969f49c5e6b: Log is configured to *not* fsync() on all Append() calls
I20260807 10:41:11.249729 8535 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 726f931f082142dd8a906969f49c5e6b: No bootstrap required, opened a new log
Aug 07 10:41:11 dist-test-slave-0b58 krb5kdc[8451](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099270, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.171.126@KRBTEST.COM
I20260807 10:41:11.259153 8535 raft_consensus.cc:348] T 00000000000000000000000000000000 P 726f931f082142dd8a906969f49c5e6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "726f931f082142dd8a906969f49c5e6b" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 37853 } }
I20260807 10:41:11.259565 8535 raft_consensus.cc:374] T 00000000000000000000000000000000 P 726f931f082142dd8a906969f49c5e6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:41:11.259696 8535 raft_consensus.cc:729] T 00000000000000000000000000000000 P 726f931f082142dd8a906969f49c5e6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 726f931f082142dd8a906969f49c5e6b, State: Initialized, Role: FOLLOWER
I20260807 10:41:11.260478 8535 consensus_queue.cc:260] T 00000000000000000000000000000000 P 726f931f082142dd8a906969f49c5e6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "726f931f082142dd8a906969f49c5e6b" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 37853 } }
I20260807 10:41:11.260771 8535 raft_consensus.cc:388] T 00000000000000000000000000000000 P 726f931f082142dd8a906969f49c5e6b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 10:41:11.260996 8535 raft_consensus.cc:482] T 00000000000000000000000000000000 P 726f931f082142dd8a906969f49c5e6b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 10:41:11.261184 8535 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 726f931f082142dd8a906969f49c5e6b [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:41:11.261736 8538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:11.238396 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37542 (local address 127.20.171.126:37853)
0807 10:41:11.239302 (+ 906us) server_negotiation.cc:206] Beginning negotiation
0807 10:41:11.239314 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 10:41:11.239357 (+ 43us) server_negotiation.cc:407] Connection header received
0807 10:41:11.241190 (+ 1833us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:41:11.241212 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:41:11.241586 (+ 374us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:41:11.241984 (+ 398us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:41:11.243530 (+ 1546us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:11.244895 (+ 1365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:11.246944 (+ 2049us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:11.247955 (+ 1011us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:11.248080 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:11.253290 (+ 5210us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:41:11.253298 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:41:11.253316 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:41:11.253355 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:41:11.257306 (+ 3951us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:41:11.258032 (+ 726us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:41:11.258041 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:41:11.258050 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:41:11.258265 (+ 215us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:41:11.258667 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:41:11.258673 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:41:11.258676 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:41:11.259190 (+ 514us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:41:11.259525 (+ 335us) server_negotiation.cc:1035] Waiting for connection context
0807 10:41:11.259966 (+ 441us) server_negotiation.cc:299] Negotiation successful
0807 10:41:11.260418 (+ 452us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":686,"thread_start_us":441,"threads_started":1}
I20260807 10:41:11.264386 8535 raft_consensus.cc:504] T 00000000000000000000000000000000 P 726f931f082142dd8a906969f49c5e6b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "726f931f082142dd8a906969f49c5e6b" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 37853 } }
I20260807 10:41:11.265017 8535 leader_election.cc:302] T 00000000000000000000000000000000 P 726f931f082142dd8a906969f49c5e6b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 726f931f082142dd8a906969f49c5e6b; no voters:
I20260807 10:41:11.265654 8535 leader_election.cc:288] T 00000000000000000000000000000000 P 726f931f082142dd8a906969f49c5e6b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 10:41:11.265815 8540 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 726f931f082142dd8a906969f49c5e6b [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:41:11.266551 8540 raft_consensus.cc:686] T 00000000000000000000000000000000 P 726f931f082142dd8a906969f49c5e6b [term 1 LEADER]: Becoming Leader. State: Replica: 726f931f082142dd8a906969f49c5e6b, State: Running, Role: LEADER
I20260807 10:41:11.267102 8540 consensus_queue.cc:237] T 00000000000000000000000000000000 P 726f931f082142dd8a906969f49c5e6b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "726f931f082142dd8a906969f49c5e6b" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 37853 } }
I20260807 10:41:11.267794 8535 sys_catalog.cc:564] T 00000000000000000000000000000000 P 726f931f082142dd8a906969f49c5e6b [sys.catalog]: configured and running, proceeding with master startup.
I20260807 10:41:11.269865 8541 sys_catalog.cc:455] T 00000000000000000000000000000000 P 726f931f082142dd8a906969f49c5e6b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "726f931f082142dd8a906969f49c5e6b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "726f931f082142dd8a906969f49c5e6b" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 37853 } } }
I20260807 10:41:11.269958 8542 sys_catalog.cc:455] T 00000000000000000000000000000000 P 726f931f082142dd8a906969f49c5e6b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 726f931f082142dd8a906969f49c5e6b. Latest consensus state: current_term: 1 leader_uuid: "726f931f082142dd8a906969f49c5e6b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "726f931f082142dd8a906969f49c5e6b" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 37853 } } }
I20260807 10:41:11.270349 8541 sys_catalog.cc:458] T 00000000000000000000000000000000 P 726f931f082142dd8a906969f49c5e6b [sys.catalog]: This master's current role is: LEADER
I20260807 10:41:11.270349 8542 sys_catalog.cc:458] T 00000000000000000000000000000000 P 726f931f082142dd8a906969f49c5e6b [sys.catalog]: This master's current role is: LEADER
I20260807 10:41:11.274289 8545 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 10:41:11.279860 8545 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 10:41:11.288488 8545 catalog_manager.cc:1347] Generated new cluster ID: c193b82ed1044fed8bb525301afd3275
I20260807 10:41:11.288594 8545 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 10:41:11.309430 8545 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 10:41:11.310750 8545 catalog_manager.cc:1504] Loading token signing keys...
I20260807 10:41:11.318759 8545 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 726f931f082142dd8a906969f49c5e6b: Generated new TSK 0
I20260807 10:41:11.319579 8545 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.171.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.171.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.171.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.65.keytab.
Entry for principal kudu/127.20.171.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.65.keytab.
I20260807 10:41:11.411609 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786098956060137-21165-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786098956060137-21165-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786098956060137-21165-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786098956060137-21165-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.171.65:0
--local_ip_for_outbound_sockets=127.20.171.65
--webserver_interface=127.20.171.65
--webserver_port=0
--tserver_master_addrs=127.20.171.126:37853
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.65.keytab
--principal=kudu/127.20.171.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.171.84:33597
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786098956060137-21165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786098956060137-21165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786098956060137-21165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:41:11.771147 8562 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:41:11.771418 8562 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:41:11.771601 8562 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:41:11.779098 8562 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:41:11.779251 8562 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:41:11.779399 8562 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.171.65
I20260807 10:41:11.789037 8562 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.171.84:33597
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786098956060137-21165-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786098956060137-21165-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.65.keytab
--principal=kudu/127.20.171.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.171.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786098956060137-21165-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.171.65
--webserver_port=0
--tserver_master_addrs=127.20.171.126:37853
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.171.65
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786098956060137-21165-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:41:11.790377 8562 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:41:11.791652 8562 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:41:11.804701 8567 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:41:11.804654 8570 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:41:11.804613 8568 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:41:11.805964 8562 server_base.cc:1034] running on GCE node
I20260807 10:41:11.806542 8562 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:41:11.807425 8562 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:41:11.808622 8562 hybrid_clock.cc:648] HybridClock initialized: now 1786099271808588 us; error 32 us; skew 500 ppm
I20260807 10:41:11.808945 8562 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:41:11 dist-test-slave-0b58 krb5kdc[8451](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099271, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:41:11.816413 8562 init.cc:377] Logged in from keytab as kudu/127.20.171.65@KRBTEST.COM (short username kudu)
I20260807 10:41:11.817991 8562 webserver.cc:460] Webserver started at http://127.20.171.65:36289/ using document root <none> and password file <none>
I20260807 10:41:11.818746 8562 fs_manager.cc:359] Metadata directory not provided
I20260807 10:41:11.818892 8562 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:41:11.819247 8562 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:41:11.822288 8562 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786098956060137-21165-0/minicluster-data/ts-0/data/instance:
uuid: "fb94c69482e7487ba39233fac1c086cd"
format_stamp: "Formatted at 2026-08-07 10:41:11 on dist-test-slave-0b58"
server_key: "1690cc5a7bb698310a57ec31f2f43249"
server_key_iv: "ca066990adcff3ca5ed759f6f07182ae"
server_key_version: "encryptionkey@0"
I20260807 10:41:11.823045 8562 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786098956060137-21165-0/minicluster-data/ts-0/wal/instance:
uuid: "fb94c69482e7487ba39233fac1c086cd"
format_stamp: "Formatted at 2026-08-07 10:41:11 on dist-test-slave-0b58"
server_key: "1690cc5a7bb698310a57ec31f2f43249"
server_key_iv: "ca066990adcff3ca5ed759f6f07182ae"
server_key_version: "encryptionkey@0"
I20260807 10:41:11.828238 8562 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.004s
I20260807 10:41:11.831665 8577 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:41:11.833019 8562 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260807 10:41:11.833182 8562 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786098956060137-21165-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786098956060137-21165-0/minicluster-data/ts-0/wal
uuid: "fb94c69482e7487ba39233fac1c086cd"
format_stamp: "Formatted at 2026-08-07 10:41:11 on dist-test-slave-0b58"
server_key: "1690cc5a7bb698310a57ec31f2f43249"
server_key_iv: "ca066990adcff3ca5ed759f6f07182ae"
server_key_version: "encryptionkey@0"
I20260807 10:41:11.833391 8562 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786098956060137-21165-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786098956060137-21165-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786098956060137-21165-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:41:11.852123 8562 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:41:11.856086 8562 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:41:11.856437 8562 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:41:11.857479 8562 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:41:11.858982 8562 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:41:11.859056 8562 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:41:11.859207 8562 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:41:11.859314 8562 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:41:11.893939 8562 rpc_server.cc:307] RPC server started. Bound to: 127.20.171.65:39649
I20260807 10:41:11.893985 8694 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.171.65:39649 every 8 connection(s)
I20260807 10:41:11.895221 8562 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786098956060137-21165-0/minicluster-data/ts-0/data/info.pb
I20260807 10:41:11.901409 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 8562
I20260807 10:41:11.901600 21165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786098956060137-21165-0/minicluster-data/ts-0/wal/instance
I20260807 10:41:11.902060 21165 external_mini_cluster.cc:1428] Setting key 3cbae670519cb21b207dc61bd8de1863
Aug 07 10:41:11 dist-test-slave-0b58 krb5kdc[8451](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099271, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.65@KRBTEST.COM for kudu/127.20.171.126@KRBTEST.COM
I20260807 10:41:11.915993 8697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:11.898272 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.65:40845 (local address 127.20.171.126:37853)
0807 10:41:11.898823 (+ 551us) server_negotiation.cc:206] Beginning negotiation
0807 10:41:11.898832 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 10:41:11.899396 (+ 564us) server_negotiation.cc:407] Connection header received
0807 10:41:11.901350 (+ 1954us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:41:11.901356 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:41:11.901457 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:41:11.901597 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:41:11.903340 (+ 1743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:11.904090 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:11.905706 (+ 1616us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:11.906131 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:11.906289 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:11.910055 (+ 3766us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:41:11.910061 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:41:11.910064 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:41:11.910096 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:41:11.912786 (+ 2690us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:41:11.913613 (+ 827us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:41:11.913621 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:41:11.913629 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:41:11.913769 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:41:11.914238 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:41:11.914242 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:41:11.914244 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:41:11.914510 (+ 266us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:41:11.914673 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0807 10:41:11.915374 (+ 701us) server_negotiation.cc:299] Negotiation successful
0807 10:41:11.915609 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":372,"thread_start_us":269,"threads_started":1}
I20260807 10:41:11.916996 8698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:11.898492 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:37853 (local address 127.20.171.65:40845)
0807 10:41:11.899226 (+ 734us) negotiation.cc:107] Waiting for socket to connect
0807 10:41:11.899269 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0807 10:41:11.901078 (+ 1809us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:41:11.901841 (+ 763us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:41:11.901849 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:41:11.902434 (+ 585us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:41:11.903157 (+ 723us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:41:11.903178 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:41:11.904279 (+ 1101us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:41:11.904287 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:41:11.905558 (+ 1271us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:41:11.905570 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:41:11.906390 (+ 820us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:41:11.906399 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:41:11.906652 (+ 253us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:11.907364 (+ 712us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:41:11.907393 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:41:11.909829 (+ 2436us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:41:11.912968 (+ 3139us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:41:11.912977 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:41:11.912992 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:41:11.913469 (+ 477us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:41:11.913894 (+ 425us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:41:11.913902 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:41:11.913906 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:41:11.914108 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:41:11.914645 (+ 537us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:41:11.914652 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:41:11.914992 (+ 340us) client_negotiation.cc:769] Sending connection context
0807 10:41:11.915263 (+ 271us) client_negotiation.cc:240] Negotiation successful
0807 10:41:11.915797 (+ 534us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":519,"thread_start_us":325,"threads_started":1}
I20260807 10:41:11.918638 8695 heartbeater.cc:347] Connected to a master server at 127.20.171.126:37853
I20260807 10:41:11.918951 8695 heartbeater.cc:464] Registering TS with master...
I20260807 10:41:11.919657 8695 heartbeater.cc:511] Master 127.20.171.126:37853 requested a full tablet report, sending...
I20260807 10:41:11.921761 8497 ts_manager.cc:194] Registered new tserver with Master: fb94c69482e7487ba39233fac1c086cd (127.20.171.65:39649)
I20260807 10:41:11.923208 8497 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.171.65@KRBTEST.COM'} at 127.20.171.65:40845
WARNING: no policy specified for kudu/127.20.171.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.171.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.171.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.66.keytab.
Entry for principal kudu/127.20.171.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.66.keytab.
I20260807 10:41:11.975741 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786098956060137-21165-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786098956060137-21165-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786098956060137-21165-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786098956060137-21165-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.171.66:0
--local_ip_for_outbound_sockets=127.20.171.66
--webserver_interface=127.20.171.66
--webserver_port=0
--tserver_master_addrs=127.20.171.126:37853
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.66.keytab
--principal=kudu/127.20.171.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.171.84:33597
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786098956060137-21165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786098956060137-21165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786098956060137-21165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:41:12.322739 8701 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:41:12.323029 8701 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:41:12.323123 8701 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:41:12.330763 8701 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:41:12.330874 8701 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:41:12.330988 8701 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.171.66
I20260807 10:41:12.341158 8701 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.171.84:33597
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786098956060137-21165-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786098956060137-21165-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.66.keytab
--principal=kudu/127.20.171.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.171.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786098956060137-21165-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.171.66
--webserver_port=0
--tserver_master_addrs=127.20.171.126:37853
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.171.66
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786098956060137-21165-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:41:12.342450 8701 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:41:12.343756 8701 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:41:12.357005 8709 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:41:12.357049 8706 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:41:12.357065 8707 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:41:12.357965 8701 server_base.cc:1034] running on GCE node
I20260807 10:41:12.358597 8701 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:41:12.359568 8701 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:41:12.360756 8701 hybrid_clock.cc:648] HybridClock initialized: now 1786099272360708 us; error 30 us; skew 500 ppm
I20260807 10:41:12.361124 8701 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:41:12 dist-test-slave-0b58 krb5kdc[8451](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099272, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:41:12.364444 8701 init.cc:377] Logged in from keytab as kudu/127.20.171.66@KRBTEST.COM (short username kudu)
I20260807 10:41:12.365857 8701 webserver.cc:460] Webserver started at http://127.20.171.66:44383/ using document root <none> and password file <none>
I20260807 10:41:12.366560 8701 fs_manager.cc:359] Metadata directory not provided
I20260807 10:41:12.366714 8701 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:41:12.367039 8701 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:41:12.370203 8701 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786098956060137-21165-0/minicluster-data/ts-1/data/instance:
uuid: "fc95efd48eb24c77a6405d01698766dd"
format_stamp: "Formatted at 2026-08-07 10:41:12 on dist-test-slave-0b58"
server_key: "588e0e209f023794b75f565797fba917"
server_key_iv: "8d8fd756a9f82431dc0962f38b66afac"
server_key_version: "encryptionkey@0"
I20260807 10:41:12.371001 8701 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786098956060137-21165-0/minicluster-data/ts-1/wal/instance:
uuid: "fc95efd48eb24c77a6405d01698766dd"
format_stamp: "Formatted at 2026-08-07 10:41:12 on dist-test-slave-0b58"
server_key: "588e0e209f023794b75f565797fba917"
server_key_iv: "8d8fd756a9f82431dc0962f38b66afac"
server_key_version: "encryptionkey@0"
I20260807 10:41:12.376362 8701 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260807 10:41:12.379725 8716 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:41:12.380982 8701 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 10:41:12.381153 8701 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786098956060137-21165-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786098956060137-21165-0/minicluster-data/ts-1/wal
uuid: "fc95efd48eb24c77a6405d01698766dd"
format_stamp: "Formatted at 2026-08-07 10:41:12 on dist-test-slave-0b58"
server_key: "588e0e209f023794b75f565797fba917"
server_key_iv: "8d8fd756a9f82431dc0962f38b66afac"
server_key_version: "encryptionkey@0"
I20260807 10:41:12.381361 8701 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786098956060137-21165-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786098956060137-21165-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786098956060137-21165-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:41:12.394459 8701 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:41:12.398227 8701 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:41:12.398525 8701 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:41:12.399447 8701 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:41:12.400903 8701 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:41:12.401007 8701 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:41:12.401151 8701 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:41:12.401228 8701 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:41:12.435009 8701 rpc_server.cc:307] RPC server started. Bound to: 127.20.171.66:35539
I20260807 10:41:12.435056 8834 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.171.66:35539 every 8 connection(s)
I20260807 10:41:12.436391 8701 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786098956060137-21165-0/minicluster-data/ts-1/data/info.pb
I20260807 10:41:12.439744 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 8701
I20260807 10:41:12.439949 21165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786098956060137-21165-0/minicluster-data/ts-1/wal/instance
I20260807 10:41:12.440654 21165 external_mini_cluster.cc:1428] Setting key 72a4240ab5281dbe9d757c7dbdd1833d
Aug 07 10:41:12 dist-test-slave-0b58 krb5kdc[8451](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099272, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.66@KRBTEST.COM for kudu/127.20.171.126@KRBTEST.COM
I20260807 10:41:12.459180 8837 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:12.439069 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.66:42019 (local address 127.20.171.126:37853)
0807 10:41:12.439556 (+ 487us) server_negotiation.cc:206] Beginning negotiation
0807 10:41:12.439563 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:41:12.440684 (+ 1121us) server_negotiation.cc:407] Connection header received
0807 10:41:12.442962 (+ 2278us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:41:12.442966 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:41:12.443028 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:41:12.443117 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:41:12.445173 (+ 2056us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:12.445968 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:12.448445 (+ 2477us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:12.448887 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:12.448985 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:12.453217 (+ 4232us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:41:12.453222 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:41:12.453226 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:41:12.453258 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:41:12.455977 (+ 2719us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:41:12.456799 (+ 822us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:41:12.456804 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:41:12.456806 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:41:12.456936 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:41:12.457406 (+ 470us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:41:12.457410 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:41:12.457418 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:41:12.457694 (+ 276us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:41:12.457857 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0807 10:41:12.458544 (+ 687us) server_negotiation.cc:299] Negotiation successful
0807 10:41:12.458784 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":347,"thread_start_us":221,"threads_started":1}
I20260807 10:41:12.460240 8838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:12.439547 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:37853 (local address 127.20.171.66:42019)
0807 10:41:12.440489 (+ 942us) negotiation.cc:107] Waiting for socket to connect
0807 10:41:12.440550 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0807 10:41:12.442667 (+ 2117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:41:12.443386 (+ 719us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:41:12.443399 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:41:12.444153 (+ 754us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:41:12.444998 (+ 845us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:41:12.445025 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:41:12.446149 (+ 1124us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:41:12.446157 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:41:12.448301 (+ 2144us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:41:12.448318 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:41:12.449120 (+ 802us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:41:12.449130 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:41:12.449457 (+ 327us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:12.450194 (+ 737us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:41:12.450228 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:41:12.452969 (+ 2741us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:41:12.456127 (+ 3158us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:41:12.456136 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:41:12.456151 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:41:12.456667 (+ 516us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:41:12.457072 (+ 405us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:41:12.457078 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:41:12.457081 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:41:12.457282 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:41:12.457827 (+ 545us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:41:12.457835 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:41:12.458181 (+ 346us) client_negotiation.cc:769] Sending connection context
0807 10:41:12.458446 (+ 265us) client_negotiation.cc:240] Negotiation successful
0807 10:41:12.459087 (+ 641us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":605,"thread_start_us":346,"threads_started":1}
I20260807 10:41:12.461849 8835 heartbeater.cc:347] Connected to a master server at 127.20.171.126:37853
I20260807 10:41:12.462217 8835 heartbeater.cc:464] Registering TS with master...
I20260807 10:41:12.463115 8835 heartbeater.cc:511] Master 127.20.171.126:37853 requested a full tablet report, sending...
I20260807 10:41:12.464809 8497 ts_manager.cc:194] Registered new tserver with Master: fc95efd48eb24c77a6405d01698766dd (127.20.171.66:35539)
I20260807 10:41:12.465652 8497 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.171.66@KRBTEST.COM'} at 127.20.171.66:42019
WARNING: no policy specified for kudu/127.20.171.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.171.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.171.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.67.keytab.
Entry for principal kudu/127.20.171.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.67.keytab.
I20260807 10:41:12.517624 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786098956060137-21165-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786098956060137-21165-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786098956060137-21165-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786098956060137-21165-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.171.67:0
--local_ip_for_outbound_sockets=127.20.171.67
--webserver_interface=127.20.171.67
--webserver_port=0
--tserver_master_addrs=127.20.171.126:37853
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.67.keytab
--principal=kudu/127.20.171.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.171.84:33597
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786098956060137-21165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786098956060137-21165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786098956060137-21165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:41:12.861492 8841 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:41:12.861833 8841 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:41:12.861932 8841 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:41:12.869494 8841 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:41:12.869618 8841 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:41:12.869747 8841 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.171.67
I20260807 10:41:12.880626 8841 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.171.84:33597
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786098956060137-21165-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786098956060137-21165-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.67.keytab
--principal=kudu/127.20.171.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.171.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786098956060137-21165-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.171.67
--webserver_port=0
--tserver_master_addrs=127.20.171.126:37853
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.171.67
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786098956060137-21165-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:41:12.881963 8841 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:41:12.883280 8841 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:41:12.896600 8847 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:41:12.897261 8849 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:41:12.897441 8846 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:41:12.897864 8841 server_base.cc:1034] running on GCE node
I20260807 10:41:12.898483 8841 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:41:12.899495 8841 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:41:12.900717 8841 hybrid_clock.cc:648] HybridClock initialized: now 1786099272900667 us; error 41 us; skew 500 ppm
I20260807 10:41:12.901034 8841 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:41:12 dist-test-slave-0b58 krb5kdc[8451](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099272, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:41:12.904152 8841 init.cc:377] Logged in from keytab as kudu/127.20.171.67@KRBTEST.COM (short username kudu)
I20260807 10:41:12.905665 8841 webserver.cc:460] Webserver started at http://127.20.171.67:45781/ using document root <none> and password file <none>
I20260807 10:41:12.906390 8841 fs_manager.cc:359] Metadata directory not provided
I20260807 10:41:12.906539 8841 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:41:12.906906 8841 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:41:12.909873 8841 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786098956060137-21165-0/minicluster-data/ts-2/data/instance:
uuid: "5c19ab8e366243648d5346d8151f52d9"
format_stamp: "Formatted at 2026-08-07 10:41:12 on dist-test-slave-0b58"
server_key: "bc3148dbf48976819cc08d9415bca42c"
server_key_iv: "067a723e6019506b81ca1d1e8fdbd500"
server_key_version: "encryptionkey@0"
I20260807 10:41:12.910671 8841 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786098956060137-21165-0/minicluster-data/ts-2/wal/instance:
uuid: "5c19ab8e366243648d5346d8151f52d9"
format_stamp: "Formatted at 2026-08-07 10:41:12 on dist-test-slave-0b58"
server_key: "bc3148dbf48976819cc08d9415bca42c"
server_key_iv: "067a723e6019506b81ca1d1e8fdbd500"
server_key_version: "encryptionkey@0"
I20260807 10:41:12.915813 8841 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260807 10:41:12.919318 8857 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:41:12.920639 8841 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 10:41:12.920810 8841 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786098956060137-21165-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786098956060137-21165-0/minicluster-data/ts-2/wal
uuid: "5c19ab8e366243648d5346d8151f52d9"
format_stamp: "Formatted at 2026-08-07 10:41:12 on dist-test-slave-0b58"
server_key: "bc3148dbf48976819cc08d9415bca42c"
server_key_iv: "067a723e6019506b81ca1d1e8fdbd500"
server_key_version: "encryptionkey@0"
I20260807 10:41:12.921022 8841 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786098956060137-21165-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786098956060137-21165-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786098956060137-21165-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:41:12.926088 8695 heartbeater.cc:503] Master 127.20.171.126:37853 was elected leader, sending a full tablet report...
I20260807 10:41:12.937783 8841 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:41:12.941608 8841 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:41:12.941913 8841 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:41:12.942888 8841 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:41:12.944213 8841 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:41:12.944356 8841 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:41:12.944453 8841 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:41:12.944555 8841 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:41:12.979363 8841 rpc_server.cc:307] RPC server started. Bound to: 127.20.171.67:42795
I20260807 10:41:12.979414 8973 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.171.67:42795 every 8 connection(s)
I20260807 10:41:12.980768 8841 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786098956060137-21165-0/minicluster-data/ts-2/data/info.pb
I20260807 10:41:12.982095 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 8841
I20260807 10:41:12.982293 21165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786098956060137-21165-0/minicluster-data/ts-2/wal/instance
I20260807 10:41:12.982823 21165 external_mini_cluster.cc:1428] Setting key 961b62f1dea35cabb6eaa7be3f968e06
Aug 07 10:41:12 dist-test-slave-0b58 krb5kdc[8451](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099272, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.67@KRBTEST.COM for kudu/127.20.171.126@KRBTEST.COM
I20260807 10:41:13.001364 8977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:12.983387 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.67:41055 (local address 127.20.171.126:37853)
0807 10:41:12.983859 (+ 472us) server_negotiation.cc:206] Beginning negotiation
0807 10:41:12.983863 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 10:41:12.985073 (+ 1210us) server_negotiation.cc:407] Connection header received
0807 10:41:12.987300 (+ 2227us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:41:12.987304 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:41:12.987388 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:41:12.987476 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:41:12.989009 (+ 1533us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:12.989765 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:12.991274 (+ 1509us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:12.991674 (+ 400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:12.991766 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:12.995152 (+ 3386us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:41:12.995157 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:41:12.995160 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:41:12.995192 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:41:12.998388 (+ 3196us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:41:12.999113 (+ 725us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:41:12.999116 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:41:12.999119 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:41:12.999233 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:41:12.999670 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:41:12.999673 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:41:12.999675 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:41:12.999926 (+ 251us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:41:13.000040 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0807 10:41:13.000748 (+ 708us) server_negotiation.cc:299] Negotiation successful
0807 10:41:13.000911 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":361,"thread_start_us":232,"threads_started":1}
I20260807 10:41:13.002089 8978 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:12.983967 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:37853 (local address 127.20.171.67:41055)
0807 10:41:12.984901 (+ 934us) negotiation.cc:107] Waiting for socket to connect
0807 10:41:12.984958 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0807 10:41:12.987031 (+ 2073us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:41:12.987698 (+ 667us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:41:12.987706 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:41:12.988222 (+ 516us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:41:12.988860 (+ 638us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:41:12.988877 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:41:12.989898 (+ 1021us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:41:12.989901 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:41:12.991116 (+ 1215us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:41:12.991127 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:41:12.991900 (+ 773us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:41:12.991905 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:41:12.992110 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:12.992812 (+ 702us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:41:12.992836 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:41:12.994959 (+ 2123us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:41:12.998529 (+ 3570us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:41:12.998539 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:41:12.998553 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:41:12.999003 (+ 450us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:41:12.999361 (+ 358us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:41:12.999365 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:41:12.999367 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:41:12.999557 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:41:13.000034 (+ 477us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:41:13.000039 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:41:13.000424 (+ 385us) client_negotiation.cc:769] Sending connection context
0807 10:41:13.000658 (+ 234us) client_negotiation.cc:240] Negotiation successful
0807 10:41:13.001028 (+ 370us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":632,"thread_start_us":381,"threads_started":1}
I20260807 10:41:13.003386 8974 heartbeater.cc:347] Connected to a master server at 127.20.171.126:37853
I20260807 10:41:13.003695 8974 heartbeater.cc:464] Registering TS with master...
I20260807 10:41:13.004487 8974 heartbeater.cc:511] Master 127.20.171.126:37853 requested a full tablet report, sending...
I20260807 10:41:13.005883 8497 ts_manager.cc:194] Registered new tserver with Master: 5c19ab8e366243648d5346d8151f52d9 (127.20.171.67:42795)
I20260807 10:41:13.006705 8497 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.171.67@KRBTEST.COM'} at 127.20.171.67:41055
I20260807 10:41:13.010782 21165 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 10:41:13.027191 8977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:13.014958 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37550 (local address 127.20.171.126:37853)
0807 10:41:13.015165 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0807 10:41:13.015174 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 10:41:13.015714 (+ 540us) server_negotiation.cc:407] Connection header received
0807 10:41:13.015847 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:41:13.015851 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:41:13.015937 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:41:13.016015 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:41:13.017420 (+ 1405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:13.018120 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:13.019328 (+ 1208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:13.019759 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:13.019856 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:13.022110 (+ 2254us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:41:13.022114 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:41:13.022117 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:41:13.022145 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:41:13.024761 (+ 2616us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:41:13.025430 (+ 669us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:41:13.025434 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:41:13.025436 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:41:13.025592 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:41:13.025902 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:41:13.025905 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:41:13.025907 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:41:13.026218 (+ 311us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:41:13.026398 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0807 10:41:13.026690 (+ 292us) server_negotiation.cc:299] Negotiation successful
0807 10:41:13.026862 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260807 10:41:13.030859 8497 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37550:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 10:41:13.037832 8497 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 10:41:13.075330 8990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:13.049953 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.66:35539 (local address 127.0.0.1:44686)
0807 10:41:13.063220 (+ 13267us) negotiation.cc:107] Waiting for socket to connect
0807 10:41:13.063290 (+ 70us) client_negotiation.cc:174] Beginning negotiation
0807 10:41:13.063547 (+ 257us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:41:13.066301 (+ 2754us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:41:13.066310 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:41:13.066348 (+ 38us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:41:13.066965 (+ 617us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:41:13.066983 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:41:13.069800 (+ 2817us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:41:13.069807 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:41:13.072048 (+ 2241us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:41:13.072062 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:41:13.074143 (+ 2081us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:41:13.074152 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:41:13.074368 (+ 216us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:13.074447 (+ 79us) client_negotiation.cc:769] Sending connection context
0807 10:41:13.074614 (+ 167us) client_negotiation.cc:240] Negotiation successful
0807 10:41:13.074808 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12875,"mutex_wait_us":5,"thread_start_us":14322,"threads_started":1}
I20260807 10:41:13.075814 8991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:13.050132 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44686 (local address 127.20.171.66:35539)
0807 10:41:13.065553 (+ 15421us) server_negotiation.cc:206] Beginning negotiation
0807 10:41:13.065565 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 10:41:13.065602 (+ 37us) server_negotiation.cc:407] Connection header received
0807 10:41:13.065726 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:41:13.065736 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:41:13.066008 (+ 272us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:41:13.067244 (+ 1236us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:41:13.067569 (+ 325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:13.069614 (+ 2045us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:13.072268 (+ 2654us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:13.073912 (+ 1644us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:13.075034 (+ 1122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:13.075233 (+ 199us) server_negotiation.cc:1035] Waiting for connection context
0807 10:41:13.075310 (+ 77us) server_negotiation.cc:299] Negotiation successful
0807 10:41:13.075475 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15190,"thread_start_us":15755,"threads_started":1}
I20260807 10:41:13.075834 8989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:13.050063 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.65:39649 (local address 127.0.0.1:46666)
0807 10:41:13.064031 (+ 13968us) negotiation.cc:107] Waiting for socket to connect
0807 10:41:13.064050 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 10:41:13.064171 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:41:13.065412 (+ 1241us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:41:13.065419 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:41:13.065456 (+ 37us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:41:13.065735 (+ 279us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:41:13.065745 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:41:13.068710 (+ 2965us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:41:13.068719 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:41:13.072148 (+ 3429us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:41:13.072165 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:41:13.074875 (+ 2710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:41:13.074884 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:41:13.075097 (+ 213us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:13.075127 (+ 30us) client_negotiation.cc:769] Sending connection context
0807 10:41:13.075223 (+ 96us) client_negotiation.cc:240] Negotiation successful
0807 10:41:13.075366 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13843,"mutex_wait_us":49,"thread_start_us":12567,"threads_started":1}
I20260807 10:41:13.076579 8992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:13.050486 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46666 (local address 127.20.171.65:39649)
0807 10:41:13.064240 (+ 13754us) server_negotiation.cc:206] Beginning negotiation
0807 10:41:13.064466 (+ 226us) server_negotiation.cc:399] Waiting for connection header
0807 10:41:13.064499 (+ 33us) server_negotiation.cc:407] Connection header received
0807 10:41:13.064599 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:41:13.064609 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:41:13.064886 (+ 277us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:41:13.065081 (+ 195us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:41:13.065899 (+ 818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:13.068506 (+ 2607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:13.072432 (+ 3926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:13.074533 (+ 2101us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:13.074669 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:13.074918 (+ 249us) server_negotiation.cc:1035] Waiting for connection context
0807 10:41:13.076121 (+ 1203us) server_negotiation.cc:299] Negotiation successful
0807 10:41:13.076321 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13558,"thread_start_us":13767,"threads_started":1}
I20260807 10:41:13.078629 8994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:13.066256 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.67:42795 (local address 127.0.0.1:45150)
0807 10:41:13.070208 (+ 3952us) negotiation.cc:107] Waiting for socket to connect
0807 10:41:13.070227 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 10:41:13.070380 (+ 153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:41:13.071013 (+ 633us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:41:13.071018 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:41:13.071044 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:41:13.071471 (+ 427us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:41:13.071482 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:41:13.073445 (+ 1963us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:41:13.073449 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:41:13.075761 (+ 2312us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:41:13.075781 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:41:13.077861 (+ 2080us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:41:13.077867 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:41:13.078047 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:13.078079 (+ 32us) client_negotiation.cc:769] Sending connection context
0807 10:41:13.078166 (+ 87us) client_negotiation.cc:240] Negotiation successful
0807 10:41:13.078295 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3803,"thread_start_us":3605,"threads_started":1}
I20260807 10:41:13.078987 8993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:13.064316 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45150 (local address 127.20.171.67:42795)
0807 10:41:13.069831 (+ 5515us) server_negotiation.cc:206] Beginning negotiation
0807 10:41:13.069839 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 10:41:13.070344 (+ 505us) server_negotiation.cc:407] Connection header received
0807 10:41:13.070545 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:41:13.070553 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:41:13.070807 (+ 254us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:41:13.071002 (+ 195us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:41:13.071671 (+ 669us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:13.073264 (+ 1593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:13.075977 (+ 2713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:13.077412 (+ 1435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:13.077543 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:13.077704 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0807 10:41:13.078436 (+ 732us) server_negotiation.cc:299] Negotiation successful
0807 10:41:13.078611 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5318,"thread_start_us":5129,"threads_started":1}
I20260807 10:41:13.080325 8764 tablet_service.cc:1467] Processing CreateTablet for tablet 3080f0e1d724491399c6978d8f6d740b (DEFAULT_TABLE table=test-table [id=b58cf327bac84fe5a43ab7a7817d0f64]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:41:13.080317 8627 tablet_service.cc:1467] Processing CreateTablet for tablet 3080f0e1d724491399c6978d8f6d740b (DEFAULT_TABLE table=test-table [id=b58cf327bac84fe5a43ab7a7817d0f64]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:41:13.081897 8627 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3080f0e1d724491399c6978d8f6d740b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:41:13.081902 8764 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3080f0e1d724491399c6978d8f6d740b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:41:13.082350 8907 tablet_service.cc:1467] Processing CreateTablet for tablet 3080f0e1d724491399c6978d8f6d740b (DEFAULT_TABLE table=test-table [id=b58cf327bac84fe5a43ab7a7817d0f64]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:41:13.083722 8907 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3080f0e1d724491399c6978d8f6d740b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:41:13.095815 8995 tablet_bootstrap.cc:492] T 3080f0e1d724491399c6978d8f6d740b P 5c19ab8e366243648d5346d8151f52d9: Bootstrap starting.
I20260807 10:41:13.098003 8998 tablet_bootstrap.cc:492] T 3080f0e1d724491399c6978d8f6d740b P fb94c69482e7487ba39233fac1c086cd: Bootstrap starting.
I20260807 10:41:13.099066 8996 tablet_bootstrap.cc:492] T 3080f0e1d724491399c6978d8f6d740b P fc95efd48eb24c77a6405d01698766dd: Bootstrap starting.
I20260807 10:41:13.100185 8995 tablet_bootstrap.cc:654] T 3080f0e1d724491399c6978d8f6d740b P 5c19ab8e366243648d5346d8151f52d9: Neither blocks nor log segments found. Creating new log.
I20260807 10:41:13.101586 8995 log.cc:824] T 3080f0e1d724491399c6978d8f6d740b P 5c19ab8e366243648d5346d8151f52d9: Log is configured to *not* fsync() on all Append() calls
I20260807 10:41:13.102787 8998 tablet_bootstrap.cc:654] T 3080f0e1d724491399c6978d8f6d740b P fb94c69482e7487ba39233fac1c086cd: Neither blocks nor log segments found. Creating new log.
I20260807 10:41:13.103307 8996 tablet_bootstrap.cc:654] T 3080f0e1d724491399c6978d8f6d740b P fc95efd48eb24c77a6405d01698766dd: Neither blocks nor log segments found. Creating new log.
I20260807 10:41:13.104087 8998 log.cc:824] T 3080f0e1d724491399c6978d8f6d740b P fb94c69482e7487ba39233fac1c086cd: Log is configured to *not* fsync() on all Append() calls
I20260807 10:41:13.104462 8996 log.cc:824] T 3080f0e1d724491399c6978d8f6d740b P fc95efd48eb24c77a6405d01698766dd: Log is configured to *not* fsync() on all Append() calls
I20260807 10:41:13.105021 8995 tablet_bootstrap.cc:492] T 3080f0e1d724491399c6978d8f6d740b P 5c19ab8e366243648d5346d8151f52d9: No bootstrap required, opened a new log
I20260807 10:41:13.105415 8995 ts_tablet_manager.cc:1397] T 3080f0e1d724491399c6978d8f6d740b P 5c19ab8e366243648d5346d8151f52d9: Time spent bootstrapping tablet: real 0.010s user 0.005s sys 0.003s
I20260807 10:41:13.107424 8998 tablet_bootstrap.cc:492] T 3080f0e1d724491399c6978d8f6d740b P fb94c69482e7487ba39233fac1c086cd: No bootstrap required, opened a new log
I20260807 10:41:13.107638 8996 tablet_bootstrap.cc:492] T 3080f0e1d724491399c6978d8f6d740b P fc95efd48eb24c77a6405d01698766dd: No bootstrap required, opened a new log
I20260807 10:41:13.107686 8998 ts_tablet_manager.cc:1397] T 3080f0e1d724491399c6978d8f6d740b P fb94c69482e7487ba39233fac1c086cd: Time spent bootstrapping tablet: real 0.010s user 0.006s sys 0.000s
I20260807 10:41:13.108382 8996 ts_tablet_manager.cc:1397] T 3080f0e1d724491399c6978d8f6d740b P fc95efd48eb24c77a6405d01698766dd: Time spent bootstrapping tablet: real 0.010s user 0.007s sys 0.000s
I20260807 10:41:13.113610 8995 raft_consensus.cc:348] T 3080f0e1d724491399c6978d8f6d740b P 5c19ab8e366243648d5346d8151f52d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc95efd48eb24c77a6405d01698766dd" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 35539 } } peers { permanent_uuid: "fb94c69482e7487ba39233fac1c086cd" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 39649 } } peers { permanent_uuid: "5c19ab8e366243648d5346d8151f52d9" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 42795 } }
I20260807 10:41:13.114005 8995 raft_consensus.cc:374] T 3080f0e1d724491399c6978d8f6d740b P 5c19ab8e366243648d5346d8151f52d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:41:13.114113 8995 raft_consensus.cc:729] T 3080f0e1d724491399c6978d8f6d740b P 5c19ab8e366243648d5346d8151f52d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c19ab8e366243648d5346d8151f52d9, State: Initialized, Role: FOLLOWER
I20260807 10:41:13.114773 8995 consensus_queue.cc:260] T 3080f0e1d724491399c6978d8f6d740b P 5c19ab8e366243648d5346d8151f52d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc95efd48eb24c77a6405d01698766dd" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 35539 } } peers { permanent_uuid: "fb94c69482e7487ba39233fac1c086cd" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 39649 } } peers { permanent_uuid: "5c19ab8e366243648d5346d8151f52d9" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 42795 } }
I20260807 10:41:13.115964 8974 heartbeater.cc:503] Master 127.20.171.126:37853 was elected leader, sending a full tablet report...
I20260807 10:41:13.116614 8995 ts_tablet_manager.cc:1428] T 3080f0e1d724491399c6978d8f6d740b P 5c19ab8e366243648d5346d8151f52d9: Time spent starting tablet: real 0.011s user 0.011s sys 0.000s
I20260807 10:41:13.118840 8998 raft_consensus.cc:348] T 3080f0e1d724491399c6978d8f6d740b P fb94c69482e7487ba39233fac1c086cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc95efd48eb24c77a6405d01698766dd" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 35539 } } peers { permanent_uuid: "fb94c69482e7487ba39233fac1c086cd" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 39649 } } peers { permanent_uuid: "5c19ab8e366243648d5346d8151f52d9" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 42795 } }
I20260807 10:41:13.119359 8998 raft_consensus.cc:374] T 3080f0e1d724491399c6978d8f6d740b P fb94c69482e7487ba39233fac1c086cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:41:13.119472 8998 raft_consensus.cc:729] T 3080f0e1d724491399c6978d8f6d740b P fb94c69482e7487ba39233fac1c086cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fb94c69482e7487ba39233fac1c086cd, State: Initialized, Role: FOLLOWER
I20260807 10:41:13.119213 8996 raft_consensus.cc:348] T 3080f0e1d724491399c6978d8f6d740b P fc95efd48eb24c77a6405d01698766dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc95efd48eb24c77a6405d01698766dd" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 35539 } } peers { permanent_uuid: "fb94c69482e7487ba39233fac1c086cd" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 39649 } } peers { permanent_uuid: "5c19ab8e366243648d5346d8151f52d9" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 42795 } }
I20260807 10:41:13.119678 8996 raft_consensus.cc:374] T 3080f0e1d724491399c6978d8f6d740b P fc95efd48eb24c77a6405d01698766dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:41:13.119779 8996 raft_consensus.cc:729] T 3080f0e1d724491399c6978d8f6d740b P fc95efd48eb24c77a6405d01698766dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc95efd48eb24c77a6405d01698766dd, State: Initialized, Role: FOLLOWER
I20260807 10:41:13.120155 8998 consensus_queue.cc:260] T 3080f0e1d724491399c6978d8f6d740b P fb94c69482e7487ba39233fac1c086cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc95efd48eb24c77a6405d01698766dd" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 35539 } } peers { permanent_uuid: "fb94c69482e7487ba39233fac1c086cd" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 39649 } } peers { permanent_uuid: "5c19ab8e366243648d5346d8151f52d9" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 42795 } }
I20260807 10:41:13.120365 8996 consensus_queue.cc:260] T 3080f0e1d724491399c6978d8f6d740b P fc95efd48eb24c77a6405d01698766dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc95efd48eb24c77a6405d01698766dd" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 35539 } } peers { permanent_uuid: "fb94c69482e7487ba39233fac1c086cd" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 39649 } } peers { permanent_uuid: "5c19ab8e366243648d5346d8151f52d9" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 42795 } }
I20260807 10:41:13.122277 8998 ts_tablet_manager.cc:1428] T 3080f0e1d724491399c6978d8f6d740b P fb94c69482e7487ba39233fac1c086cd: Time spent starting tablet: real 0.014s user 0.008s sys 0.007s
I20260807 10:41:13.123390 8835 heartbeater.cc:503] Master 127.20.171.126:37853 was elected leader, sending a full tablet report...
I20260807 10:41:13.123962 8996 ts_tablet_manager.cc:1428] T 3080f0e1d724491399c6978d8f6d740b P fc95efd48eb24c77a6405d01698766dd: Time spent starting tablet: real 0.015s user 0.014s sys 0.000s
W20260807 10:41:13.147811 8696 tablet.cc:2369] T 3080f0e1d724491399c6978d8f6d740b P fb94c69482e7487ba39233fac1c086cd: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 10:41:13.188501 8836 tablet.cc:2369] T 3080f0e1d724491399c6978d8f6d740b P fc95efd48eb24c77a6405d01698766dd: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 10:41:13.204041 9004 raft_consensus.cc:482] T 3080f0e1d724491399c6978d8f6d740b P fc95efd48eb24c77a6405d01698766dd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 10:41:13.204387 9004 raft_consensus.cc:504] T 3080f0e1d724491399c6978d8f6d740b P fc95efd48eb24c77a6405d01698766dd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc95efd48eb24c77a6405d01698766dd" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 35539 } } peers { permanent_uuid: "fb94c69482e7487ba39233fac1c086cd" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 39649 } } peers { permanent_uuid: "5c19ab8e366243648d5346d8151f52d9" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 42795 } }
I20260807 10:41:13.206048 9004 leader_election.cc:288] T 3080f0e1d724491399c6978d8f6d740b P fc95efd48eb24c77a6405d01698766dd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fb94c69482e7487ba39233fac1c086cd (127.20.171.65:39649), 5c19ab8e366243648d5346d8151f52d9 (127.20.171.67:42795)
I20260807 10:41:13.213055 8992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:13.206583 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.66:39357 (local address 127.20.171.65:39649)
0807 10:41:13.206861 (+ 278us) server_negotiation.cc:206] Beginning negotiation
0807 10:41:13.206868 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:41:13.207200 (+ 332us) server_negotiation.cc:407] Connection header received
0807 10:41:13.207534 (+ 334us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:41:13.207543 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:41:13.207637 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:41:13.207740 (+ 103us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:41:13.208350 (+ 610us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:13.209094 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:13.210945 (+ 1851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:13.211931 (+ 986us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:13.212123 (+ 192us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:13.212206 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0807 10:41:13.212666 (+ 460us) server_negotiation.cc:299] Negotiation successful
0807 10:41:13.212796 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260807 10:41:13.213202 8993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:13.207565 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.66:42999 (local address 127.20.171.67:42795)
0807 10:41:13.207781 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0807 10:41:13.207787 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:41:13.207982 (+ 195us) server_negotiation.cc:407] Connection header received
0807 10:41:13.208187 (+ 205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:41:13.208193 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:41:13.208319 (+ 126us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:41:13.208423 (+ 104us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:41:13.208955 (+ 532us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:13.209701 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:13.211383 (+ 1682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:13.212221 (+ 838us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:13.212415 (+ 194us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:13.212491 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0807 10:41:13.212797 (+ 306us) server_negotiation.cc:299] Negotiation successful
0807 10:41:13.212931 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260807 10:41:13.213305 9005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:13.206456 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.65:39649 (local address 127.20.171.66:39357)
0807 10:41:13.207077 (+ 621us) negotiation.cc:107] Waiting for socket to connect
0807 10:41:13.207094 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 10:41:13.207301 (+ 207us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:41:13.207801 (+ 500us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:41:13.207805 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:41:13.207833 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:41:13.208186 (+ 353us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:41:13.208196 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:41:13.209227 (+ 1031us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:41:13.209236 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:41:13.210783 (+ 1547us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:41:13.210796 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:41:13.212159 (+ 1363us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:41:13.212166 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:41:13.212435 (+ 269us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:13.212521 (+ 86us) client_negotiation.cc:769] Sending connection context
0807 10:41:13.212637 (+ 116us) client_negotiation.cc:240] Negotiation successful
0807 10:41:13.212770 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":512,"mutex_wait_us":65,"thread_start_us":347,"threads_started":1}
I20260807 10:41:13.213644 9006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:13.207264 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.67:42795 (local address 127.20.171.66:42999)
0807 10:41:13.207885 (+ 621us) negotiation.cc:107] Waiting for socket to connect
0807 10:41:13.207898 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 10:41:13.208053 (+ 155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:41:13.208437 (+ 384us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:41:13.208441 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:41:13.208463 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:41:13.208803 (+ 340us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:41:13.208813 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:41:13.209843 (+ 1030us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:41:13.209851 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:41:13.211223 (+ 1372us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:41:13.211235 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:41:13.212439 (+ 1204us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:41:13.212445 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:41:13.212644 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:13.212666 (+ 22us) client_negotiation.cc:769] Sending connection context
0807 10:41:13.212770 (+ 104us) client_negotiation.cc:240] Negotiation successful
0807 10:41:13.212894 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":494,"mutex_wait_us":3,"thread_start_us":305,"threads_started":1}
I20260807 10:41:13.214447 8647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3080f0e1d724491399c6978d8f6d740b" candidate_uuid: "fc95efd48eb24c77a6405d01698766dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb94c69482e7487ba39233fac1c086cd" is_pre_election: true
I20260807 10:41:13.214656 8928 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3080f0e1d724491399c6978d8f6d740b" candidate_uuid: "fc95efd48eb24c77a6405d01698766dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c19ab8e366243648d5346d8151f52d9" is_pre_election: true
I20260807 10:41:13.215091 8647 raft_consensus.cc:2454] T 3080f0e1d724491399c6978d8f6d740b P fb94c69482e7487ba39233fac1c086cd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc95efd48eb24c77a6405d01698766dd in term 0.
I20260807 10:41:13.215170 8928 raft_consensus.cc:2454] T 3080f0e1d724491399c6978d8f6d740b P 5c19ab8e366243648d5346d8151f52d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc95efd48eb24c77a6405d01698766dd in term 0.
I20260807 10:41:13.215817 8718 leader_election.cc:302] T 3080f0e1d724491399c6978d8f6d740b P fc95efd48eb24c77a6405d01698766dd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: fb94c69482e7487ba39233fac1c086cd, fc95efd48eb24c77a6405d01698766dd; no voters:
I20260807 10:41:13.216162 9004 raft_consensus.cc:2781] T 3080f0e1d724491399c6978d8f6d740b P fc95efd48eb24c77a6405d01698766dd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 10:41:13.216361 9004 raft_consensus.cc:482] T 3080f0e1d724491399c6978d8f6d740b P fc95efd48eb24c77a6405d01698766dd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 10:41:13.216491 9004 raft_consensus.cc:3037] T 3080f0e1d724491399c6978d8f6d740b P fc95efd48eb24c77a6405d01698766dd [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:41:13.218616 9004 raft_consensus.cc:504] T 3080f0e1d724491399c6978d8f6d740b P fc95efd48eb24c77a6405d01698766dd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc95efd48eb24c77a6405d01698766dd" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 35539 } } peers { permanent_uuid: "fb94c69482e7487ba39233fac1c086cd" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 39649 } } peers { permanent_uuid: "5c19ab8e366243648d5346d8151f52d9" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 42795 } }
I20260807 10:41:13.219220 9004 leader_election.cc:288] T 3080f0e1d724491399c6978d8f6d740b P fc95efd48eb24c77a6405d01698766dd [CANDIDATE]: Term 1 election: Requested vote from peers fb94c69482e7487ba39233fac1c086cd (127.20.171.65:39649), 5c19ab8e366243648d5346d8151f52d9 (127.20.171.67:42795)
I20260807 10:41:13.219614 8647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3080f0e1d724491399c6978d8f6d740b" candidate_uuid: "fc95efd48eb24c77a6405d01698766dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb94c69482e7487ba39233fac1c086cd"
I20260807 10:41:13.219707 8928 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3080f0e1d724491399c6978d8f6d740b" candidate_uuid: "fc95efd48eb24c77a6405d01698766dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c19ab8e366243648d5346d8151f52d9"
I20260807 10:41:13.219852 8647 raft_consensus.cc:3037] T 3080f0e1d724491399c6978d8f6d740b P fb94c69482e7487ba39233fac1c086cd [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:41:13.219913 8928 raft_consensus.cc:3037] T 3080f0e1d724491399c6978d8f6d740b P 5c19ab8e366243648d5346d8151f52d9 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:41:13.223181 8928 raft_consensus.cc:2454] T 3080f0e1d724491399c6978d8f6d740b P 5c19ab8e366243648d5346d8151f52d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc95efd48eb24c77a6405d01698766dd in term 1.
I20260807 10:41:13.223172 8647 raft_consensus.cc:2454] T 3080f0e1d724491399c6978d8f6d740b P fb94c69482e7487ba39233fac1c086cd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc95efd48eb24c77a6405d01698766dd in term 1.
I20260807 10:41:13.223560 8718 leader_election.cc:302] T 3080f0e1d724491399c6978d8f6d740b P fc95efd48eb24c77a6405d01698766dd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c19ab8e366243648d5346d8151f52d9, fc95efd48eb24c77a6405d01698766dd; no voters:
I20260807 10:41:13.223817 9004 raft_consensus.cc:2781] T 3080f0e1d724491399c6978d8f6d740b P fc95efd48eb24c77a6405d01698766dd [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:41:13.224383 9004 raft_consensus.cc:686] T 3080f0e1d724491399c6978d8f6d740b P fc95efd48eb24c77a6405d01698766dd [term 1 LEADER]: Becoming Leader. State: Replica: fc95efd48eb24c77a6405d01698766dd, State: Running, Role: LEADER
I20260807 10:41:13.224999 9004 consensus_queue.cc:237] T 3080f0e1d724491399c6978d8f6d740b P fc95efd48eb24c77a6405d01698766dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc95efd48eb24c77a6405d01698766dd" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 35539 } } peers { permanent_uuid: "fb94c69482e7487ba39233fac1c086cd" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 39649 } } peers { permanent_uuid: "5c19ab8e366243648d5346d8151f52d9" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 42795 } }
I20260807 10:41:13.229914 8497 catalog_manager.cc:5495] T 3080f0e1d724491399c6978d8f6d740b P fc95efd48eb24c77a6405d01698766dd reported cstate change: term changed from 0 to 1, leader changed from <none> to fc95efd48eb24c77a6405d01698766dd (127.20.171.66). New cstate: current_term: 1 leader_uuid: "fc95efd48eb24c77a6405d01698766dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc95efd48eb24c77a6405d01698766dd" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 35539 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fb94c69482e7487ba39233fac1c086cd" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 39649 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c19ab8e366243648d5346d8151f52d9" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 42795 } health_report { overall_health: UNKNOWN } } }
W20260807 10:41:13.232478 8976 tablet.cc:2369] T 3080f0e1d724491399c6978d8f6d740b P 5c19ab8e366243648d5346d8151f52d9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 10:41:13.271636 8991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:13.266531 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44694 (local address 127.20.171.66:35539)
0807 10:41:13.266713 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0807 10:41:13.266718 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:41:13.266859 (+ 141us) server_negotiation.cc:407] Connection header received
0807 10:41:13.267046 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:41:13.267050 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:41:13.267126 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:41:13.267251 (+ 125us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 10:41:13.267567 (+ 316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:13.268373 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:13.269724 (+ 1351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:13.270122 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:13.270217 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:13.270652 (+ 435us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 10:41:13.271177 (+ 525us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 10:41:13.271291 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0807 10:41:13.271359 (+ 68us) server_negotiation.cc:299] Negotiation successful
0807 10:41:13.271421 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260807 10:41:13.279749 8647 raft_consensus.cc:1261] T 3080f0e1d724491399c6978d8f6d740b P fb94c69482e7487ba39233fac1c086cd [term 1 FOLLOWER]: Refusing update from remote peer fc95efd48eb24c77a6405d01698766dd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 10:41:13.279834 8928 raft_consensus.cc:1261] T 3080f0e1d724491399c6978d8f6d740b P 5c19ab8e366243648d5346d8151f52d9 [term 1 FOLLOWER]: Refusing update from remote peer fc95efd48eb24c77a6405d01698766dd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 10:41:13.280699 9007 consensus_queue.cc:1035] T 3080f0e1d724491399c6978d8f6d740b P fc95efd48eb24c77a6405d01698766dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fb94c69482e7487ba39233fac1c086cd" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 39649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 10:41:13.281131 9004 consensus_queue.cc:1035] T 3080f0e1d724491399c6978d8f6d740b P fc95efd48eb24c77a6405d01698766dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c19ab8e366243648d5346d8151f52d9" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 42795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 10:41:13.292791 9010 mvcc.cc:205] Tried to move back new op lower bound from 7315862623344005120 to 7315862623133925376. Current Snapshot: MvccSnapshot[applied={T|T < 7315862623344005120}]
I20260807 10:41:13.309214 8497 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37550:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 10:41:13.309476 8497 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37550:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 10:41:13.313084 8497 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 726f931f082142dd8a906969f49c5e6b: Sending DeleteTablet for 3 replicas of tablet 3080f0e1d724491399c6978d8f6d740b
I20260807 10:41:13.314289 8764 tablet_service.cc:1514] Processing DeleteTablet for tablet 3080f0e1d724491399c6978d8f6d740b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:41:13 UTC) from {username='kudu', principal='kudu/127.20.171.126@KRBTEST.COM'} at 127.0.0.1:44686
I20260807 10:41:13.314672 8627 tablet_service.cc:1514] Processing DeleteTablet for tablet 3080f0e1d724491399c6978d8f6d740b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:41:13 UTC) from {username='kudu', principal='kudu/127.20.171.126@KRBTEST.COM'} at 127.0.0.1:46666
I20260807 10:41:13.315331 8907 tablet_service.cc:1514] Processing DeleteTablet for tablet 3080f0e1d724491399c6978d8f6d740b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:41:13 UTC) from {username='kudu', principal='kudu/127.20.171.126@KRBTEST.COM'} at 127.0.0.1:45150
I20260807 10:41:13.315779 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 8562
I20260807 10:41:13.323283 9021 tablet_replica.cc:330] T 3080f0e1d724491399c6978d8f6d740b P fb94c69482e7487ba39233fac1c086cd: stopping tablet replica
I20260807 10:41:13.323902 9022 tablet_replica.cc:330] T 3080f0e1d724491399c6978d8f6d740b P 5c19ab8e366243648d5346d8151f52d9: stopping tablet replica
I20260807 10:41:13.324867 9021 raft_consensus.cc:2229] T 3080f0e1d724491399c6978d8f6d740b P fb94c69482e7487ba39233fac1c086cd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 10:41:13.325198 9022 raft_consensus.cc:2229] T 3080f0e1d724491399c6978d8f6d740b P 5c19ab8e366243648d5346d8151f52d9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 10:41:13.326061 9021 raft_consensus.cc:2258] T 3080f0e1d724491399c6978d8f6d740b P fb94c69482e7487ba39233fac1c086cd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:41:13.326454 9022 raft_consensus.cc:2258] T 3080f0e1d724491399c6978d8f6d740b P 5c19ab8e366243648d5346d8151f52d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:41:13.329303 9021 ts_tablet_manager.cc:1905] T 3080f0e1d724491399c6978d8f6d740b P fb94c69482e7487ba39233fac1c086cd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 10:41:13.330740 9020 tablet_replica.cc:330] T 3080f0e1d724491399c6978d8f6d740b P fc95efd48eb24c77a6405d01698766dd: stopping tablet replica
I20260807 10:41:13.331209 9022 ts_tablet_manager.cc:1905] T 3080f0e1d724491399c6978d8f6d740b P 5c19ab8e366243648d5346d8151f52d9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 10:41:13.331194 9020 raft_consensus.cc:2229] T 3080f0e1d724491399c6978d8f6d740b P fc95efd48eb24c77a6405d01698766dd [term 1 LEADER]: Raft consensus shutting down.
I20260807 10:41:13.331954 9020 raft_consensus.cc:2258] T 3080f0e1d724491399c6978d8f6d740b P fc95efd48eb24c77a6405d01698766dd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:41:13.333995 9020 ts_tablet_manager.cc:1905] T 3080f0e1d724491399c6978d8f6d740b P fc95efd48eb24c77a6405d01698766dd: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 07 10:41:13 dist-test-slave-0b58 krb5kdc[8451](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099270, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.171.65@KRBTEST.COM
I20260807 10:41:13.341588 9020 ts_tablet_manager.cc:1918] T 3080f0e1d724491399c6978d8f6d740b P fc95efd48eb24c77a6405d01698766dd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 10:41:13.341775 9020 log.cc:1196] T 3080f0e1d724491399c6978d8f6d740b P fc95efd48eb24c77a6405d01698766dd: Deleting WAL directory at /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786098956060137-21165-0/minicluster-data/ts-1/wal/wals/3080f0e1d724491399c6978d8f6d740b
I20260807 10:41:13.342371 9020 ts_tablet_manager.cc:1939] T 3080f0e1d724491399c6978d8f6d740b P fc95efd48eb24c77a6405d01698766dd: Deleting consensus metadata
I20260807 10:41:13.344373 8484 catalog_manager.cc:4841] TS fc95efd48eb24c77a6405d01698766dd (127.20.171.66:35539): tablet 3080f0e1d724491399c6978d8f6d740b (table test-table [id=b58cf327bac84fe5a43ab7a7817d0f64]) successfully deleted
I20260807 10:41:13.344638 8992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:13.316882 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46680 (local address 127.20.171.65:39649)
0807 10:41:13.317076 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0807 10:41:13.317085 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 10:41:13.322940 (+ 5855us) server_negotiation.cc:407] Connection header received
0807 10:41:13.323134 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:41:13.323139 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:41:13.323225 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:41:13.323363 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:41:13.325557 (+ 2194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:13.326807 (+ 1250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:13.328784 (+ 1977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:13.329429 (+ 645us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:13.329531 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:13.336706 (+ 7175us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:41:13.336721 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:41:13.336738 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:41:13.336778 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:41:13.340851 (+ 4073us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:41:13.341749 (+ 898us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:41:13.341757 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:41:13.341761 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:41:13.341934 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:41:13.342476 (+ 542us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:41:13.342480 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:41:13.342483 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:41:13.342992 (+ 509us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:41:13.343340 (+ 348us) server_negotiation.cc:1035] Waiting for connection context
0807 10:41:13.343941 (+ 601us) server_negotiation.cc:299] Negotiation successful
0807 10:41:13.344184 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260807 10:41:13.346016 8690 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:41:13.350669 9022 ts_tablet_manager.cc:1918] T 3080f0e1d724491399c6978d8f6d740b P 5c19ab8e366243648d5346d8151f52d9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 10:41:13.350855 9022 log.cc:1196] T 3080f0e1d724491399c6978d8f6d740b P 5c19ab8e366243648d5346d8151f52d9: Deleting WAL directory at /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786098956060137-21165-0/minicluster-data/ts-2/wal/wals/3080f0e1d724491399c6978d8f6d740b
I20260807 10:41:13.351408 9022 ts_tablet_manager.cc:1939] T 3080f0e1d724491399c6978d8f6d740b P 5c19ab8e366243648d5346d8151f52d9: Deleting consensus metadata
I20260807 10:41:13.353250 8482 catalog_manager.cc:4841] TS 5c19ab8e366243648d5346d8151f52d9 (127.20.171.67:42795): tablet 3080f0e1d724491399c6978d8f6d740b (table test-table [id=b58cf327bac84fe5a43ab7a7817d0f64]) successfully deleted
I20260807 10:41:13.438997 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 8562
W20260807 10:41:13.460309 8482 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.20.171.65:39649 (error 108)
I20260807 10:41:13.461225 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 8701
I20260807 10:41:13.472856 8994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:13.472231 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.65:39649 (local address 127.0.0.1:46694)
0807 10:41:13.472612 (+ 381us) negotiation.cc:107] Waiting for socket to connect
0807 10:41:13.472721 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.65:39649: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":190}
W20260807 10:41:13.473129 8482 catalog_manager.cc:4584] TS fb94c69482e7487ba39233fac1c086cd (127.20.171.65:39649): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 3080f0e1d724491399c6978d8f6d740b: Network error: Client connection negotiation failed: client connection to 127.20.171.65:39649: connect: Connection refused (error 111)
Aug 07 10:41:13 dist-test-slave-0b58 krb5kdc[8451](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099270, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.171.66@KRBTEST.COM
I20260807 10:41:13.484464 8991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:13.463225 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44696 (local address 127.20.171.66:35539)
0807 10:41:13.463446 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0807 10:41:13.463455 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 10:41:13.463478 (+ 23us) server_negotiation.cc:407] Connection header received
0807 10:41:13.463556 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:41:13.463564 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:41:13.463658 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:41:13.463797 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:41:13.466342 (+ 2545us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:13.468026 (+ 1684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:13.470594 (+ 2568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:13.471532 (+ 938us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:13.471659 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:13.476929 (+ 5270us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:41:13.476943 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:41:13.476961 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:41:13.477002 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:41:13.481291 (+ 4289us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:41:13.482196 (+ 905us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:41:13.482205 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:41:13.482208 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:41:13.482362 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:41:13.482790 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:41:13.482796 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:41:13.482800 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:41:13.483294 (+ 494us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:41:13.483630 (+ 336us) server_negotiation.cc:1035] Waiting for connection context
0807 10:41:13.483830 (+ 200us) server_negotiation.cc:299] Negotiation successful
0807 10:41:13.484052 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260807 10:41:13.485201 8830 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:41:13.526839 8994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:13.526352 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.65:39649 (local address 127.0.0.1:46700)
0807 10:41:13.526567 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0807 10:41:13.526673 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.65:39649: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":84}
I20260807 10:41:13.528132 8994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:13.527650 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.65:39649 (local address 127.0.0.1:46706)
0807 10:41:13.527820 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0807 10:41:13.527917 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.65:39649: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
I20260807 10:41:13.588980 8994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:13.588428 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.65:39649 (local address 127.0.0.1:46710)
0807 10:41:13.588655 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0807 10:41:13.588793 (+ 138us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.65:39649: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":76}
I20260807 10:41:13.590058 8994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:13.589687 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.65:39649 (local address 127.0.0.1:46716)
0807 10:41:13.589841 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0807 10:41:13.589922 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.65:39649: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
I20260807 10:41:13.603986 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 8701
I20260807 10:41:13.627446 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 8841
Aug 07 10:41:13 dist-test-slave-0b58 krb5kdc[8451](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099270, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.171.67@KRBTEST.COM
I20260807 10:41:13.642460 8993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:13.628209 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45152 (local address 127.20.171.67:42795)
0807 10:41:13.628471 (+ 262us) server_negotiation.cc:206] Beginning negotiation
0807 10:41:13.628475 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 10:41:13.628494 (+ 19us) server_negotiation.cc:407] Connection header received
0807 10:41:13.628674 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:41:13.628678 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:41:13.628741 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:41:13.628831 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:41:13.630191 (+ 1360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:13.630906 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:13.632200 (+ 1294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:13.632623 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:13.632713 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:13.637209 (+ 4496us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:41:13.637223 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:41:13.637240 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:41:13.637278 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:41:13.639887 (+ 2609us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:41:13.640719 (+ 832us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:41:13.640726 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:41:13.640729 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:41:13.640880 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:41:13.641212 (+ 332us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:41:13.641215 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:41:13.641217 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:41:13.641568 (+ 351us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:41:13.641777 (+ 209us) server_negotiation.cc:1035] Waiting for connection context
0807 10:41:13.642046 (+ 269us) server_negotiation.cc:299] Negotiation successful
0807 10:41:13.642211 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":151}
I20260807 10:41:13.643113 8969 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:41:13.670684 8994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:13.670097 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.65:39649 (local address 127.0.0.1:46726)
0807 10:41:13.670343 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0807 10:41:13.670462 (+ 119us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.65:39649: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":87}
I20260807 10:41:13.671836 8994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:13.671377 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.65:39649 (local address 127.0.0.1:46730)
0807 10:41:13.671604 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0807 10:41:13.671694 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.65:39649: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114}
I20260807 10:41:13.734843 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 8841
I20260807 10:41:13.755383 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 8464
I20260807 10:41:13.756593 8530 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:41:13.871793 8994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:13.871091 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.65:39649 (local address 127.0.0.1:46744)
0807 10:41:13.871325 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0807 10:41:13.871475 (+ 150us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.65:39649: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
I20260807 10:41:13.872071 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 8464
2026-08-07T10:41:13Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (4657 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-08-07T10:41:13Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T10:41:13Z Disabled control of system clock
I20260807 10:41:13.974045 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786098956060137-21165-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786098956060137-21165-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786098956060137-21165-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.171.126:43583
--webserver_interface=127.20.171.126
--webserver_port=0
--builtin_ntp_servers=127.20.171.84:43665
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.171.126:43583
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260807 10:41:14.324831 9034 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:41:14.325120 9034 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:41:14.325335 9034 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:41:14.332883 9034 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 10:41:14.332989 9034 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:41:14.333076 9034 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:41:14.333186 9034 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 10:41:14.333267 9034 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 10:41:14.342716 9034 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.171.84:43665
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786098956060137-21165-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786098956060137-21165-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.171.126:43583
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.171.126:43583
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.171.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786098956060137-21165-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:41:14.344099 9034 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:41:14.345950 9034 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:41:14.358256 9042 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:41:14.358490 9039 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:41:14.358315 9040 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:41:14.359201 9034 server_base.cc:1034] running on GCE node
I20260807 10:41:14.359917 9034 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:41:14.361296 9034 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:41:14.362576 9034 hybrid_clock.cc:648] HybridClock initialized: now 1786099274362503 us; error 44 us; skew 500 ppm
I20260807 10:41:14.362960 9034 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 10:41:14.365221 9034 webserver.cc:460] Webserver started at http://127.20.171.126:36809/ using document root <none> and password file <none>
I20260807 10:41:14.365906 9034 fs_manager.cc:359] Metadata directory not provided
I20260807 10:41:14.366019 9034 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:41:14.366371 9034 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:41:14.369261 9034 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786098956060137-21165-0/minicluster-data/master-0/data/instance:
uuid: "456aa1da9fb54452b8b2e394388d7905"
format_stamp: "Formatted at 2026-08-07 10:41:14 on dist-test-slave-0b58"
server_key: "c46d40aea91bfd2b66c42f06bb17fd47"
server_key_iv: "44f479ccfbfb85a36040376b6a0a759d"
server_key_version: "encryptionkey@0"
I20260807 10:41:14.370080 9034 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786098956060137-21165-0/minicluster-data/master-0/wal/instance:
uuid: "456aa1da9fb54452b8b2e394388d7905"
format_stamp: "Formatted at 2026-08-07 10:41:14 on dist-test-slave-0b58"
server_key: "c46d40aea91bfd2b66c42f06bb17fd47"
server_key_iv: "44f479ccfbfb85a36040376b6a0a759d"
server_key_version: "encryptionkey@0"
I20260807 10:41:14.375061 9034 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260807 10:41:14.378410 9048 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:41:14.379637 9034 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260807 10:41:14.379820 9034 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786098956060137-21165-0/minicluster-data/master-0/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786098956060137-21165-0/minicluster-data/master-0/wal
uuid: "456aa1da9fb54452b8b2e394388d7905"
format_stamp: "Formatted at 2026-08-07 10:41:14 on dist-test-slave-0b58"
server_key: "c46d40aea91bfd2b66c42f06bb17fd47"
server_key_iv: "44f479ccfbfb85a36040376b6a0a759d"
server_key_version: "encryptionkey@0"
I20260807 10:41:14.380039 9034 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786098956060137-21165-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786098956060137-21165-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786098956060137-21165-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:41:14.398047 9034 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:41:14.398874 9034 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:41:14.399214 9034 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:41:14.418543 9034 rpc_server.cc:307] RPC server started. Bound to: 127.20.171.126:43583
I20260807 10:41:14.418567 9102 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.171.126:43583 every 8 connection(s)
I20260807 10:41:14.419945 9034 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
I20260807 10:41:14.423717 9103 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:41:14.425454 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 9034
I20260807 10:41:14.425653 21165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786098956060137-21165-0/minicluster-data/master-0/wal/instance
I20260807 10:41:14.426261 21165 external_mini_cluster.cc:1428] Setting key ee476a848331d7014cee052c913dd76d
I20260807 10:41:14.437734 9103 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 456aa1da9fb54452b8b2e394388d7905: Bootstrap starting.
I20260807 10:41:14.439883 9106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:14.428301 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37354 (local address 127.20.171.126:43583)
0807 10:41:14.429388 (+ 1087us) server_negotiation.cc:206] Beginning negotiation
0807 10:41:14.429398 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 10:41:14.429445 (+ 47us) server_negotiation.cc:407] Connection header received
0807 10:41:14.431127 (+ 1682us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:41:14.431151 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:41:14.431681 (+ 530us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:41:14.432085 (+ 404us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:41:14.432660 (+ 575us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:14.433999 (+ 1339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:14.435348 (+ 1349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:14.436071 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:14.436268 (+ 197us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:14.437522 (+ 1254us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:41:14.437530 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:41:14.437545 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:41:14.438163 (+ 618us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:41:14.438227 (+ 64us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:41:14.438252 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:41:14.438381 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0807 10:41:14.438603 (+ 222us) server_negotiation.cc:299] Negotiation successful
0807 10:41:14.438953 (+ 350us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":669,"thread_start_us":393,"threads_started":1}
I20260807 10:41:14.441447 9103 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 456aa1da9fb54452b8b2e394388d7905: Neither blocks nor log segments found. Creating new log.
I20260807 10:41:14.442576 9103 log.cc:824] T 00000000000000000000000000000000 P 456aa1da9fb54452b8b2e394388d7905: Log is configured to *not* fsync() on all Append() calls
I20260807 10:41:14.445351 9103 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 456aa1da9fb54452b8b2e394388d7905: No bootstrap required, opened a new log
I20260807 10:41:14.452787 9103 raft_consensus.cc:348] T 00000000000000000000000000000000 P 456aa1da9fb54452b8b2e394388d7905 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "456aa1da9fb54452b8b2e394388d7905" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 43583 } }
I20260807 10:41:14.453146 9103 raft_consensus.cc:374] T 00000000000000000000000000000000 P 456aa1da9fb54452b8b2e394388d7905 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:41:14.453222 9103 raft_consensus.cc:729] T 00000000000000000000000000000000 P 456aa1da9fb54452b8b2e394388d7905 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 456aa1da9fb54452b8b2e394388d7905, State: Initialized, Role: FOLLOWER
I20260807 10:41:14.453751 9103 consensus_queue.cc:260] T 00000000000000000000000000000000 P 456aa1da9fb54452b8b2e394388d7905 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "456aa1da9fb54452b8b2e394388d7905" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 43583 } }
I20260807 10:41:14.453964 9103 raft_consensus.cc:388] T 00000000000000000000000000000000 P 456aa1da9fb54452b8b2e394388d7905 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 10:41:14.454066 9103 raft_consensus.cc:482] T 00000000000000000000000000000000 P 456aa1da9fb54452b8b2e394388d7905 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 10:41:14.454178 9103 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 456aa1da9fb54452b8b2e394388d7905 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:41:14.456568 9103 raft_consensus.cc:504] T 00000000000000000000000000000000 P 456aa1da9fb54452b8b2e394388d7905 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "456aa1da9fb54452b8b2e394388d7905" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 43583 } }
I20260807 10:41:14.457021 9103 leader_election.cc:302] T 00000000000000000000000000000000 P 456aa1da9fb54452b8b2e394388d7905 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 456aa1da9fb54452b8b2e394388d7905; no voters:
I20260807 10:41:14.457538 9103 leader_election.cc:288] T 00000000000000000000000000000000 P 456aa1da9fb54452b8b2e394388d7905 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 10:41:14.457758 9108 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 456aa1da9fb54452b8b2e394388d7905 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:41:14.458561 9108 raft_consensus.cc:686] T 00000000000000000000000000000000 P 456aa1da9fb54452b8b2e394388d7905 [term 1 LEADER]: Becoming Leader. State: Replica: 456aa1da9fb54452b8b2e394388d7905, State: Running, Role: LEADER
I20260807 10:41:14.459055 9108 consensus_queue.cc:237] T 00000000000000000000000000000000 P 456aa1da9fb54452b8b2e394388d7905 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "456aa1da9fb54452b8b2e394388d7905" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 43583 } }
I20260807 10:41:14.459699 9103 sys_catalog.cc:564] T 00000000000000000000000000000000 P 456aa1da9fb54452b8b2e394388d7905 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 10:41:14.462010 9110 sys_catalog.cc:455] T 00000000000000000000000000000000 P 456aa1da9fb54452b8b2e394388d7905 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 456aa1da9fb54452b8b2e394388d7905. Latest consensus state: current_term: 1 leader_uuid: "456aa1da9fb54452b8b2e394388d7905" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "456aa1da9fb54452b8b2e394388d7905" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 43583 } } }
I20260807 10:41:14.462365 9109 sys_catalog.cc:455] T 00000000000000000000000000000000 P 456aa1da9fb54452b8b2e394388d7905 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "456aa1da9fb54452b8b2e394388d7905" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "456aa1da9fb54452b8b2e394388d7905" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 43583 } } }
I20260807 10:41:14.462682 9109 sys_catalog.cc:458] T 00000000000000000000000000000000 P 456aa1da9fb54452b8b2e394388d7905 [sys.catalog]: This master's current role is: LEADER
I20260807 10:41:14.462548 9110 sys_catalog.cc:458] T 00000000000000000000000000000000 P 456aa1da9fb54452b8b2e394388d7905 [sys.catalog]: This master's current role is: LEADER
I20260807 10:41:14.464459 9117 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 10:41:14.469846 9117 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 10:41:14.478062 9117 catalog_manager.cc:1347] Generated new cluster ID: 9c513e280964421596226261b596e055
I20260807 10:41:14.478178 9117 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 10:41:14.488391 9117 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 10:41:14.489599 9117 catalog_manager.cc:1504] Loading token signing keys...
I20260807 10:41:14.498414 9117 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 456aa1da9fb54452b8b2e394388d7905: Generated new TSK 0
I20260807 10:41:14.499301 9117 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 10:41:14.513672 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786098956060137-21165-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786098956060137-21165-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786098956060137-21165-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786098956060137-21165-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.171.65:0
--local_ip_for_outbound_sockets=127.20.171.65
--webserver_interface=127.20.171.65
--webserver_port=0
--tserver_master_addrs=127.20.171.126:43583
--builtin_ntp_servers=127.20.171.84:43665
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260807 10:41:14.870774 9129 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:41:14.871052 9129 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:41:14.871227 9129 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:41:14.878786 9129 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:41:14.878923 9129 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:41:14.879105 9129 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.171.65
I20260807 10:41:14.888983 9129 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.171.84:43665
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786098956060137-21165-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786098956060137-21165-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.171.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786098956060137-21165-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.171.65
--webserver_port=0
--tserver_master_addrs=127.20.171.126:43583
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.171.65
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786098956060137-21165-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:41:14.890347 9129 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:41:14.892225 9129 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:41:14.905789 9137 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:41:14.905767 9135 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:41:14.906301 9134 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:41:14.906613 9129 server_base.cc:1034] running on GCE node
I20260807 10:41:14.907294 9129 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:41:14.908293 9129 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:41:14.909523 9129 hybrid_clock.cc:648] HybridClock initialized: now 1786099274909482 us; error 37 us; skew 500 ppm
I20260807 10:41:14.909853 9129 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 10:41:14.912411 9129 webserver.cc:460] Webserver started at http://127.20.171.65:44483/ using document root <none> and password file <none>
I20260807 10:41:14.913177 9129 fs_manager.cc:359] Metadata directory not provided
I20260807 10:41:14.913300 9129 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:41:14.913638 9129 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:41:14.916710 9129 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786098956060137-21165-0/minicluster-data/ts-0/data/instance:
uuid: "f1cb46cdb0ef41cd8048fd3b1a7303d5"
format_stamp: "Formatted at 2026-08-07 10:41:14 on dist-test-slave-0b58"
server_key: "5d39fc8d5b84b7b28d24e1e09673d8a3"
server_key_iv: "aa6fb1b40ca4c2b5b931e9ebbed6af4e"
server_key_version: "encryptionkey@0"
I20260807 10:41:14.917595 9129 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786098956060137-21165-0/minicluster-data/ts-0/wal/instance:
uuid: "f1cb46cdb0ef41cd8048fd3b1a7303d5"
format_stamp: "Formatted at 2026-08-07 10:41:14 on dist-test-slave-0b58"
server_key: "5d39fc8d5b84b7b28d24e1e09673d8a3"
server_key_iv: "aa6fb1b40ca4c2b5b931e9ebbed6af4e"
server_key_version: "encryptionkey@0"
I20260807 10:41:14.922766 9129 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.003s
I20260807 10:41:14.926183 9143 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:41:14.927480 9129 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 10:41:14.927666 9129 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786098956060137-21165-0/minicluster-data/ts-0/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786098956060137-21165-0/minicluster-data/ts-0/wal
uuid: "f1cb46cdb0ef41cd8048fd3b1a7303d5"
format_stamp: "Formatted at 2026-08-07 10:41:14 on dist-test-slave-0b58"
server_key: "5d39fc8d5b84b7b28d24e1e09673d8a3"
server_key_iv: "aa6fb1b40ca4c2b5b931e9ebbed6af4e"
server_key_version: "encryptionkey@0"
I20260807 10:41:14.927878 9129 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786098956060137-21165-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786098956060137-21165-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786098956060137-21165-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:41:14.940686 9129 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:41:14.941480 9129 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:41:14.941792 9129 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:41:14.942742 9129 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:41:14.944343 9129 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:41:14.944466 9129 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:41:14.944593 9129 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:41:14.944679 9129 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:41:14.977555 9129 rpc_server.cc:307] RPC server started. Bound to: 127.20.171.65:35775
I20260807 10:41:14.977596 9259 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.171.65:35775 every 8 connection(s)
I20260807 10:41:14.978892 9129 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786098956060137-21165-0/minicluster-data/ts-0/data/info.pb
I20260807 10:41:14.988720 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 9129
I20260807 10:41:14.988943 21165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786098956060137-21165-0/minicluster-data/ts-0/wal/instance
I20260807 10:41:14.989513 21165 external_mini_cluster.cc:1428] Setting key 7713d6a771ae9d98a70ecbcabc59f289
I20260807 10:41:14.992017 9263 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:14.981511 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.65:44501 (local address 127.20.171.126:43583)
0807 10:41:14.981998 (+ 487us) server_negotiation.cc:206] Beginning negotiation
0807 10:41:14.982005 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:41:14.983203 (+ 1198us) server_negotiation.cc:407] Connection header received
0807 10:41:14.985175 (+ 1972us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:41:14.985180 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:41:14.985270 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:41:14.985397 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:41:14.986513 (+ 1116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:14.987297 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:14.988989 (+ 1692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:14.989639 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:14.989778 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:14.991101 (+ 1323us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:41:14.991108 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:41:14.991116 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:41:14.991138 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:41:14.991212 (+ 74us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:41:14.991231 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:41:14.991328 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0807 10:41:14.991561 (+ 233us) server_negotiation.cc:299] Negotiation successful
0807 10:41:14.991659 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":356,"thread_start_us":231,"threads_started":1}
I20260807 10:41:14.992427 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786098956060137-21165-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786098956060137-21165-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786098956060137-21165-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786098956060137-21165-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.171.66:0
--local_ip_for_outbound_sockets=127.20.171.66
--webserver_interface=127.20.171.66
--webserver_port=0
--tserver_master_addrs=127.20.171.126:43583
--builtin_ntp_servers=127.20.171.84:43665
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260807 10:41:14.993170 9264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:14.982092 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:43583 (local address 127.20.171.65:44501)
0807 10:41:14.983047 (+ 955us) negotiation.cc:107] Waiting for socket to connect
0807 10:41:14.983091 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0807 10:41:14.984908 (+ 1817us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:41:14.985638 (+ 730us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:41:14.985646 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:41:14.985749 (+ 103us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:41:14.986328 (+ 579us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:41:14.986345 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:41:14.987471 (+ 1126us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:41:14.987475 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:41:14.988810 (+ 1335us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:41:14.988823 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:41:14.989847 (+ 1024us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:41:14.989852 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:41:14.990055 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:14.990791 (+ 736us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 10:41:14.990793 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:41:14.990831 (+ 38us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 10:41:14.990908 (+ 77us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:41:14.991325 (+ 417us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:41:14.991334 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:41:14.991340 (+ 6us) client_negotiation.cc:769] Sending connection context
0807 10:41:14.991545 (+ 205us) client_negotiation.cc:240] Negotiation successful
0807 10:41:14.991916 (+ 371us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":470,"thread_start_us":291,"threads_started":1}
I20260807 10:41:14.994706 9261 heartbeater.cc:347] Connected to a master server at 127.20.171.126:43583
I20260807 10:41:14.995038 9261 heartbeater.cc:464] Registering TS with master...
I20260807 10:41:14.995913 9261 heartbeater.cc:511] Master 127.20.171.126:43583 requested a full tablet report, sending...
I20260807 10:41:14.998320 9066 ts_manager.cc:194] Registered new tserver with Master: f1cb46cdb0ef41cd8048fd3b1a7303d5 (127.20.171.65:35775)
I20260807 10:41:15.000548 9066 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.20.171.65:44501
W20260807 10:41:15.336145 9265 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:41:15.336469 9265 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:41:15.336642 9265 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:41:15.343828 9265 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:41:15.343921 9265 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:41:15.344053 9265 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.171.66
I20260807 10:41:15.353129 9265 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.171.84:43665
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786098956060137-21165-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786098956060137-21165-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.171.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786098956060137-21165-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.171.66
--webserver_port=0
--tserver_master_addrs=127.20.171.126:43583
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.171.66
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786098956060137-21165-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:41:15.354429 9265 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:41:15.356153 9265 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:41:15.373251 9270 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:41:15.373284 9273 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:41:15.373350 9271 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:41:15.374507 9265 server_base.cc:1034] running on GCE node
I20260807 10:41:15.375165 9265 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:41:15.376114 9265 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:41:15.377347 9265 hybrid_clock.cc:648] HybridClock initialized: now 1786099275377301 us; error 49 us; skew 500 ppm
I20260807 10:41:15.377669 9265 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 10:41:15.379827 9265 webserver.cc:460] Webserver started at http://127.20.171.66:45431/ using document root <none> and password file <none>
I20260807 10:41:15.380584 9265 fs_manager.cc:359] Metadata directory not provided
I20260807 10:41:15.380716 9265 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:41:15.381022 9265 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:41:15.383920 9265 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786098956060137-21165-0/minicluster-data/ts-1/data/instance:
uuid: "070cd2a47d0340a0822715dc272dcce5"
format_stamp: "Formatted at 2026-08-07 10:41:15 on dist-test-slave-0b58"
server_key: "66b67040d9fe7247f1b9e7730ded15aa"
server_key_iv: "2a1e0fcd89ccb77e45642c54cb513732"
server_key_version: "encryptionkey@0"
I20260807 10:41:15.384752 9265 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786098956060137-21165-0/minicluster-data/ts-1/wal/instance:
uuid: "070cd2a47d0340a0822715dc272dcce5"
format_stamp: "Formatted at 2026-08-07 10:41:15 on dist-test-slave-0b58"
server_key: "66b67040d9fe7247f1b9e7730ded15aa"
server_key_iv: "2a1e0fcd89ccb77e45642c54cb513732"
server_key_version: "encryptionkey@0"
I20260807 10:41:15.389822 9265 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260807 10:41:15.393112 9279 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:41:15.394415 9265 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 10:41:15.394590 9265 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786098956060137-21165-0/minicluster-data/ts-1/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786098956060137-21165-0/minicluster-data/ts-1/wal
uuid: "070cd2a47d0340a0822715dc272dcce5"
format_stamp: "Formatted at 2026-08-07 10:41:15 on dist-test-slave-0b58"
server_key: "66b67040d9fe7247f1b9e7730ded15aa"
server_key_iv: "2a1e0fcd89ccb77e45642c54cb513732"
server_key_version: "encryptionkey@0"
I20260807 10:41:15.394807 9265 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786098956060137-21165-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786098956060137-21165-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786098956060137-21165-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:41:15.409827 9265 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:41:15.410579 9265 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:41:15.410892 9265 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:41:15.411806 9265 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:41:15.413290 9265 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:41:15.413429 9265 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:41:15.413558 9265 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:41:15.413650 9265 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:41:15.449573 9265 rpc_server.cc:307] RPC server started. Bound to: 127.20.171.66:33779
I20260807 10:41:15.449658 9397 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.171.66:33779 every 8 connection(s)
I20260807 10:41:15.450861 9265 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786098956060137-21165-0/minicluster-data/ts-1/data/info.pb
I20260807 10:41:15.458287 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 9265
I20260807 10:41:15.458468 21165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786098956060137-21165-0/minicluster-data/ts-1/wal/instance
I20260807 10:41:15.458971 21165 external_mini_cluster.cc:1428] Setting key 4c9c5a6af3d4586ddb93cd5927c73f80
I20260807 10:41:15.462330 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786098956060137-21165-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786098956060137-21165-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786098956060137-21165-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786098956060137-21165-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.171.67:0
--local_ip_for_outbound_sockets=127.20.171.67
--webserver_interface=127.20.171.67
--webserver_port=0
--tserver_master_addrs=127.20.171.126:43583
--builtin_ntp_servers=127.20.171.84:43665
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260807 10:41:15.463729 9263 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:15.453478 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.66:48399 (local address 127.20.171.126:43583)
0807 10:41:15.453673 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0807 10:41:15.453678 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:41:15.454968 (+ 1290us) server_negotiation.cc:407] Connection header received
0807 10:41:15.456757 (+ 1789us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:41:15.456761 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:41:15.456852 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:41:15.456939 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:41:15.457911 (+ 972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:15.458753 (+ 842us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:15.460656 (+ 1903us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:15.461274 (+ 618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:15.461378 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:15.462977 (+ 1599us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:41:15.462981 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:41:15.462985 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:41:15.463002 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:41:15.463035 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:41:15.463046 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:41:15.463114 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0807 10:41:15.463400 (+ 286us) server_negotiation.cc:299] Negotiation successful
0807 10:41:15.463505 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260807 10:41:15.465281 9401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:15.453950 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:43583 (local address 127.20.171.66:48399)
0807 10:41:15.454801 (+ 851us) negotiation.cc:107] Waiting for socket to connect
0807 10:41:15.454834 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0807 10:41:15.456523 (+ 1689us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:41:15.457130 (+ 607us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:41:15.457137 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:41:15.457215 (+ 78us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:41:15.457767 (+ 552us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:41:15.457783 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:41:15.458914 (+ 1131us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:41:15.458919 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:41:15.460495 (+ 1576us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:41:15.460508 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:41:15.461505 (+ 997us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:41:15.461512 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:41:15.461804 (+ 292us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:15.462575 (+ 771us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 10:41:15.462581 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:41:15.462643 (+ 62us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 10:41:15.462769 (+ 126us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:41:15.463143 (+ 374us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:41:15.463156 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:41:15.463168 (+ 12us) client_negotiation.cc:769] Sending connection context
0807 10:41:15.463357 (+ 189us) client_negotiation.cc:240] Negotiation successful
0807 10:41:15.463790 (+ 433us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":449,"thread_start_us":269,"threads_started":1}
I20260807 10:41:15.466779 9399 heartbeater.cc:347] Connected to a master server at 127.20.171.126:43583
I20260807 10:41:15.467142 9399 heartbeater.cc:464] Registering TS with master...
I20260807 10:41:15.468078 9399 heartbeater.cc:511] Master 127.20.171.126:43583 requested a full tablet report, sending...
I20260807 10:41:15.469614 9066 ts_manager.cc:194] Registered new tserver with Master: 070cd2a47d0340a0822715dc272dcce5 (127.20.171.66:33779)
I20260807 10:41:15.470417 9066 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.20.171.66:48399
W20260807 10:41:15.806864 9402 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:41:15.807147 9402 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:41:15.807235 9402 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:41:15.814267 9402 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:41:15.814358 9402 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:41:15.814469 9402 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.171.67
I20260807 10:41:15.823320 9402 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.171.84:43665
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786098956060137-21165-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786098956060137-21165-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.171.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786098956060137-21165-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.171.67
--webserver_port=0
--tserver_master_addrs=127.20.171.126:43583
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.171.67
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786098956060137-21165-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:41:15.824553 9402 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:41:15.826277 9402 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:41:15.839557 9410 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:41:15.839612 9407 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:41:15.839645 9408 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:41:15.840456 9402 server_base.cc:1034] running on GCE node
I20260807 10:41:15.841058 9402 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:41:15.842015 9402 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:41:15.843218 9402 hybrid_clock.cc:648] HybridClock initialized: now 1786099275843175 us; error 30 us; skew 500 ppm
I20260807 10:41:15.843575 9402 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 10:41:15.845795 9402 webserver.cc:460] Webserver started at http://127.20.171.67:39917/ using document root <none> and password file <none>
I20260807 10:41:15.846467 9402 fs_manager.cc:359] Metadata directory not provided
I20260807 10:41:15.846580 9402 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:41:15.846904 9402 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:41:15.849768 9402 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786098956060137-21165-0/minicluster-data/ts-2/data/instance:
uuid: "78e1edf0f5a946eba27c0e8a92b87ec2"
format_stamp: "Formatted at 2026-08-07 10:41:15 on dist-test-slave-0b58"
server_key: "39da404a230c4d7f77bb0e37bfa266fc"
server_key_iv: "7e75408abac362ec85619a80415746c9"
server_key_version: "encryptionkey@0"
I20260807 10:41:15.850569 9402 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786098956060137-21165-0/minicluster-data/ts-2/wal/instance:
uuid: "78e1edf0f5a946eba27c0e8a92b87ec2"
format_stamp: "Formatted at 2026-08-07 10:41:15 on dist-test-slave-0b58"
server_key: "39da404a230c4d7f77bb0e37bfa266fc"
server_key_iv: "7e75408abac362ec85619a80415746c9"
server_key_version: "encryptionkey@0"
I20260807 10:41:15.855641 9402 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260807 10:41:15.858951 9416 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:41:15.860337 9402 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 10:41:15.860528 9402 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786098956060137-21165-0/minicluster-data/ts-2/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786098956060137-21165-0/minicluster-data/ts-2/wal
uuid: "78e1edf0f5a946eba27c0e8a92b87ec2"
format_stamp: "Formatted at 2026-08-07 10:41:15 on dist-test-slave-0b58"
server_key: "39da404a230c4d7f77bb0e37bfa266fc"
server_key_iv: "7e75408abac362ec85619a80415746c9"
server_key_version: "encryptionkey@0"
I20260807 10:41:15.860761 9402 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786098956060137-21165-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786098956060137-21165-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786098956060137-21165-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:41:15.889914 9402 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:41:15.890851 9402 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:41:15.891175 9402 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:41:15.892176 9402 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:41:15.893613 9402 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:41:15.893752 9402 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:41:15.893886 9402 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:41:15.893973 9402 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:41:15.927994 9402 rpc_server.cc:307] RPC server started. Bound to: 127.20.171.67:46803
I20260807 10:41:15.928084 9532 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.171.67:46803 every 8 connection(s)
I20260807 10:41:15.929337 9402 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786098956060137-21165-0/minicluster-data/ts-2/data/info.pb
I20260807 10:41:15.939492 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 9402
I20260807 10:41:15.939694 21165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786098956060137-21165-0/minicluster-data/ts-2/wal/instance
I20260807 10:41:15.940243 21165 external_mini_cluster.cc:1428] Setting key 13f06a60092667555d91241d95884cd6
I20260807 10:41:15.941769 9263 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:15.931852 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.67:60495 (local address 127.20.171.126:43583)
0807 10:41:15.932087 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0807 10:41:15.932094 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:41:15.933533 (+ 1439us) server_negotiation.cc:407] Connection header received
0807 10:41:15.935250 (+ 1717us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:41:15.935254 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:41:15.935320 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:41:15.935404 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:41:15.936469 (+ 1065us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:15.937207 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:15.938688 (+ 1481us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:15.939094 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:15.939197 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:15.940830 (+ 1633us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:41:15.940834 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:41:15.940838 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:41:15.940874 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:41:15.940917 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:41:15.940934 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:41:15.941028 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0807 10:41:15.941319 (+ 291us) server_negotiation.cc:299] Negotiation successful
0807 10:41:15.941442 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260807 10:41:15.942967 9535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:15.932456 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:43583 (local address 127.20.171.67:60495)
0807 10:41:15.933359 (+ 903us) negotiation.cc:107] Waiting for socket to connect
0807 10:41:15.933410 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0807 10:41:15.935013 (+ 1603us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:41:15.935608 (+ 595us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:41:15.935616 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:41:15.935696 (+ 80us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:41:15.936236 (+ 540us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:41:15.936318 (+ 82us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:41:15.937337 (+ 1019us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:41:15.937340 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:41:15.938565 (+ 1225us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:41:15.938577 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:41:15.939419 (+ 842us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:41:15.939423 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:41:15.939617 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:15.940517 (+ 900us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 10:41:15.940520 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:41:15.940561 (+ 41us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 10:41:15.940632 (+ 71us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:41:15.941056 (+ 424us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:41:15.941066 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:41:15.941072 (+ 6us) client_negotiation.cc:769] Sending connection context
0807 10:41:15.941283 (+ 211us) client_negotiation.cc:240] Negotiation successful
0807 10:41:15.941679 (+ 396us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":486,"thread_start_us":321,"threads_started":1}
I20260807 10:41:15.944425 9533 heartbeater.cc:347] Connected to a master server at 127.20.171.126:43583
I20260807 10:41:15.944756 9533 heartbeater.cc:464] Registering TS with master...
I20260807 10:41:15.945498 9533 heartbeater.cc:511] Master 127.20.171.126:43583 requested a full tablet report, sending...
I20260807 10:41:15.946846 9066 ts_manager.cc:194] Registered new tserver with Master: 78e1edf0f5a946eba27c0e8a92b87ec2 (127.20.171.67:46803)
I20260807 10:41:15.947635 9066 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.20.171.67:60495
I20260807 10:41:15.955839 21165 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 10:41:15.966310 9263 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:15.960046 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37360 (local address 127.20.171.126:43583)
0807 10:41:15.960310 (+ 264us) server_negotiation.cc:206] Beginning negotiation
0807 10:41:15.960322 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 10:41:15.960823 (+ 501us) server_negotiation.cc:407] Connection header received
0807 10:41:15.960948 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:41:15.960951 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:41:15.961010 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:41:15.961089 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:41:15.961543 (+ 454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:15.962284 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:15.963657 (+ 1373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:15.964075 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:15.964224 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:15.965394 (+ 1170us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:41:15.965399 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:41:15.965402 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:41:15.965420 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:41:15.965452 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:41:15.965464 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:41:15.965628 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0807 10:41:15.965892 (+ 264us) server_negotiation.cc:299] Negotiation successful
0807 10:41:15.966015 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260807 10:41:15.969986 9066 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37360:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 10:41:15.977164 9066 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 10:41:16.004644 9261 heartbeater.cc:503] Master 127.20.171.126:43583 was elected leader, sending a full tablet report...
I20260807 10:41:16.015846 9551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:15.991846 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38260 (local address 127.20.171.67:46803)
0807 10:41:16.006066 (+ 14220us) server_negotiation.cc:206] Beginning negotiation
0807 10:41:16.006078 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 10:41:16.006126 (+ 48us) server_negotiation.cc:407] Connection header received
0807 10:41:16.006278 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:41:16.006290 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:41:16.006628 (+ 338us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:41:16.006899 (+ 271us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:41:16.008869 (+ 1970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:16.010535 (+ 1666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:16.013279 (+ 2744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:16.014707 (+ 1428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:16.014851 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:16.015132 (+ 281us) server_negotiation.cc:1035] Waiting for connection context
0807 10:41:16.015405 (+ 273us) server_negotiation.cc:299] Negotiation successful
0807 10:41:16.015556 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13993,"thread_start_us":13759,"threads_started":1}
I20260807 10:41:16.016649 9547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:15.990589 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.67:46803 (local address 127.0.0.1:38260)
0807 10:41:16.003999 (+ 13410us) negotiation.cc:107] Waiting for socket to connect
0807 10:41:16.004025 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0807 10:41:16.004177 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:41:16.007678 (+ 3501us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:41:16.007684 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:41:16.007710 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:41:16.008224 (+ 514us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:41:16.008239 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:41:16.010690 (+ 2451us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:41:16.010696 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:41:16.013068 (+ 2372us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:41:16.013082 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:41:16.014904 (+ 1822us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:41:16.014911 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:41:16.015119 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:16.015170 (+ 51us) client_negotiation.cc:769] Sending connection context
0807 10:41:16.015303 (+ 133us) client_negotiation.cc:240] Negotiation successful
0807 10:41:16.016303 (+ 1000us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13233,"thread_start_us":1671,"threads_started":1}
I20260807 10:41:16.017009 9546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:15.990248 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.65:35775 (local address 127.0.0.1:57994)
0807 10:41:15.997632 (+ 7384us) negotiation.cc:107] Waiting for socket to connect
0807 10:41:15.997693 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0807 10:41:15.997907 (+ 214us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:41:16.008748 (+ 10841us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:41:16.008752 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:41:16.008780 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:41:16.009214 (+ 434us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:41:16.009228 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:41:16.011180 (+ 1952us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:41:16.011185 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:41:16.012983 (+ 1798us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:41:16.012999 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:41:16.015297 (+ 2298us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:41:16.015304 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:41:16.016226 (+ 922us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:16.016279 (+ 53us) client_negotiation.cc:769] Sending connection context
0807 10:41:16.016366 (+ 87us) client_negotiation.cc:240] Negotiation successful
0807 10:41:16.016500 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7020,"mutex_wait_us":757,"thread_start_us":18306,"threads_started":1}
I20260807 10:41:16.017323 9549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:15.991355 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38110 (local address 127.20.171.66:33779)
0807 10:41:16.003172 (+ 11817us) server_negotiation.cc:206] Beginning negotiation
0807 10:41:16.003185 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 10:41:16.008985 (+ 5800us) server_negotiation.cc:407] Connection header received
0807 10:41:16.009178 (+ 193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:41:16.009183 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:41:16.009354 (+ 171us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:41:16.009554 (+ 200us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:41:16.010107 (+ 553us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:16.012635 (+ 2528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:16.014474 (+ 1839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:16.015851 (+ 1377us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:16.015998 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:16.016236 (+ 238us) server_negotiation.cc:1035] Waiting for connection context
0807 10:41:16.016770 (+ 534us) server_negotiation.cc:299] Negotiation successful
0807 10:41:16.016942 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11590,"thread_start_us":11828,"threads_started":1}
I20260807 10:41:16.017580 9548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:15.991099 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57994 (local address 127.20.171.65:35775)
0807 10:41:16.008038 (+ 16939us) server_negotiation.cc:206] Beginning negotiation
0807 10:41:16.008050 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 10:41:16.008083 (+ 33us) server_negotiation.cc:407] Connection header received
0807 10:41:16.008194 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:41:16.008204 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:41:16.008512 (+ 308us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:41:16.009417 (+ 905us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:41:16.009666 (+ 249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:16.011017 (+ 1351us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:16.013200 (+ 2183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:16.014707 (+ 1507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:16.014858 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:16.015133 (+ 275us) server_negotiation.cc:1035] Waiting for connection context
0807 10:41:16.016991 (+ 1858us) server_negotiation.cc:299] Negotiation successful
0807 10:41:16.017187 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16710,"thread_start_us":16281,"threads_started":1}
I20260807 10:41:16.018661 9545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:15.991070 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.66:33779 (local address 127.0.0.1:38110)
0807 10:41:16.008848 (+ 17778us) negotiation.cc:107] Waiting for socket to connect
0807 10:41:16.008866 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 10:41:16.009026 (+ 160us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:41:16.009554 (+ 528us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:41:16.009559 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:41:16.009581 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:41:16.009925 (+ 344us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:41:16.009935 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:41:16.012779 (+ 2844us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:41:16.012784 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:41:16.014286 (+ 1502us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:41:16.014298 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:41:16.016399 (+ 2101us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:41:16.016405 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:41:16.016588 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:16.016611 (+ 23us) client_negotiation.cc:769] Sending connection context
0807 10:41:16.016724 (+ 113us) client_negotiation.cc:240] Negotiation successful
0807 10:41:16.018438 (+ 1714us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":17632,"mutex_wait_us":1,"thread_start_us":12553,"threads_started":1}
I20260807 10:41:16.021075 9464 tablet_service.cc:1467] Processing CreateTablet for tablet ceec8dd3e38a4b16943a3d59ba187583 (DEFAULT_TABLE table=test-table [id=f57d2018637549e0ae91972b27bb3a29]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:41:16.021064 9192 tablet_service.cc:1467] Processing CreateTablet for tablet ceec8dd3e38a4b16943a3d59ba187583 (DEFAULT_TABLE table=test-table [id=f57d2018637549e0ae91972b27bb3a29]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:41:16.021835 9329 tablet_service.cc:1467] Processing CreateTablet for tablet ceec8dd3e38a4b16943a3d59ba187583 (DEFAULT_TABLE table=test-table [id=f57d2018637549e0ae91972b27bb3a29]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:41:16.022619 9464 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ceec8dd3e38a4b16943a3d59ba187583. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:41:16.022619 9192 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ceec8dd3e38a4b16943a3d59ba187583. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:41:16.022961 9329 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ceec8dd3e38a4b16943a3d59ba187583. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:41:16.035907 9552 tablet_bootstrap.cc:492] T ceec8dd3e38a4b16943a3d59ba187583 P 070cd2a47d0340a0822715dc272dcce5: Bootstrap starting.
I20260807 10:41:16.038067 9554 tablet_bootstrap.cc:492] T ceec8dd3e38a4b16943a3d59ba187583 P f1cb46cdb0ef41cd8048fd3b1a7303d5: Bootstrap starting.
I20260807 10:41:16.039037 9553 tablet_bootstrap.cc:492] T ceec8dd3e38a4b16943a3d59ba187583 P 78e1edf0f5a946eba27c0e8a92b87ec2: Bootstrap starting.
I20260807 10:41:16.039973 9552 tablet_bootstrap.cc:654] T ceec8dd3e38a4b16943a3d59ba187583 P 070cd2a47d0340a0822715dc272dcce5: Neither blocks nor log segments found. Creating new log.
I20260807 10:41:16.041366 9552 log.cc:824] T ceec8dd3e38a4b16943a3d59ba187583 P 070cd2a47d0340a0822715dc272dcce5: Log is configured to *not* fsync() on all Append() calls
I20260807 10:41:16.042531 9554 tablet_bootstrap.cc:654] T ceec8dd3e38a4b16943a3d59ba187583 P f1cb46cdb0ef41cd8048fd3b1a7303d5: Neither blocks nor log segments found. Creating new log.
I20260807 10:41:16.042703 9553 tablet_bootstrap.cc:654] T ceec8dd3e38a4b16943a3d59ba187583 P 78e1edf0f5a946eba27c0e8a92b87ec2: Neither blocks nor log segments found. Creating new log.
I20260807 10:41:16.043834 9554 log.cc:824] T ceec8dd3e38a4b16943a3d59ba187583 P f1cb46cdb0ef41cd8048fd3b1a7303d5: Log is configured to *not* fsync() on all Append() calls
I20260807 10:41:16.043998 9553 log.cc:824] T ceec8dd3e38a4b16943a3d59ba187583 P 78e1edf0f5a946eba27c0e8a92b87ec2: Log is configured to *not* fsync() on all Append() calls
I20260807 10:41:16.045054 9552 tablet_bootstrap.cc:492] T ceec8dd3e38a4b16943a3d59ba187583 P 070cd2a47d0340a0822715dc272dcce5: No bootstrap required, opened a new log
I20260807 10:41:16.045393 9552 ts_tablet_manager.cc:1397] T ceec8dd3e38a4b16943a3d59ba187583 P 070cd2a47d0340a0822715dc272dcce5: Time spent bootstrapping tablet: real 0.010s user 0.001s sys 0.006s
I20260807 10:41:16.047210 9554 tablet_bootstrap.cc:492] T ceec8dd3e38a4b16943a3d59ba187583 P f1cb46cdb0ef41cd8048fd3b1a7303d5: No bootstrap required, opened a new log
I20260807 10:41:16.047210 9553 tablet_bootstrap.cc:492] T ceec8dd3e38a4b16943a3d59ba187583 P 78e1edf0f5a946eba27c0e8a92b87ec2: No bootstrap required, opened a new log
I20260807 10:41:16.047482 9554 ts_tablet_manager.cc:1397] T ceec8dd3e38a4b16943a3d59ba187583 P f1cb46cdb0ef41cd8048fd3b1a7303d5: Time spent bootstrapping tablet: real 0.010s user 0.003s sys 0.003s
I20260807 10:41:16.047482 9553 ts_tablet_manager.cc:1397] T ceec8dd3e38a4b16943a3d59ba187583 P 78e1edf0f5a946eba27c0e8a92b87ec2: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.000s
I20260807 10:41:16.052702 9552 raft_consensus.cc:348] T ceec8dd3e38a4b16943a3d59ba187583 P 070cd2a47d0340a0822715dc272dcce5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1cb46cdb0ef41cd8048fd3b1a7303d5" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 35775 } } peers { permanent_uuid: "78e1edf0f5a946eba27c0e8a92b87ec2" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 46803 } } peers { permanent_uuid: "070cd2a47d0340a0822715dc272dcce5" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 33779 } }
I20260807 10:41:16.053095 9552 raft_consensus.cc:374] T ceec8dd3e38a4b16943a3d59ba187583 P 070cd2a47d0340a0822715dc272dcce5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:41:16.053228 9552 raft_consensus.cc:729] T ceec8dd3e38a4b16943a3d59ba187583 P 070cd2a47d0340a0822715dc272dcce5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 070cd2a47d0340a0822715dc272dcce5, State: Initialized, Role: FOLLOWER
I20260807 10:41:16.054018 9552 consensus_queue.cc:260] T ceec8dd3e38a4b16943a3d59ba187583 P 070cd2a47d0340a0822715dc272dcce5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1cb46cdb0ef41cd8048fd3b1a7303d5" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 35775 } } peers { permanent_uuid: "78e1edf0f5a946eba27c0e8a92b87ec2" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 46803 } } peers { permanent_uuid: "070cd2a47d0340a0822715dc272dcce5" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 33779 } }
I20260807 10:41:16.055729 9399 heartbeater.cc:503] Master 127.20.171.126:43583 was elected leader, sending a full tablet report...
I20260807 10:41:16.056551 9552 ts_tablet_manager.cc:1428] T ceec8dd3e38a4b16943a3d59ba187583 P 070cd2a47d0340a0822715dc272dcce5: Time spent starting tablet: real 0.011s user 0.011s sys 0.001s
I20260807 10:41:16.058326 9553 raft_consensus.cc:348] T ceec8dd3e38a4b16943a3d59ba187583 P 78e1edf0f5a946eba27c0e8a92b87ec2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1cb46cdb0ef41cd8048fd3b1a7303d5" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 35775 } } peers { permanent_uuid: "78e1edf0f5a946eba27c0e8a92b87ec2" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 46803 } } peers { permanent_uuid: "070cd2a47d0340a0822715dc272dcce5" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 33779 } }
I20260807 10:41:16.058320 9554 raft_consensus.cc:348] T ceec8dd3e38a4b16943a3d59ba187583 P f1cb46cdb0ef41cd8048fd3b1a7303d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1cb46cdb0ef41cd8048fd3b1a7303d5" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 35775 } } peers { permanent_uuid: "78e1edf0f5a946eba27c0e8a92b87ec2" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 46803 } } peers { permanent_uuid: "070cd2a47d0340a0822715dc272dcce5" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 33779 } }
I20260807 10:41:16.058754 9553 raft_consensus.cc:374] T ceec8dd3e38a4b16943a3d59ba187583 P 78e1edf0f5a946eba27c0e8a92b87ec2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:41:16.058760 9554 raft_consensus.cc:374] T ceec8dd3e38a4b16943a3d59ba187583 P f1cb46cdb0ef41cd8048fd3b1a7303d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:41:16.058866 9553 raft_consensus.cc:729] T ceec8dd3e38a4b16943a3d59ba187583 P 78e1edf0f5a946eba27c0e8a92b87ec2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 78e1edf0f5a946eba27c0e8a92b87ec2, State: Initialized, Role: FOLLOWER
I20260807 10:41:16.058862 9554 raft_consensus.cc:729] T ceec8dd3e38a4b16943a3d59ba187583 P f1cb46cdb0ef41cd8048fd3b1a7303d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1cb46cdb0ef41cd8048fd3b1a7303d5, State: Initialized, Role: FOLLOWER
I20260807 10:41:16.059461 9554 consensus_queue.cc:260] T ceec8dd3e38a4b16943a3d59ba187583 P f1cb46cdb0ef41cd8048fd3b1a7303d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1cb46cdb0ef41cd8048fd3b1a7303d5" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 35775 } } peers { permanent_uuid: "78e1edf0f5a946eba27c0e8a92b87ec2" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 46803 } } peers { permanent_uuid: "070cd2a47d0340a0822715dc272dcce5" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 33779 } }
I20260807 10:41:16.059497 9553 consensus_queue.cc:260] T ceec8dd3e38a4b16943a3d59ba187583 P 78e1edf0f5a946eba27c0e8a92b87ec2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1cb46cdb0ef41cd8048fd3b1a7303d5" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 35775 } } peers { permanent_uuid: "78e1edf0f5a946eba27c0e8a92b87ec2" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 46803 } } peers { permanent_uuid: "070cd2a47d0340a0822715dc272dcce5" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 33779 } }
I20260807 10:41:16.061084 9533 heartbeater.cc:503] Master 127.20.171.126:43583 was elected leader, sending a full tablet report...
I20260807 10:41:16.061331 9554 ts_tablet_manager.cc:1428] T ceec8dd3e38a4b16943a3d59ba187583 P f1cb46cdb0ef41cd8048fd3b1a7303d5: Time spent starting tablet: real 0.014s user 0.014s sys 0.001s
I20260807 10:41:16.061631 9553 ts_tablet_manager.cc:1428] T ceec8dd3e38a4b16943a3d59ba187583 P 78e1edf0f5a946eba27c0e8a92b87ec2: Time spent starting tablet: real 0.014s user 0.014s sys 0.001s
W20260807 10:41:16.181149 9534 tablet.cc:2369] T ceec8dd3e38a4b16943a3d59ba187583 P 78e1edf0f5a946eba27c0e8a92b87ec2: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 10:41:16.202925 9400 tablet.cc:2369] T ceec8dd3e38a4b16943a3d59ba187583 P 070cd2a47d0340a0822715dc272dcce5: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 10:41:16.231604 9262 tablet.cc:2369] T ceec8dd3e38a4b16943a3d59ba187583 P f1cb46cdb0ef41cd8048fd3b1a7303d5: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 10:41:16.369582 9560 raft_consensus.cc:482] T ceec8dd3e38a4b16943a3d59ba187583 P 78e1edf0f5a946eba27c0e8a92b87ec2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 10:41:16.369897 9560 raft_consensus.cc:504] T ceec8dd3e38a4b16943a3d59ba187583 P 78e1edf0f5a946eba27c0e8a92b87ec2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1cb46cdb0ef41cd8048fd3b1a7303d5" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 35775 } } peers { permanent_uuid: "78e1edf0f5a946eba27c0e8a92b87ec2" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 46803 } } peers { permanent_uuid: "070cd2a47d0340a0822715dc272dcce5" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 33779 } }
I20260807 10:41:16.371515 9560 leader_election.cc:288] T ceec8dd3e38a4b16943a3d59ba187583 P 78e1edf0f5a946eba27c0e8a92b87ec2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1cb46cdb0ef41cd8048fd3b1a7303d5 (127.20.171.65:35775), 070cd2a47d0340a0822715dc272dcce5 (127.20.171.66:33779)
I20260807 10:41:16.377054 9549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:16.372111 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.67:44079 (local address 127.20.171.66:33779)
0807 10:41:16.372325 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0807 10:41:16.372333 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 10:41:16.372355 (+ 22us) server_negotiation.cc:407] Connection header received
0807 10:41:16.372440 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:41:16.372446 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:41:16.372547 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:41:16.372652 (+ 105us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:41:16.373067 (+ 415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:16.373757 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:16.375406 (+ 1649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:16.376137 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:16.376319 (+ 182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:16.376399 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0807 10:41:16.376658 (+ 259us) server_negotiation.cc:299] Negotiation successful
0807 10:41:16.376784 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260807 10:41:16.377071 9535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:16.371765 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.66:33779 (local address 127.20.171.67:44079)
0807 10:41:16.372087 (+ 322us) negotiation.cc:107] Waiting for socket to connect
0807 10:41:16.372111 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0807 10:41:16.372284 (+ 173us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:41:16.372712 (+ 428us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:41:16.372716 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:41:16.372740 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:41:16.372904 (+ 164us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:41:16.372911 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:41:16.373898 (+ 987us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:41:16.373905 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:41:16.375232 (+ 1327us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:41:16.375243 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:41:16.376319 (+ 1076us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:41:16.376325 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:41:16.376494 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:16.376518 (+ 24us) client_negotiation.cc:769] Sending connection context
0807 10:41:16.376618 (+ 100us) client_negotiation.cc:240] Negotiation successful
0807 10:41:16.376754 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":193}
I20260807 10:41:16.377807 9548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:16.372080 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.171.67:48539 (local address 127.20.171.65:35775)
0807 10:41:16.372312 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0807 10:41:16.372319 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:41:16.372847 (+ 528us) server_negotiation.cc:407] Connection header received
0807 10:41:16.373043 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:41:16.373047 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:41:16.373117 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:41:16.373215 (+ 98us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:41:16.373738 (+ 523us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:16.374405 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:16.376037 (+ 1632us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:16.376877 (+ 840us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:16.377041 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:16.377105 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0807 10:41:16.377484 (+ 379us) server_negotiation.cc:299] Negotiation successful
0807 10:41:16.377627 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260807 10:41:16.377828 9561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:16.371898 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.65:35775 (local address 127.20.171.67:48539)
0807 10:41:16.372729 (+ 831us) negotiation.cc:107] Waiting for socket to connect
0807 10:41:16.372748 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 10:41:16.372887 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:41:16.373227 (+ 340us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:41:16.373232 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:41:16.373253 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:41:16.373571 (+ 318us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:41:16.373579 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:41:16.374560 (+ 981us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:41:16.374570 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:41:16.375849 (+ 1279us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:41:16.375860 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:41:16.377048 (+ 1188us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:41:16.377054 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:41:16.377276 (+ 222us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:16.377304 (+ 28us) client_negotiation.cc:769] Sending connection context
0807 10:41:16.377419 (+ 115us) client_negotiation.cc:240] Negotiation successful
0807 10:41:16.377528 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":708,"thread_start_us":526,"threads_started":1}
I20260807 10:41:16.378146 9350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ceec8dd3e38a4b16943a3d59ba187583" candidate_uuid: "78e1edf0f5a946eba27c0e8a92b87ec2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "070cd2a47d0340a0822715dc272dcce5" is_pre_election: true
I20260807 10:41:16.378752 9350 raft_consensus.cc:2454] T ceec8dd3e38a4b16943a3d59ba187583 P 070cd2a47d0340a0822715dc272dcce5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 78e1edf0f5a946eba27c0e8a92b87ec2 in term 0.
I20260807 10:41:16.378980 9213 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ceec8dd3e38a4b16943a3d59ba187583" candidate_uuid: "78e1edf0f5a946eba27c0e8a92b87ec2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1cb46cdb0ef41cd8048fd3b1a7303d5" is_pre_election: true
I20260807 10:41:16.379460 9419 leader_election.cc:302] T ceec8dd3e38a4b16943a3d59ba187583 P 78e1edf0f5a946eba27c0e8a92b87ec2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 070cd2a47d0340a0822715dc272dcce5, 78e1edf0f5a946eba27c0e8a92b87ec2; no voters:
I20260807 10:41:16.379532 9213 raft_consensus.cc:2454] T ceec8dd3e38a4b16943a3d59ba187583 P f1cb46cdb0ef41cd8048fd3b1a7303d5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 78e1edf0f5a946eba27c0e8a92b87ec2 in term 0.
I20260807 10:41:16.379880 9560 raft_consensus.cc:2781] T ceec8dd3e38a4b16943a3d59ba187583 P 78e1edf0f5a946eba27c0e8a92b87ec2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 10:41:16.380038 9560 raft_consensus.cc:482] T ceec8dd3e38a4b16943a3d59ba187583 P 78e1edf0f5a946eba27c0e8a92b87ec2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 10:41:16.380180 9560 raft_consensus.cc:3037] T ceec8dd3e38a4b16943a3d59ba187583 P 78e1edf0f5a946eba27c0e8a92b87ec2 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:41:16.382468 9560 raft_consensus.cc:504] T ceec8dd3e38a4b16943a3d59ba187583 P 78e1edf0f5a946eba27c0e8a92b87ec2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1cb46cdb0ef41cd8048fd3b1a7303d5" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 35775 } } peers { permanent_uuid: "78e1edf0f5a946eba27c0e8a92b87ec2" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 46803 } } peers { permanent_uuid: "070cd2a47d0340a0822715dc272dcce5" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 33779 } }
I20260807 10:41:16.383117 9560 leader_election.cc:288] T ceec8dd3e38a4b16943a3d59ba187583 P 78e1edf0f5a946eba27c0e8a92b87ec2 [CANDIDATE]: Term 1 election: Requested vote from peers f1cb46cdb0ef41cd8048fd3b1a7303d5 (127.20.171.65:35775), 070cd2a47d0340a0822715dc272dcce5 (127.20.171.66:33779)
I20260807 10:41:16.383514 9213 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ceec8dd3e38a4b16943a3d59ba187583" candidate_uuid: "78e1edf0f5a946eba27c0e8a92b87ec2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1cb46cdb0ef41cd8048fd3b1a7303d5"
I20260807 10:41:16.383605 9350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ceec8dd3e38a4b16943a3d59ba187583" candidate_uuid: "78e1edf0f5a946eba27c0e8a92b87ec2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "070cd2a47d0340a0822715dc272dcce5"
I20260807 10:41:16.383726 9213 raft_consensus.cc:3037] T ceec8dd3e38a4b16943a3d59ba187583 P f1cb46cdb0ef41cd8048fd3b1a7303d5 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:41:16.383855 9350 raft_consensus.cc:3037] T ceec8dd3e38a4b16943a3d59ba187583 P 070cd2a47d0340a0822715dc272dcce5 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:41:16.386112 9350 raft_consensus.cc:2454] T ceec8dd3e38a4b16943a3d59ba187583 P 070cd2a47d0340a0822715dc272dcce5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 78e1edf0f5a946eba27c0e8a92b87ec2 in term 1.
I20260807 10:41:16.386274 9213 raft_consensus.cc:2454] T ceec8dd3e38a4b16943a3d59ba187583 P f1cb46cdb0ef41cd8048fd3b1a7303d5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 78e1edf0f5a946eba27c0e8a92b87ec2 in term 1.
I20260807 10:41:16.386518 9419 leader_election.cc:302] T ceec8dd3e38a4b16943a3d59ba187583 P 78e1edf0f5a946eba27c0e8a92b87ec2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 070cd2a47d0340a0822715dc272dcce5, 78e1edf0f5a946eba27c0e8a92b87ec2; no voters:
I20260807 10:41:16.386831 9560 raft_consensus.cc:2781] T ceec8dd3e38a4b16943a3d59ba187583 P 78e1edf0f5a946eba27c0e8a92b87ec2 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:41:16.387292 9560 raft_consensus.cc:686] T ceec8dd3e38a4b16943a3d59ba187583 P 78e1edf0f5a946eba27c0e8a92b87ec2 [term 1 LEADER]: Becoming Leader. State: Replica: 78e1edf0f5a946eba27c0e8a92b87ec2, State: Running, Role: LEADER
I20260807 10:41:16.388027 9560 consensus_queue.cc:237] T ceec8dd3e38a4b16943a3d59ba187583 P 78e1edf0f5a946eba27c0e8a92b87ec2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1cb46cdb0ef41cd8048fd3b1a7303d5" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 35775 } } peers { permanent_uuid: "78e1edf0f5a946eba27c0e8a92b87ec2" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 46803 } } peers { permanent_uuid: "070cd2a47d0340a0822715dc272dcce5" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 33779 } }
I20260807 10:41:16.392505 9066 catalog_manager.cc:5495] T ceec8dd3e38a4b16943a3d59ba187583 P 78e1edf0f5a946eba27c0e8a92b87ec2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 78e1edf0f5a946eba27c0e8a92b87ec2 (127.20.171.67). New cstate: current_term: 1 leader_uuid: "78e1edf0f5a946eba27c0e8a92b87ec2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1cb46cdb0ef41cd8048fd3b1a7303d5" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 35775 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "78e1edf0f5a946eba27c0e8a92b87ec2" member_type: VOTER last_known_addr { host: "127.20.171.67" port: 46803 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "070cd2a47d0340a0822715dc272dcce5" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 33779 } health_report { overall_health: UNKNOWN } } }
I20260807 10:41:16.470681 9551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:16.464908 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38272 (local address 127.20.171.67:46803)
0807 10:41:16.465127 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0807 10:41:16.465133 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:41:16.465153 (+ 20us) server_negotiation.cc:407] Connection header received
0807 10:41:16.465418 (+ 265us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:41:16.465422 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:41:16.465502 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:41:16.465661 (+ 159us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 10:41:16.466046 (+ 385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:16.467012 (+ 966us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:16.468558 (+ 1546us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:16.468970 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:16.469109 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:16.469624 (+ 515us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 10:41:16.470097 (+ 473us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 10:41:16.470261 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0807 10:41:16.470322 (+ 61us) server_negotiation.cc:299] Negotiation successful
0807 10:41:16.470412 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260807 10:41:16.478490 9350 raft_consensus.cc:1261] T ceec8dd3e38a4b16943a3d59ba187583 P 070cd2a47d0340a0822715dc272dcce5 [term 1 FOLLOWER]: Refusing update from remote peer 78e1edf0f5a946eba27c0e8a92b87ec2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 10:41:16.478509 9213 raft_consensus.cc:1261] T ceec8dd3e38a4b16943a3d59ba187583 P f1cb46cdb0ef41cd8048fd3b1a7303d5 [term 1 FOLLOWER]: Refusing update from remote peer 78e1edf0f5a946eba27c0e8a92b87ec2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 10:41:16.479471 9562 consensus_queue.cc:1035] T ceec8dd3e38a4b16943a3d59ba187583 P 78e1edf0f5a946eba27c0e8a92b87ec2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1cb46cdb0ef41cd8048fd3b1a7303d5" member_type: VOTER last_known_addr { host: "127.20.171.65" port: 35775 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 10:41:16.479818 9560 consensus_queue.cc:1035] T ceec8dd3e38a4b16943a3d59ba187583 P 78e1edf0f5a946eba27c0e8a92b87ec2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "070cd2a47d0340a0822715dc272dcce5" member_type: VOTER last_known_addr { host: "127.20.171.66" port: 33779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 10:41:16.493947 9566 mvcc.cc:205] Tried to move back new op lower bound from 7315862636446773248 to 7315862636089397248. Current Snapshot: MvccSnapshot[applied={T|T < 7315862636446773248}]
I20260807 10:41:16.496650 9565 mvcc.cc:205] Tried to move back new op lower bound from 7315862636446773248 to 7315862636089397248. Current Snapshot: MvccSnapshot[applied={T|T < 7315862636446773248}]
I20260807 10:41:16.508311 9065 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37360:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 10:41:16.508581 9065 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37360:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 10:41:16.512137 9065 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 456aa1da9fb54452b8b2e394388d7905: Sending DeleteTablet for 3 replicas of tablet ceec8dd3e38a4b16943a3d59ba187583
I20260807 10:41:16.513370 9192 tablet_service.cc:1514] Processing DeleteTablet for tablet ceec8dd3e38a4b16943a3d59ba187583 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:41:16 UTC) from {username='slave'} at 127.0.0.1:57994
I20260807 10:41:16.513378 9464 tablet_service.cc:1514] Processing DeleteTablet for tablet ceec8dd3e38a4b16943a3d59ba187583 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:41:16 UTC) from {username='slave'} at 127.0.0.1:38260
I20260807 10:41:16.514029 9329 tablet_service.cc:1514] Processing DeleteTablet for tablet ceec8dd3e38a4b16943a3d59ba187583 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:41:16 UTC) from {username='slave'} at 127.0.0.1:38110
I20260807 10:41:16.515394 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 9129
I20260807 10:41:16.525885 9576 tablet_replica.cc:330] T ceec8dd3e38a4b16943a3d59ba187583 P 070cd2a47d0340a0822715dc272dcce5: stopping tablet replica
I20260807 10:41:16.526482 9576 raft_consensus.cc:2229] T ceec8dd3e38a4b16943a3d59ba187583 P 070cd2a47d0340a0822715dc272dcce5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 10:41:16.527212 9576 raft_consensus.cc:2258] T ceec8dd3e38a4b16943a3d59ba187583 P 070cd2a47d0340a0822715dc272dcce5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:41:16.528870 9575 tablet_replica.cc:330] T ceec8dd3e38a4b16943a3d59ba187583 P 78e1edf0f5a946eba27c0e8a92b87ec2: stopping tablet replica
I20260807 10:41:16.529367 9575 raft_consensus.cc:2229] T ceec8dd3e38a4b16943a3d59ba187583 P 78e1edf0f5a946eba27c0e8a92b87ec2 [term 1 LEADER]: Raft consensus shutting down.
I20260807 10:41:16.530119 9575 raft_consensus.cc:2258] T ceec8dd3e38a4b16943a3d59ba187583 P 78e1edf0f5a946eba27c0e8a92b87ec2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:41:16.532765 9575 ts_tablet_manager.cc:1905] T ceec8dd3e38a4b16943a3d59ba187583 P 78e1edf0f5a946eba27c0e8a92b87ec2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 10:41:16.532917 9574 tablet_replica.cc:330] T ceec8dd3e38a4b16943a3d59ba187583 P f1cb46cdb0ef41cd8048fd3b1a7303d5: stopping tablet replica
I20260807 10:41:16.533308 9576 ts_tablet_manager.cc:1905] T ceec8dd3e38a4b16943a3d59ba187583 P 070cd2a47d0340a0822715dc272dcce5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 10:41:16.533846 9574 raft_consensus.cc:2229] T ceec8dd3e38a4b16943a3d59ba187583 P f1cb46cdb0ef41cd8048fd3b1a7303d5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 10:41:16.535110 9574 raft_consensus.cc:2258] T ceec8dd3e38a4b16943a3d59ba187583 P f1cb46cdb0ef41cd8048fd3b1a7303d5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:41:16.537362 9548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:16.519691 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57998 (local address 127.20.171.65:35775)
0807 10:41:16.520135 (+ 444us) server_negotiation.cc:206] Beginning negotiation
0807 10:41:16.520145 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 10:41:16.528119 (+ 7974us) server_negotiation.cc:407] Connection header received
0807 10:41:16.528371 (+ 252us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:41:16.528378 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:41:16.528503 (+ 125us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:41:16.528626 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:41:16.529419 (+ 793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:16.530662 (+ 1243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:16.533144 (+ 2482us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:16.533743 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:16.533853 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:16.535658 (+ 1805us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:41:16.535670 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:41:16.535686 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:41:16.536451 (+ 765us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:41:16.536514 (+ 63us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:41:16.536539 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:41:16.536622 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0807 10:41:16.536892 (+ 270us) server_negotiation.cc:299] Negotiation successful
0807 10:41:16.537004 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":270}
I20260807 10:41:16.538653 9255 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:41:16.540504 9576 ts_tablet_manager.cc:1918] T ceec8dd3e38a4b16943a3d59ba187583 P 070cd2a47d0340a0822715dc272dcce5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 10:41:16.540722 9576 log.cc:1196] T ceec8dd3e38a4b16943a3d59ba187583 P 070cd2a47d0340a0822715dc272dcce5: Deleting WAL directory at /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786098956060137-21165-0/minicluster-data/ts-1/wal/wals/ceec8dd3e38a4b16943a3d59ba187583
I20260807 10:41:16.541328 9576 ts_tablet_manager.cc:1939] T ceec8dd3e38a4b16943a3d59ba187583 P 070cd2a47d0340a0822715dc272dcce5: Deleting consensus metadata
I20260807 10:41:16.542443 9575 ts_tablet_manager.cc:1918] T ceec8dd3e38a4b16943a3d59ba187583 P 78e1edf0f5a946eba27c0e8a92b87ec2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 10:41:16.543273 9575 log.cc:1196] T ceec8dd3e38a4b16943a3d59ba187583 P 78e1edf0f5a946eba27c0e8a92b87ec2: Deleting WAL directory at /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786098956060137-21165-0/minicluster-data/ts-2/wal/wals/ceec8dd3e38a4b16943a3d59ba187583
I20260807 10:41:16.543277 9052 catalog_manager.cc:4841] TS 070cd2a47d0340a0822715dc272dcce5 (127.20.171.66:33779): tablet ceec8dd3e38a4b16943a3d59ba187583 (table test-table [id=f57d2018637549e0ae91972b27bb3a29]) successfully deleted
I20260807 10:41:16.543963 9575 ts_tablet_manager.cc:1939] T ceec8dd3e38a4b16943a3d59ba187583 P 78e1edf0f5a946eba27c0e8a92b87ec2: Deleting consensus metadata
I20260807 10:41:16.546384 9053 catalog_manager.cc:4841] TS 78e1edf0f5a946eba27c0e8a92b87ec2 (127.20.171.67:46803): tablet ceec8dd3e38a4b16943a3d59ba187583 (table test-table [id=f57d2018637549e0ae91972b27bb3a29]) successfully deleted
I20260807 10:41:16.635205 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 9129
I20260807 10:41:16.657150 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 9265
W20260807 10:41:16.657091 9049 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.20.171.65:35775 (error 108)
I20260807 10:41:16.660429 9580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:16.659478 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.65:35775 (local address 127.0.0.1:58010)
0807 10:41:16.660037 (+ 559us) negotiation.cc:107] Waiting for socket to connect
0807 10:41:16.660153 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.65:35775: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":434,"thread_start_us":313,"threads_started":1}
W20260807 10:41:16.660722 9049 catalog_manager.cc:4584] TS f1cb46cdb0ef41cd8048fd3b1a7303d5 (127.20.171.65:35775): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet ceec8dd3e38a4b16943a3d59ba187583: Network error: Client connection negotiation failed: client connection to 127.20.171.65:35775: connect: Connection refused (error 111)
I20260807 10:41:16.666818 9549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:16.658887 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38122 (local address 127.20.171.66:33779)
0807 10:41:16.659085 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0807 10:41:16.659092 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:41:16.659438 (+ 346us) server_negotiation.cc:407] Connection header received
0807 10:41:16.659711 (+ 273us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:41:16.659719 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:41:16.659833 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:41:16.659958 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:41:16.660676 (+ 718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:16.661779 (+ 1103us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:16.663065 (+ 1286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:16.663736 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:16.663887 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:16.665103 (+ 1216us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:41:16.665139 (+ 36us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:41:16.665159 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:41:16.665973 (+ 814us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:41:16.666035 (+ 62us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:41:16.666061 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:41:16.666203 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0807 10:41:16.666295 (+ 92us) server_negotiation.cc:299] Negotiation successful
0807 10:41:16.666442 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260807 10:41:16.667583 9393 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:41:16.714658 9580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:16.714040 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.65:35775 (local address 127.0.0.1:58020)
0807 10:41:16.714321 (+ 281us) negotiation.cc:107] Waiting for socket to connect
0807 10:41:16.714455 (+ 134us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.65:35775: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":101}
I20260807 10:41:16.715965 9580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:16.715516 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.65:35775 (local address 127.0.0.1:58026)
0807 10:41:16.715702 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0807 10:41:16.715797 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.65:35775: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
I20260807 10:41:16.758930 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 9265
I20260807 10:41:16.776734 9580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:16.776118 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.65:35775 (local address 127.0.0.1:58032)
0807 10:41:16.776410 (+ 292us) negotiation.cc:107] Waiting for socket to connect
0807 10:41:16.776532 (+ 122us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.65:35775: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":85}
I20260807 10:41:16.777932 9580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:16.777470 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.65:35775 (local address 127.0.0.1:58044)
0807 10:41:16.777654 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0807 10:41:16.777755 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.65:35775: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260807 10:41:16.780467 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 9402
I20260807 10:41:16.788810 9551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:16.781194 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38276 (local address 127.20.171.67:46803)
0807 10:41:16.781714 (+ 520us) server_negotiation.cc:206] Beginning negotiation
0807 10:41:16.781721 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:41:16.781740 (+ 19us) server_negotiation.cc:407] Connection header received
0807 10:41:16.781814 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:41:16.781820 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:41:16.781921 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:41:16.782044 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:41:16.782457 (+ 413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:16.783661 (+ 1204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:16.785140 (+ 1479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:16.785844 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:16.785999 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:16.787052 (+ 1053us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:41:16.787065 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:41:16.787084 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:41:16.787925 (+ 841us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:41:16.788001 (+ 76us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:41:16.788033 (+ 32us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:41:16.788139 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0807 10:41:16.788307 (+ 168us) server_negotiation.cc:299] Negotiation successful
0807 10:41:16.788442 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":390}
I20260807 10:41:16.789644 9527 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:41:16.858769 9580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:16.858110 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.65:35775 (local address 127.0.0.1:58048)
0807 10:41:16.858406 (+ 296us) negotiation.cc:107] Waiting for socket to connect
0807 10:41:16.858533 (+ 127us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.65:35775: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113}
I20260807 10:41:16.859949 9580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:16.859473 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.65:35775 (local address 127.0.0.1:58052)
0807 10:41:16.859684 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0807 10:41:16.859803 (+ 119us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.65:35775: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106}
I20260807 10:41:16.914176 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 9402
I20260807 10:41:16.937412 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 9034
I20260807 10:41:16.938514 9098 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:41:17.050539 9580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:17.049581 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.65:35775 (local address 127.0.0.1:58058)
0807 10:41:17.050096 (+ 515us) negotiation.cc:107] Waiting for socket to connect
0807 10:41:17.050304 (+ 208us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.65:35775: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":72}
I20260807 10:41:17.050745 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 9034
2026-08-07T10:41:17Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (3178 ms)
[----------] 6 tests from EncryptionPolicyTest (23374 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786098956060137-21165-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 10:41:17 dist-test-slave-0b58 krb5kdc[9586](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 10:41:17 dist-test-slave-0b58 krb5kdc[9586](info): set up 2 sockets
Aug 07 10:41:17 dist-test-slave-0b58 krb5kdc[9586](info): commencing operation
krb5kdc: starting...
W20260807 10:41:18.223419 21165 mini_kdc.cc:121] Time spent starting KDC: real 1.125s user 0.001s sys 0.054s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786098956060137-21165-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786098956060137-21165-0/krb5kdc/test-user.keytab.
Aug 07 10:41:18 dist-test-slave-0b58 krb5kdc[9586](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099278, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T10:41:18Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T10:41:18Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786098956060137-21165-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786098956060137-21165-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 10:41:18.588065 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786098956060137-21165-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786098956060137-21165-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786098956060137-21165-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42475
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786098956060137-21165-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:45213
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42475
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786098956060137-21165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786098956060137-21165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786098956060137-21165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:41:18.939548 9599 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:41:18.939893 9599 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:41:18.940070 9599 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:41:18.947535 9599 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 10:41:18.947714 9599 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:41:18.947827 9599 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:41:18.947940 9599 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 10:41:18.948026 9599 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 10:41:18.958570 9599 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:45213
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786098956060137-21165-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786098956060137-21165-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42475
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786098956060137-21165-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42475
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786098956060137-21165-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:41:18.960223 9599 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:41:18.961683 9599 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:41:18.975000 9607 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:41:18.975029 9605 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:41:18.975077 9604 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:41:18.975845 9599 server_base.cc:1034] running on GCE node
I20260807 10:41:18.976751 9599 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:41:18.978173 9599 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:41:18.979393 9599 hybrid_clock.cc:648] HybridClock initialized: now 1786099278979337 us; error 37 us; skew 500 ppm
I20260807 10:41:18.979714 9599 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:41:18 dist-test-slave-0b58 krb5kdc[9586](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099278, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:41:18.983022 9599 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 10:41:18.984678 9599 webserver.cc:460] Webserver started at http://127.0.0.1:45159/ using document root <none> and password file <none>
I20260807 10:41:18.985381 9599 fs_manager.cc:359] Metadata directory not provided
I20260807 10:41:18.985515 9599 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:41:18.985841 9599 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:41:18.989269 9599 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786098956060137-21165-0/minicluster-data/master-0/data/instance:
uuid: "6940b868dec64feb8c60b6b112770691"
format_stamp: "Formatted at 2026-08-07 10:41:18 on dist-test-slave-0b58"
server_key: "8af7c3af680c110ecfd4631d5d02e6e7"
server_key_iv: "e68059dc98b112b528bbc223ddd3f0ac"
server_key_version: "encryptionkey@0"
I20260807 10:41:18.990113 9599 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786098956060137-21165-0/minicluster-data/master-0/wal/instance:
uuid: "6940b868dec64feb8c60b6b112770691"
format_stamp: "Formatted at 2026-08-07 10:41:18 on dist-test-slave-0b58"
server_key: "8af7c3af680c110ecfd4631d5d02e6e7"
server_key_iv: "e68059dc98b112b528bbc223ddd3f0ac"
server_key_version: "encryptionkey@0"
I20260807 10:41:18.995618 9599 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260807 10:41:18.999325 9615 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:41:19.000770 9599 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 10:41:19.000953 9599 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786098956060137-21165-0/minicluster-data/master-0/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786098956060137-21165-0/minicluster-data/master-0/wal
uuid: "6940b868dec64feb8c60b6b112770691"
format_stamp: "Formatted at 2026-08-07 10:41:18 on dist-test-slave-0b58"
server_key: "8af7c3af680c110ecfd4631d5d02e6e7"
server_key_iv: "e68059dc98b112b528bbc223ddd3f0ac"
server_key_version: "encryptionkey@0"
I20260807 10:41:19.001161 9599 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786098956060137-21165-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786098956060137-21165-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786098956060137-21165-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:41:19.013140 9599 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:41:19.017103 9599 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:41:19.017401 9599 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:41:19.036798 9599 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42475
I20260807 10:41:19.036849 9668 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42475 every 8 connection(s)
I20260807 10:41:19.038275 9599 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
I20260807 10:41:19.042002 9669 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:41:19.043726 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 9599
I20260807 10:41:19.043973 21165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786098956060137-21165-0/minicluster-data/master-0/wal/instance
I20260807 10:41:19.044904 21165 external_mini_cluster.cc:1428] Setting key a0dde98542263b24e5fe49377728cccd
I20260807 10:41:19.056999 9669 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6940b868dec64feb8c60b6b112770691: Bootstrap starting.
Aug 07 10:41:19 dist-test-slave-0b58 krb5kdc[9586](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099278, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260807 10:41:19.060994 9669 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6940b868dec64feb8c60b6b112770691: Neither blocks nor log segments found. Creating new log.
I20260807 10:41:19.062055 9669 log.cc:824] T 00000000000000000000000000000000 P 6940b868dec64feb8c60b6b112770691: Log is configured to *not* fsync() on all Append() calls
I20260807 10:41:19.065363 9669 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6940b868dec64feb8c60b6b112770691: No bootstrap required, opened a new log
I20260807 10:41:19.069779 9672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:19.046991 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57913 (local address 127.0.0.1:42475)
0807 10:41:19.047876 (+ 885us) server_negotiation.cc:206] Beginning negotiation
0807 10:41:19.047895 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0807 10:41:19.047938 (+ 43us) server_negotiation.cc:407] Connection header received
0807 10:41:19.049599 (+ 1661us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:41:19.049626 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:41:19.050036 (+ 410us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:41:19.050351 (+ 315us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:41:19.052231 (+ 1880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:19.053927 (+ 1696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:19.055788 (+ 1861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:19.056558 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:19.056693 (+ 135us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:19.061756 (+ 5063us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:41:19.061767 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:41:19.061781 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:41:19.061817 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:41:19.065446 (+ 3629us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:41:19.066374 (+ 928us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:41:19.066381 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:41:19.066387 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:41:19.066580 (+ 193us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:41:19.067090 (+ 510us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:41:19.067094 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:41:19.067096 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:41:19.067592 (+ 496us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:41:19.067967 (+ 375us) server_negotiation.cc:1035] Waiting for connection context
0807 10:41:19.068469 (+ 502us) server_negotiation.cc:299] Negotiation successful
0807 10:41:19.068794 (+ 325us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":662,"thread_start_us":426,"threads_started":1}
I20260807 10:41:19.073764 21165 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 10:41:19.073602 9669 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6940b868dec64feb8c60b6b112770691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6940b868dec64feb8c60b6b112770691" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42475 } }
I20260807 10:41:19.074059 9669 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6940b868dec64feb8c60b6b112770691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:41:19.074158 9669 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6940b868dec64feb8c60b6b112770691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6940b868dec64feb8c60b6b112770691, State: Initialized, Role: FOLLOWER
I20260807 10:41:19.074755 9669 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6940b868dec64feb8c60b6b112770691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6940b868dec64feb8c60b6b112770691" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42475 } }
I20260807 10:41:19.075037 9669 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6940b868dec64feb8c60b6b112770691 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 10:41:19.075171 9669 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6940b868dec64feb8c60b6b112770691 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 10:41:19.075323 9669 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6940b868dec64feb8c60b6b112770691 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:41:19.078794 9669 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6940b868dec64feb8c60b6b112770691 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6940b868dec64feb8c60b6b112770691" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42475 } }
I20260807 10:41:19.079391 9669 leader_election.cc:302] T 00000000000000000000000000000000 P 6940b868dec64feb8c60b6b112770691 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6940b868dec64feb8c60b6b112770691; no voters:
I20260807 10:41:19.080090 9669 leader_election.cc:288] T 00000000000000000000000000000000 P 6940b868dec64feb8c60b6b112770691 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 10:41:19.080222 9678 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6940b868dec64feb8c60b6b112770691 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:41:19.085161 9678 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6940b868dec64feb8c60b6b112770691 [term 1 LEADER]: Becoming Leader. State: Replica: 6940b868dec64feb8c60b6b112770691, State: Running, Role: LEADER
I20260807 10:41:19.085777 9678 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6940b868dec64feb8c60b6b112770691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6940b868dec64feb8c60b6b112770691" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42475 } }
I20260807 10:41:19.086536 9669 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6940b868dec64feb8c60b6b112770691 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 10:41:19.089568 9680 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6940b868dec64feb8c60b6b112770691 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6940b868dec64feb8c60b6b112770691" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6940b868dec64feb8c60b6b112770691" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42475 } } }
I20260807 10:41:19.090050 9680 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6940b868dec64feb8c60b6b112770691 [sys.catalog]: This master's current role is: LEADER
I20260807 10:41:19.090538 9681 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6940b868dec64feb8c60b6b112770691 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6940b868dec64feb8c60b6b112770691. Latest consensus state: current_term: 1 leader_uuid: "6940b868dec64feb8c60b6b112770691" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6940b868dec64feb8c60b6b112770691" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42475 } } }
I20260807 10:41:19.090845 9681 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6940b868dec64feb8c60b6b112770691 [sys.catalog]: This master's current role is: LEADER
I20260807 10:41:19.099478 9672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:19.079786 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54459 (local address 127.0.0.1:42475)
0807 10:41:19.079993 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0807 10:41:19.080001 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 10:41:19.080612 (+ 611us) server_negotiation.cc:407] Connection header received
0807 10:41:19.080807 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:41:19.080812 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:41:19.080876 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:41:19.080984 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:41:19.082398 (+ 1414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:19.083258 (+ 860us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:19.084705 (+ 1447us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:19.085437 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:19.085531 (+ 94us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:19.088748 (+ 3217us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:41:19.088758 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:41:19.088765 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:41:19.088815 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:41:19.094138 (+ 5323us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:41:19.095622 (+ 1484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:41:19.095632 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:41:19.095638 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:41:19.095875 (+ 237us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:41:19.096756 (+ 881us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:41:19.096764 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:41:19.096770 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:41:19.097304 (+ 534us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:41:19.097656 (+ 352us) server_negotiation.cc:1035] Waiting for connection context
0807 10:41:19.098673 (+ 1017us) server_negotiation.cc:299] Negotiation successful
0807 10:41:19.098951 (+ 278us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260807 10:41:19.102872 9686 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 10:41:19.108202 9686 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 10:41:19.117110 9686 catalog_manager.cc:1347] Generated new cluster ID: b0465d3196d640f5bd671d91e70a8494
I20260807 10:41:19.117233 9686 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 10:41:19.138168 9686 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 10:41:19.139704 9686 catalog_manager.cc:1504] Loading token signing keys...
I20260807 10:41:19.146863 9686 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6940b868dec64feb8c60b6b112770691: Generated new TSK 0
I20260807 10:41:19.147977 9686 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 10:41:19.163487 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 9599
I20260807 10:41:19.165071 9664 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:41:19.259572 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 9599
W20260807 10:41:19.278609 9584 connection.cc:535] client connection to 127.0.0.1:42475 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:42475): Connection reset by peer (error 104)
2026-08-07T10:41:19Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (2199 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786098956060137-21165-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 10:41:19 dist-test-slave-0b58 krb5kdc[9701](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 10:41:19 dist-test-slave-0b58 krb5kdc[9701](info): set up 2 sockets
Aug 07 10:41:19 dist-test-slave-0b58 krb5kdc[9701](info): commencing operation
krb5kdc: starting...
W20260807 10:41:20.422705 21165 mini_kdc.cc:121] Time spent starting KDC: real 1.125s user 0.005s sys 0.049s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786098956060137-21165-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786098956060137-21165-0/krb5kdc/test-user.keytab.
Aug 07 10:41:20 dist-test-slave-0b58 krb5kdc[9701](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099280, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T10:41:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T10:41:20Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786098956060137-21165-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786098956060137-21165-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 10:41:20.767575 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786098956060137-21165-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786098956060137-21165-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786098956060137-21165-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35441
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786098956060137-21165-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40783
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:35441
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786098956060137-21165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786098956060137-21165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786098956060137-21165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:41:21.134667 9715 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:41:21.134958 9715 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:41:21.135138 9715 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:41:21.142463 9715 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 10:41:21.142616 9715 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:41:21.142711 9715 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:41:21.142829 9715 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 10:41:21.142913 9715 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 10:41:21.152951 9715 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40783
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786098956060137-21165-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786098956060137-21165-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:35441
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786098956060137-21165-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35441
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786098956060137-21165-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:41:21.154316 9715 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:41:21.155663 9715 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:41:21.168349 9723 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:41:21.168435 9720 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:41:21.168434 9721 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:41:21.169193 9715 server_base.cc:1034] running on GCE node
I20260807 10:41:21.169955 9715 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:41:21.171309 9715 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:41:21.172511 9715 hybrid_clock.cc:648] HybridClock initialized: now 1786099281172470 us; error 29 us; skew 500 ppm
I20260807 10:41:21.172863 9715 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:41:21 dist-test-slave-0b58 krb5kdc[9701](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099281, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:41:21.175966 9715 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 10:41:21.177646 9715 webserver.cc:460] Webserver started at http://127.0.0.1:40391/ using document root <none> and password file <none>
I20260807 10:41:21.178318 9715 fs_manager.cc:359] Metadata directory not provided
I20260807 10:41:21.178467 9715 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:41:21.178778 9715 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:41:21.181895 9715 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786098956060137-21165-0/minicluster-data/master-0/data/instance:
uuid: "59bd4ffce3f447a5b10b3270c3c99449"
format_stamp: "Formatted at 2026-08-07 10:41:21 on dist-test-slave-0b58"
server_key: "839a96021d773b80d72bb3bc009afd90"
server_key_iv: "55af0e12821bc731d40d4d52789bf11c"
server_key_version: "encryptionkey@0"
I20260807 10:41:21.182705 9715 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786098956060137-21165-0/minicluster-data/master-0/wal/instance:
uuid: "59bd4ffce3f447a5b10b3270c3c99449"
format_stamp: "Formatted at 2026-08-07 10:41:21 on dist-test-slave-0b58"
server_key: "839a96021d773b80d72bb3bc009afd90"
server_key_iv: "55af0e12821bc731d40d4d52789bf11c"
server_key_version: "encryptionkey@0"
I20260807 10:41:21.187973 9715 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260807 10:41:21.191447 9730 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:41:21.192843 9715 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 10:41:21.193018 9715 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786098956060137-21165-0/minicluster-data/master-0/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786098956060137-21165-0/minicluster-data/master-0/wal
uuid: "59bd4ffce3f447a5b10b3270c3c99449"
format_stamp: "Formatted at 2026-08-07 10:41:21 on dist-test-slave-0b58"
server_key: "839a96021d773b80d72bb3bc009afd90"
server_key_iv: "55af0e12821bc731d40d4d52789bf11c"
server_key_version: "encryptionkey@0"
I20260807 10:41:21.193202 9715 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786098956060137-21165-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786098956060137-21165-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786098956060137-21165-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:41:21.215248 9715 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:41:21.219841 9715 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:41:21.220129 9715 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:41:21.239631 9715 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:35441
I20260807 10:41:21.239665 9784 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:35441 every 8 connection(s)
I20260807 10:41:21.241171 9715 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
I20260807 10:41:21.243062 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 9715
I20260807 10:41:21.243203 21165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786098956060137-21165-0/minicluster-data/master-0/wal/instance
I20260807 10:41:21.243738 21165 external_mini_cluster.cc:1428] Setting key a9b0bc28375d11aafd0199962ab0d7ba
I20260807 10:41:21.245901 9785 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:41:21.256829 9788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:21.245609 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45865 (local address 127.0.0.1:35441)
0807 10:41:21.246483 (+ 874us) server_negotiation.cc:206] Beginning negotiation
0807 10:41:21.246494 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 10:41:21.246535 (+ 41us) server_negotiation.cc:407] Connection header received
0807 10:41:21.248210 (+ 1675us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:41:21.248234 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:41:21.248661 (+ 427us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:41:21.249056 (+ 395us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:41:21.249584 (+ 528us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:21.250901 (+ 1317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:21.252317 (+ 1416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:21.252974 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:21.253167 (+ 193us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:21.254544 (+ 1377us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:41:21.254554 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:41:21.254566 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:41:21.255103 (+ 537us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:41:21.255178 (+ 75us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:41:21.255205 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:41:21.255381 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0807 10:41:21.255653 (+ 272us) server_negotiation.cc:299] Negotiation successful
0807 10:41:21.255819 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":662,"thread_start_us":412,"threads_started":1}
I20260807 10:41:21.258337 9785 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 59bd4ffce3f447a5b10b3270c3c99449: Bootstrap starting.
I20260807 10:41:21.260684 21165 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 10:41:21.262100 9785 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 59bd4ffce3f447a5b10b3270c3c99449: Neither blocks nor log segments found. Creating new log.
I20260807 10:41:21.263224 9785 log.cc:824] T 00000000000000000000000000000000 P 59bd4ffce3f447a5b10b3270c3c99449: Log is configured to *not* fsync() on all Append() calls
I20260807 10:41:21.266906 9785 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 59bd4ffce3f447a5b10b3270c3c99449: No bootstrap required, opened a new log
I20260807 10:41:21.272527 9788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:21.265321 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55669 (local address 127.0.0.1:35441)
0807 10:41:21.265516 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0807 10:41:21.265522 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:41:21.265983 (+ 461us) server_negotiation.cc:407] Connection header received
0807 10:41:21.266148 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:41:21.266155 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:41:21.266245 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:41:21.266364 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:41:21.266835 (+ 471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:21.268141 (+ 1306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:21.269497 (+ 1356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:21.270359 (+ 862us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:21.270510 (+ 151us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:21.271655 (+ 1145us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:41:21.271667 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:41:21.271673 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:41:21.271695 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:41:21.271750 (+ 55us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:41:21.271774 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:41:21.271912 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0807 10:41:21.272073 (+ 161us) server_negotiation.cc:299] Negotiation successful
0807 10:41:21.272131 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260807 10:41:21.277089 9785 raft_consensus.cc:348] T 00000000000000000000000000000000 P 59bd4ffce3f447a5b10b3270c3c99449 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59bd4ffce3f447a5b10b3270c3c99449" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35441 } }
I20260807 10:41:21.277619 9785 raft_consensus.cc:374] T 00000000000000000000000000000000 P 59bd4ffce3f447a5b10b3270c3c99449 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:41:21.277765 9785 raft_consensus.cc:729] T 00000000000000000000000000000000 P 59bd4ffce3f447a5b10b3270c3c99449 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59bd4ffce3f447a5b10b3270c3c99449, State: Initialized, Role: FOLLOWER
I20260807 10:41:21.278404 9785 consensus_queue.cc:260] T 00000000000000000000000000000000 P 59bd4ffce3f447a5b10b3270c3c99449 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59bd4ffce3f447a5b10b3270c3c99449" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35441 } }
I20260807 10:41:21.278632 9785 raft_consensus.cc:388] T 00000000000000000000000000000000 P 59bd4ffce3f447a5b10b3270c3c99449 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 10:41:21.278752 9785 raft_consensus.cc:482] T 00000000000000000000000000000000 P 59bd4ffce3f447a5b10b3270c3c99449 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 10:41:21.278910 9785 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 59bd4ffce3f447a5b10b3270c3c99449 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:41:21.281402 9785 raft_consensus.cc:504] T 00000000000000000000000000000000 P 59bd4ffce3f447a5b10b3270c3c99449 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59bd4ffce3f447a5b10b3270c3c99449" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35441 } }
I20260807 10:41:21.281888 9785 leader_election.cc:302] T 00000000000000000000000000000000 P 59bd4ffce3f447a5b10b3270c3c99449 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 59bd4ffce3f447a5b10b3270c3c99449; no voters:
I20260807 10:41:21.282549 9785 leader_election.cc:288] T 00000000000000000000000000000000 P 59bd4ffce3f447a5b10b3270c3c99449 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 10:41:21.282646 9795 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 59bd4ffce3f447a5b10b3270c3c99449 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:41:21.283525 9795 raft_consensus.cc:686] T 00000000000000000000000000000000 P 59bd4ffce3f447a5b10b3270c3c99449 [term 1 LEADER]: Becoming Leader. State: Replica: 59bd4ffce3f447a5b10b3270c3c99449, State: Running, Role: LEADER
I20260807 10:41:21.284103 9795 consensus_queue.cc:237] T 00000000000000000000000000000000 P 59bd4ffce3f447a5b10b3270c3c99449 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59bd4ffce3f447a5b10b3270c3c99449" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35441 } }
I20260807 10:41:21.285241 9785 sys_catalog.cc:564] T 00000000000000000000000000000000 P 59bd4ffce3f447a5b10b3270c3c99449 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 10:41:21.287992 9797 sys_catalog.cc:455] T 00000000000000000000000000000000 P 59bd4ffce3f447a5b10b3270c3c99449 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 59bd4ffce3f447a5b10b3270c3c99449. Latest consensus state: current_term: 1 leader_uuid: "59bd4ffce3f447a5b10b3270c3c99449" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59bd4ffce3f447a5b10b3270c3c99449" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35441 } } }
I20260807 10:41:21.288434 9797 sys_catalog.cc:458] T 00000000000000000000000000000000 P 59bd4ffce3f447a5b10b3270c3c99449 [sys.catalog]: This master's current role is: LEADER
I20260807 10:41:21.289502 9796 sys_catalog.cc:455] T 00000000000000000000000000000000 P 59bd4ffce3f447a5b10b3270c3c99449 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "59bd4ffce3f447a5b10b3270c3c99449" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59bd4ffce3f447a5b10b3270c3c99449" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35441 } } }
I20260807 10:41:21.292201 9796 sys_catalog.cc:458] T 00000000000000000000000000000000 P 59bd4ffce3f447a5b10b3270c3c99449 [sys.catalog]: This master's current role is: LEADER
I20260807 10:41:21.292363 9802 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 10:41:21.298141 9802 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 10:41:21.307106 9802 catalog_manager.cc:1347] Generated new cluster ID: 903c90af952741c584048775a3111a58
I20260807 10:41:21.307235 9802 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 10:41:21.347600 9802 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 10:41:21.349009 9802 catalog_manager.cc:1504] Loading token signing keys...
I20260807 10:41:21.371225 9802 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 59bd4ffce3f447a5b10b3270c3c99449: Generated new TSK 0
I20260807 10:41:21.372191 9802 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 10:41:21.390446 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 9715
W20260807 10:41:21.391666 9780 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:45865
W20260807 10:41:21.392683 21165 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 9715: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260807 10:41:21.392899 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 9715
W20260807 10:41:21.413988 9699 connection.cc:535] client connection to 127.0.0.1:35441 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:35441): Connection reset by peer (error 104)
2026-08-07T10:41:21Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (2135 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786098956060137-21165-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 10:41:21 dist-test-slave-0b58 krb5kdc[9816](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 10:41:21 dist-test-slave-0b58 krb5kdc[9816](info): set up 2 sockets
Aug 07 10:41:21 dist-test-slave-0b58 krb5kdc[9816](info): commencing operation
krb5kdc: starting...
W20260807 10:41:22.618552 21165 mini_kdc.cc:121] Time spent starting KDC: real 1.185s user 0.001s sys 0.052s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786098956060137-21165-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786098956060137-21165-0/krb5kdc/test-user.keytab.
Aug 07 10:41:22 dist-test-slave-0b58 krb5kdc[9816](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099282, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T10:41:22Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T10:41:22Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786098956060137-21165-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786098956060137-21165-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 10:41:22.975514 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786098956060137-21165-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786098956060137-21165-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786098956060137-21165-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38587
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786098956060137-21165-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:38875
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:38587
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786098956060137-21165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786098956060137-21165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786098956060137-21165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:41:23.324323 9830 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:41:23.324628 9830 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:41:23.324819 9830 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:41:23.332114 9830 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 10:41:23.332261 9830 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:41:23.332399 9830 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:41:23.332512 9830 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 10:41:23.332581 9830 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 10:41:23.342474 9830 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:38875
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786098956060137-21165-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786098956060137-21165-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:38587
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786098956060137-21165-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38587
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786098956060137-21165-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:41:23.343827 9830 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:41:23.345228 9830 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:41:23.357473 9835 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:41:23.357563 9838 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:41:23.357507 9836 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:41:23.358412 9830 server_base.cc:1034] running on GCE node
I20260807 10:41:23.359251 9830 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:41:23.360747 9830 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:41:23.361954 9830 hybrid_clock.cc:648] HybridClock initialized: now 1786099283361918 us; error 31 us; skew 500 ppm
I20260807 10:41:23.362337 9830 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:41:23 dist-test-slave-0b58 krb5kdc[9816](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099283, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:41:23.369019 9830 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 10:41:23.370657 9830 webserver.cc:460] Webserver started at http://127.0.0.1:38905/ using document root <none> and password file <none>
I20260807 10:41:23.371373 9830 fs_manager.cc:359] Metadata directory not provided
I20260807 10:41:23.371513 9830 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:41:23.371834 9830 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:41:23.374996 9830 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786098956060137-21165-0/minicluster-data/master-0/data/instance:
uuid: "4b496666af7c4c74bfc1b4ef2a5b80f9"
format_stamp: "Formatted at 2026-08-07 10:41:23 on dist-test-slave-0b58"
server_key: "0def025a71780af61ab04a202d6a9615"
server_key_iv: "21a9cec6308df51ae3f34976785f75ef"
server_key_version: "encryptionkey@0"
I20260807 10:41:23.375826 9830 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786098956060137-21165-0/minicluster-data/master-0/wal/instance:
uuid: "4b496666af7c4c74bfc1b4ef2a5b80f9"
format_stamp: "Formatted at 2026-08-07 10:41:23 on dist-test-slave-0b58"
server_key: "0def025a71780af61ab04a202d6a9615"
server_key_iv: "21a9cec6308df51ae3f34976785f75ef"
server_key_version: "encryptionkey@0"
I20260807 10:41:23.381274 9830 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260807 10:41:23.384892 9845 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:41:23.386286 9830 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260807 10:41:23.386431 9830 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786098956060137-21165-0/minicluster-data/master-0/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786098956060137-21165-0/minicluster-data/master-0/wal
uuid: "4b496666af7c4c74bfc1b4ef2a5b80f9"
format_stamp: "Formatted at 2026-08-07 10:41:23 on dist-test-slave-0b58"
server_key: "0def025a71780af61ab04a202d6a9615"
server_key_iv: "21a9cec6308df51ae3f34976785f75ef"
server_key_version: "encryptionkey@0"
I20260807 10:41:23.386603 9830 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786098956060137-21165-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786098956060137-21165-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786098956060137-21165-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:41:23.392311 9830 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:41:23.396169 9830 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:41:23.396499 9830 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:41:23.415024 9830 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:38587
I20260807 10:41:23.415115 9898 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:38587 every 8 connection(s)
I20260807 10:41:23.416569 9830 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
I20260807 10:41:23.420311 9899 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:41:23.420853 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 9830
I20260807 10:41:23.421041 21165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786098956060137-21165-0/minicluster-data/master-0/wal/instance
I20260807 10:41:23.421613 21165 external_mini_cluster.cc:1428] Setting key 27c528705b5220dc309a600a0740bc3f
I20260807 10:41:23.429991 9902 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:23.423439 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51323 (local address 127.0.0.1:38587)
0807 10:41:23.424337 (+ 898us) server_negotiation.cc:206] Beginning negotiation
0807 10:41:23.424354 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0807 10:41:23.424404 (+ 50us) server_negotiation.cc:407] Connection header received
0807 10:41:23.426059 (+ 1655us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:41:23.426095 (+ 36us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:41:23.426559 (+ 464us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:41:23.427012 (+ 453us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:41:23.428009 (+ 997us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:41:23.428018 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:41:23.428035 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:41:23.428052 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:41:23.428126 (+ 74us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:41:23.428154 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:41:23.428452 (+ 298us) server_negotiation.cc:1035] Waiting for connection context
0807 10:41:23.428584 (+ 132us) server_negotiation.cc:299] Negotiation successful
0807 10:41:23.428781 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":604,"thread_start_us":363,"threads_started":1}
I20260807 10:41:23.433905 21165 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 10:41:23.435659 9899 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4b496666af7c4c74bfc1b4ef2a5b80f9: Bootstrap starting.
I20260807 10:41:23.439314 9899 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4b496666af7c4c74bfc1b4ef2a5b80f9: Neither blocks nor log segments found. Creating new log.
I20260807 10:41:23.440430 9899 log.cc:824] T 00000000000000000000000000000000 P 4b496666af7c4c74bfc1b4ef2a5b80f9: Log is configured to *not* fsync() on all Append() calls
I20260807 10:41:23.441098 9902 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:23.438344 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39929 (local address 127.0.0.1:38587)
0807 10:41:23.438500 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0807 10:41:23.438504 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 10:41:23.438968 (+ 464us) server_negotiation.cc:407] Connection header received
0807 10:41:23.439182 (+ 214us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:41:23.439186 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:41:23.439239 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:41:23.439352 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:41:23.440305 (+ 953us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:41:23.440311 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:41:23.440315 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:41:23.440340 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:41:23.440380 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:41:23.440396 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:41:23.440523 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0807 10:41:23.440687 (+ 164us) server_negotiation.cc:299] Negotiation successful
0807 10:41:23.440751 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260807 10:41:23.443485 9899 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4b496666af7c4c74bfc1b4ef2a5b80f9: No bootstrap required, opened a new log
I20260807 10:41:23.451123 9899 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4b496666af7c4c74bfc1b4ef2a5b80f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b496666af7c4c74bfc1b4ef2a5b80f9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38587 } }
I20260807 10:41:23.451689 9899 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4b496666af7c4c74bfc1b4ef2a5b80f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:41:23.451828 9899 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4b496666af7c4c74bfc1b4ef2a5b80f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b496666af7c4c74bfc1b4ef2a5b80f9, State: Initialized, Role: FOLLOWER
I20260807 10:41:23.452514 9899 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4b496666af7c4c74bfc1b4ef2a5b80f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b496666af7c4c74bfc1b4ef2a5b80f9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38587 } }
I20260807 10:41:23.452771 9899 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4b496666af7c4c74bfc1b4ef2a5b80f9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 10:41:23.452926 9899 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4b496666af7c4c74bfc1b4ef2a5b80f9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 10:41:23.453128 9899 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4b496666af7c4c74bfc1b4ef2a5b80f9 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:41:23.455394 9899 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4b496666af7c4c74bfc1b4ef2a5b80f9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b496666af7c4c74bfc1b4ef2a5b80f9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38587 } }
I20260807 10:41:23.455922 9899 leader_election.cc:302] T 00000000000000000000000000000000 P 4b496666af7c4c74bfc1b4ef2a5b80f9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4b496666af7c4c74bfc1b4ef2a5b80f9; no voters:
I20260807 10:41:23.456620 9899 leader_election.cc:288] T 00000000000000000000000000000000 P 4b496666af7c4c74bfc1b4ef2a5b80f9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 10:41:23.456718 9910 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4b496666af7c4c74bfc1b4ef2a5b80f9 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:41:23.457542 9910 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4b496666af7c4c74bfc1b4ef2a5b80f9 [term 1 LEADER]: Becoming Leader. State: Replica: 4b496666af7c4c74bfc1b4ef2a5b80f9, State: Running, Role: LEADER
I20260807 10:41:23.458120 9910 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4b496666af7c4c74bfc1b4ef2a5b80f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b496666af7c4c74bfc1b4ef2a5b80f9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38587 } }
I20260807 10:41:23.458911 9899 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4b496666af7c4c74bfc1b4ef2a5b80f9 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 10:41:23.461580 9912 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4b496666af7c4c74bfc1b4ef2a5b80f9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4b496666af7c4c74bfc1b4ef2a5b80f9. Latest consensus state: current_term: 1 leader_uuid: "4b496666af7c4c74bfc1b4ef2a5b80f9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b496666af7c4c74bfc1b4ef2a5b80f9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38587 } } }
I20260807 10:41:23.461508 9911 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4b496666af7c4c74bfc1b4ef2a5b80f9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4b496666af7c4c74bfc1b4ef2a5b80f9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b496666af7c4c74bfc1b4ef2a5b80f9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38587 } } }
I20260807 10:41:23.461998 9912 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4b496666af7c4c74bfc1b4ef2a5b80f9 [sys.catalog]: This master's current role is: LEADER
I20260807 10:41:23.461998 9911 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4b496666af7c4c74bfc1b4ef2a5b80f9 [sys.catalog]: This master's current role is: LEADER
I20260807 10:41:23.466470 9917 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 10:41:23.472152 9917 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 10:41:23.482008 9917 catalog_manager.cc:1347] Generated new cluster ID: 78af446f2a0c4b20a8bad1234a391f7f
I20260807 10:41:23.482151 9917 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 10:41:23.500320 9917 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 10:41:23.500854 9917 catalog_manager.cc:1504] Loading token signing keys...
I20260807 10:41:23.508203 9917 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4b496666af7c4c74bfc1b4ef2a5b80f9: Generated new TSK 0
I20260807 10:41:23.509271 9917 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 10:41:23.514305 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 9830
W20260807 10:41:23.517081 9893 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:51323
W20260807 10:41:23.517974 21165 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 9830: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260807 10:41:23.518127 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 9830
2026-08-07T10:41:23Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (2124 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786098956060137-21165-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 10:41:23 dist-test-slave-0b58 krb5kdc[9932](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 10:41:23 dist-test-slave-0b58 krb5kdc[9932](info): set up 2 sockets
Aug 07 10:41:23 dist-test-slave-0b58 krb5kdc[9932](info): commencing operation
krb5kdc: starting...
W20260807 10:41:24.694590 21165 mini_kdc.cc:121] Time spent starting KDC: real 1.136s user 0.000s sys 0.058s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786098956060137-21165-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786098956060137-21165-0/krb5kdc/test-user.keytab.
Aug 07 10:41:24 dist-test-slave-0b58 krb5kdc[9932](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099284, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T10:41:24Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T10:41:24Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786098956060137-21165-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786098956060137-21165-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 10:41:25.055390 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786098956060137-21165-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786098956060137-21165-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786098956060137-21165-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39389
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786098956060137-21165-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:42085
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:39389
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786098956060137-21165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786098956060137-21165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786098956060137-21165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:41:25.407701 9945 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:41:25.408005 9945 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:41:25.408187 9945 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:41:25.415678 9945 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 10:41:25.415809 9945 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:41:25.415867 9945 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:41:25.415923 9945 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 10:41:25.415970 9945 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 10:41:25.426415 9945 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:42085
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786098956060137-21165-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786098956060137-21165-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:39389
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786098956060137-21165-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39389
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786098956060137-21165-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:41:25.427843 9945 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:41:25.429261 9945 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:41:25.442667 9951 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:41:25.442632 9954 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:41:25.442638 9952 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:41:25.443521 9945 server_base.cc:1034] running on GCE node
I20260807 10:41:25.444504 9945 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:41:25.446226 9945 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:41:25.447438 9945 hybrid_clock.cc:648] HybridClock initialized: now 1786099285447406 us; error 46 us; skew 500 ppm
I20260807 10:41:25.447803 9945 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:41:25 dist-test-slave-0b58 krb5kdc[9932](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099285, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:41:25.450980 9945 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 10:41:25.452512 9945 webserver.cc:460] Webserver started at http://127.0.0.1:34035/ using document root <none> and password file <none>
I20260807 10:41:25.453190 9945 fs_manager.cc:359] Metadata directory not provided
I20260807 10:41:25.453357 9945 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:41:25.453660 9945 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:41:25.456686 9945 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786098956060137-21165-0/minicluster-data/master-0/data/instance:
uuid: "9d0d62d39b1845c5b321e14dc10f81ea"
format_stamp: "Formatted at 2026-08-07 10:41:25 on dist-test-slave-0b58"
server_key: "33925fca30da9d6fc76e4dfc69a0e0bc"
server_key_iv: "7aaf1750730a89ea09b21975a6a60c99"
server_key_version: "encryptionkey@0"
I20260807 10:41:25.457507 9945 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786098956060137-21165-0/minicluster-data/master-0/wal/instance:
uuid: "9d0d62d39b1845c5b321e14dc10f81ea"
format_stamp: "Formatted at 2026-08-07 10:41:25 on dist-test-slave-0b58"
server_key: "33925fca30da9d6fc76e4dfc69a0e0bc"
server_key_iv: "7aaf1750730a89ea09b21975a6a60c99"
server_key_version: "encryptionkey@0"
I20260807 10:41:25.462499 9945 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.005s
I20260807 10:41:25.465903 9962 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:41:25.467132 9945 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260807 10:41:25.467332 9945 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786098956060137-21165-0/minicluster-data/master-0/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786098956060137-21165-0/minicluster-data/master-0/wal
uuid: "9d0d62d39b1845c5b321e14dc10f81ea"
format_stamp: "Formatted at 2026-08-07 10:41:25 on dist-test-slave-0b58"
server_key: "33925fca30da9d6fc76e4dfc69a0e0bc"
server_key_iv: "7aaf1750730a89ea09b21975a6a60c99"
server_key_version: "encryptionkey@0"
I20260807 10:41:25.467535 9945 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786098956060137-21165-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786098956060137-21165-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786098956060137-21165-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:41:25.482157 9945 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:41:25.486094 9945 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:41:25.486406 9945 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:41:25.505545 9945 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:39389
I20260807 10:41:25.505582 10015 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:39389 every 8 connection(s)
I20260807 10:41:25.506973 9945 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
I20260807 10:41:25.510713 10016 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:41:25.511186 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 9945
I20260807 10:41:25.511399 21165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786098956060137-21165-0/minicluster-data/master-0/wal/instance
I20260807 10:41:25.511971 21165 external_mini_cluster.cc:1428] Setting key 19b875e01af0b745ed4467d6438aca96
I20260807 10:41:25.525763 10016 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9d0d62d39b1845c5b321e14dc10f81ea: Bootstrap starting.
Aug 07 10:41:25 dist-test-slave-0b58 krb5kdc[9932](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099284, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260807 10:41:25.529243 10016 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9d0d62d39b1845c5b321e14dc10f81ea: Neither blocks nor log segments found. Creating new log.
I20260807 10:41:25.530767 10016 log.cc:824] T 00000000000000000000000000000000 P 9d0d62d39b1845c5b321e14dc10f81ea: Log is configured to *not* fsync() on all Append() calls
I20260807 10:41:25.534446 10016 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9d0d62d39b1845c5b321e14dc10f81ea: No bootstrap required, opened a new log
I20260807 10:41:25.538869 10019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:25.513802 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56671 (local address 127.0.0.1:39389)
0807 10:41:25.514651 (+ 849us) server_negotiation.cc:206] Beginning negotiation
0807 10:41:25.514662 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 10:41:25.514712 (+ 50us) server_negotiation.cc:407] Connection header received
0807 10:41:25.517213 (+ 2501us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:41:25.517240 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:41:25.517649 (+ 409us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:41:25.518004 (+ 355us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:41:25.519902 (+ 1898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:25.521318 (+ 1416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:25.523194 (+ 1876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:25.524386 (+ 1192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:25.524591 (+ 205us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:25.529630 (+ 5039us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:41:25.529644 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:41:25.529666 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:41:25.529722 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:41:25.533911 (+ 4189us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:41:25.534750 (+ 839us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:41:25.534761 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:41:25.534772 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:41:25.535006 (+ 234us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:41:25.535466 (+ 460us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:41:25.535471 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:41:25.535474 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:41:25.536234 (+ 760us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:41:25.536604 (+ 370us) server_negotiation.cc:1035] Waiting for connection context
0807 10:41:25.536966 (+ 362us) server_negotiation.cc:299] Negotiation successful
0807 10:41:25.537446 (+ 480us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":646,"thread_start_us":401,"threads_started":1}
I20260807 10:41:25.542775 21165 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 10:41:25.544696 10016 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9d0d62d39b1845c5b321e14dc10f81ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d0d62d39b1845c5b321e14dc10f81ea" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39389 } }
I20260807 10:41:25.545171 10016 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9d0d62d39b1845c5b321e14dc10f81ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:41:25.545296 10016 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9d0d62d39b1845c5b321e14dc10f81ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d0d62d39b1845c5b321e14dc10f81ea, State: Initialized, Role: FOLLOWER
I20260807 10:41:25.546001 10016 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9d0d62d39b1845c5b321e14dc10f81ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d0d62d39b1845c5b321e14dc10f81ea" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39389 } }
I20260807 10:41:25.546365 10016 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9d0d62d39b1845c5b321e14dc10f81ea [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 10:41:25.546561 10016 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9d0d62d39b1845c5b321e14dc10f81ea [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 10:41:25.546748 10016 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9d0d62d39b1845c5b321e14dc10f81ea [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:41:25.549904 10016 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9d0d62d39b1845c5b321e14dc10f81ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d0d62d39b1845c5b321e14dc10f81ea" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39389 } }
I20260807 10:41:25.550433 10016 leader_election.cc:302] T 00000000000000000000000000000000 P 9d0d62d39b1845c5b321e14dc10f81ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9d0d62d39b1845c5b321e14dc10f81ea; no voters:
I20260807 10:41:25.551090 10016 leader_election.cc:288] T 00000000000000000000000000000000 P 9d0d62d39b1845c5b321e14dc10f81ea [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 10:41:25.551215 10027 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9d0d62d39b1845c5b321e14dc10f81ea [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:41:25.553126 10027 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9d0d62d39b1845c5b321e14dc10f81ea [term 1 LEADER]: Becoming Leader. State: Replica: 9d0d62d39b1845c5b321e14dc10f81ea, State: Running, Role: LEADER
I20260807 10:41:25.553803 10016 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9d0d62d39b1845c5b321e14dc10f81ea [sys.catalog]: configured and running, proceeding with master startup.
I20260807 10:41:25.553804 10027 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9d0d62d39b1845c5b321e14dc10f81ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d0d62d39b1845c5b321e14dc10f81ea" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39389 } }
I20260807 10:41:25.557336 10028 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9d0d62d39b1845c5b321e14dc10f81ea [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9d0d62d39b1845c5b321e14dc10f81ea" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d0d62d39b1845c5b321e14dc10f81ea" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39389 } } }
I20260807 10:41:25.557817 10028 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9d0d62d39b1845c5b321e14dc10f81ea [sys.catalog]: This master's current role is: LEADER
I20260807 10:41:25.558424 10029 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9d0d62d39b1845c5b321e14dc10f81ea [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9d0d62d39b1845c5b321e14dc10f81ea. Latest consensus state: current_term: 1 leader_uuid: "9d0d62d39b1845c5b321e14dc10f81ea" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d0d62d39b1845c5b321e14dc10f81ea" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39389 } } }
I20260807 10:41:25.558780 10029 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9d0d62d39b1845c5b321e14dc10f81ea [sys.catalog]: This master's current role is: LEADER
I20260807 10:41:25.568284 10019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:25.548521 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37505 (local address 127.0.0.1:39389)
0807 10:41:25.548734 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0807 10:41:25.548740 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:41:25.549165 (+ 425us) server_negotiation.cc:407] Connection header received
0807 10:41:25.549325 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:41:25.549331 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:41:25.549422 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:41:25.549530 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:41:25.551579 (+ 2049us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:25.552748 (+ 1169us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:25.554376 (+ 1628us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:25.554854 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:25.554993 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:25.558311 (+ 3318us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:41:25.558320 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:41:25.558327 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:41:25.558379 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:41:25.563146 (+ 4767us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:41:25.564214 (+ 1068us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:41:25.564223 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:41:25.564229 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:41:25.564461 (+ 232us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:41:25.565055 (+ 594us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:41:25.565063 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:41:25.565068 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:41:25.565602 (+ 534us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:41:25.565897 (+ 295us) server_negotiation.cc:1035] Waiting for connection context
0807 10:41:25.567403 (+ 1506us) server_negotiation.cc:299] Negotiation successful
0807 10:41:25.567637 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260807 10:41:25.570719 10032 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 10:41:25.576177 10032 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 10:41:25.585130 10032 catalog_manager.cc:1347] Generated new cluster ID: 53eb8c395fbd42e2914b32a837bc1e13
I20260807 10:41:25.585264 10032 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 10:41:25.612376 10032 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 10:41:25.614356 10032 catalog_manager.cc:1504] Loading token signing keys...
I20260807 10:41:25.624315 10032 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9d0d62d39b1845c5b321e14dc10f81ea: Generated new TSK 0
I20260807 10:41:25.625370 10032 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 10:41:25.640101 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 9945
I20260807 10:41:25.641201 10011 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:41:25.736531 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 9945
2026-08-07T10:41:25Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (2219 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786098956060137-21165-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 10:41:25 dist-test-slave-0b58 krb5kdc[10050](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 10:41:25 dist-test-slave-0b58 krb5kdc[10050](info): set up 2 sockets
Aug 07 10:41:25 dist-test-slave-0b58 krb5kdc[10050](info): commencing operation
krb5kdc: starting...
W20260807 10:41:26.898777 21165 mini_kdc.cc:121] Time spent starting KDC: real 1.121s user 0.000s sys 0.054s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786098956060137-21165-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786098956060137-21165-0/krb5kdc/test-user.keytab.
Aug 07 10:41:27 dist-test-slave-0b58 krb5kdc[10050](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099287, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T10:41:27Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T10:41:27Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786098956060137-21165-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786098956060137-21165-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 10:41:27.265719 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786098956060137-21165-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786098956060137-21165-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786098956060137-21165-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40483
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786098956060137-21165-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:46267
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:40483
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786098956060137-21165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786098956060137-21165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786098956060137-21165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:41:27.615342 10064 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:41:27.615630 10064 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:41:27.615725 10064 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:41:27.623008 10064 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 10:41:27.623114 10064 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:41:27.623167 10064 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:41:27.623224 10064 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 10:41:27.623267 10064 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 10:41:27.633251 10064 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:46267
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786098956060137-21165-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786098956060137-21165-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:40483
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786098956060137-21165-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40483
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786098956060137-21165-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:41:27.634526 10064 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:41:27.635826 10064 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:41:27.647853 10069 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:41:27.647997 10070 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:41:27.648029 10072 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:41:27.648998 10064 server_base.cc:1034] running on GCE node
I20260807 10:41:27.649833 10064 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:41:27.651443 10064 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:41:27.652688 10064 hybrid_clock.cc:648] HybridClock initialized: now 1786099287652631 us; error 45 us; skew 500 ppm
I20260807 10:41:27.653048 10064 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:41:27 dist-test-slave-0b58 krb5kdc[10050](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099287, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:41:27.656323 10064 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 10:41:27.657827 10064 webserver.cc:460] Webserver started at http://127.0.0.1:41223/ using document root <none> and password file <none>
I20260807 10:41:27.658512 10064 fs_manager.cc:359] Metadata directory not provided
I20260807 10:41:27.658671 10064 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:41:27.658993 10064 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:41:27.662122 10064 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786098956060137-21165-0/minicluster-data/master-0/data/instance:
uuid: "d006d50932654996a6608a677fb012c8"
format_stamp: "Formatted at 2026-08-07 10:41:27 on dist-test-slave-0b58"
server_key: "80bfd7ab6c21705d645b3e4e03fa62ad"
server_key_iv: "d8d0684b35c91e1da35d276a1249cefc"
server_key_version: "encryptionkey@0"
I20260807 10:41:27.662947 10064 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786098956060137-21165-0/minicluster-data/master-0/wal/instance:
uuid: "d006d50932654996a6608a677fb012c8"
format_stamp: "Formatted at 2026-08-07 10:41:27 on dist-test-slave-0b58"
server_key: "80bfd7ab6c21705d645b3e4e03fa62ad"
server_key_iv: "d8d0684b35c91e1da35d276a1249cefc"
server_key_version: "encryptionkey@0"
I20260807 10:41:27.668493 10064 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260807 10:41:27.672013 10079 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:41:27.673434 10064 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 10:41:27.673640 10064 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786098956060137-21165-0/minicluster-data/master-0/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786098956060137-21165-0/minicluster-data/master-0/wal
uuid: "d006d50932654996a6608a677fb012c8"
format_stamp: "Formatted at 2026-08-07 10:41:27 on dist-test-slave-0b58"
server_key: "80bfd7ab6c21705d645b3e4e03fa62ad"
server_key_iv: "d8d0684b35c91e1da35d276a1249cefc"
server_key_version: "encryptionkey@0"
I20260807 10:41:27.673851 10064 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786098956060137-21165-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786098956060137-21165-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786098956060137-21165-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:41:27.692592 10064 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:41:27.697247 10064 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:41:27.697573 10064 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:41:27.717440 10064 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:40483
I20260807 10:41:27.717476 10134 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:40483 every 8 connection(s)
I20260807 10:41:27.718885 10064 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
I20260807 10:41:27.722306 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 10064
I20260807 10:41:27.722489 21165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786098956060137-21165-0/minicluster-data/master-0/wal/instance
I20260807 10:41:27.722862 10135 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:41:27.722949 21165 external_mini_cluster.cc:1428] Setting key aa95fd81460b5a774e71146429d04887
I20260807 10:41:27.739087 10135 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d006d50932654996a6608a677fb012c8: Bootstrap starting.
I20260807 10:41:27.739218 10138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:27.724907 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42779 (local address 127.0.0.1:40483)
0807 10:41:27.725756 (+ 849us) server_negotiation.cc:206] Beginning negotiation
0807 10:41:27.725779 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0807 10:41:27.725827 (+ 48us) server_negotiation.cc:407] Connection header received
0807 10:41:27.728309 (+ 2482us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:41:27.728339 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:41:27.728902 (+ 563us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:41:27.729358 (+ 456us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:41:27.729920 (+ 562us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:27.732018 (+ 2098us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:27.733592 (+ 1574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:27.734699 (+ 1107us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:27.734919 (+ 220us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:27.736258 (+ 1339us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:41:27.736270 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:41:27.736309 (+ 39us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:41:27.737090 (+ 781us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:41:27.737189 (+ 99us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:41:27.737221 (+ 32us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:41:27.737345 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0807 10:41:27.737596 (+ 251us) server_negotiation.cc:299] Negotiation successful
0807 10:41:27.737882 (+ 286us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":588,"thread_start_us":355,"threads_started":1}
I20260807 10:41:27.742612 10135 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d006d50932654996a6608a677fb012c8: Neither blocks nor log segments found. Creating new log.
I20260807 10:41:27.743139 21165 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 10:41:27.743806 10135 log.cc:824] T 00000000000000000000000000000000 P d006d50932654996a6608a677fb012c8: Log is configured to *not* fsync() on all Append() calls
I20260807 10:41:27.746893 10135 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d006d50932654996a6608a677fb012c8: No bootstrap required, opened a new log
I20260807 10:41:27.754920 10138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:27.748348 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45785 (local address 127.0.0.1:40483)
0807 10:41:27.748544 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0807 10:41:27.748550 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:41:27.748848 (+ 298us) server_negotiation.cc:407] Connection header received
0807 10:41:27.748995 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:41:27.749001 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:41:27.749100 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:41:27.749207 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:41:27.749695 (+ 488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:27.750839 (+ 1144us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:27.752166 (+ 1327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:27.752911 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:27.753051 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:27.754118 (+ 1067us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:41:27.754125 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:41:27.754130 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:41:27.754150 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:41:27.754195 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:41:27.754213 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:41:27.754301 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0807 10:41:27.754433 (+ 132us) server_negotiation.cc:299] Negotiation successful
0807 10:41:27.754539 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260807 10:41:27.756851 10135 raft_consensus.cc:348] T 00000000000000000000000000000000 P d006d50932654996a6608a677fb012c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d006d50932654996a6608a677fb012c8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40483 } }
I20260807 10:41:27.757213 10135 raft_consensus.cc:374] T 00000000000000000000000000000000 P d006d50932654996a6608a677fb012c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:41:27.757287 10135 raft_consensus.cc:729] T 00000000000000000000000000000000 P d006d50932654996a6608a677fb012c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d006d50932654996a6608a677fb012c8, State: Initialized, Role: FOLLOWER
I20260807 10:41:27.757794 10135 consensus_queue.cc:260] T 00000000000000000000000000000000 P d006d50932654996a6608a677fb012c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d006d50932654996a6608a677fb012c8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40483 } }
I20260807 10:41:27.758004 10135 raft_consensus.cc:388] T 00000000000000000000000000000000 P d006d50932654996a6608a677fb012c8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 10:41:27.758093 10135 raft_consensus.cc:482] T 00000000000000000000000000000000 P d006d50932654996a6608a677fb012c8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 10:41:27.758220 10135 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d006d50932654996a6608a677fb012c8 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:41:27.760515 10135 raft_consensus.cc:504] T 00000000000000000000000000000000 P d006d50932654996a6608a677fb012c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d006d50932654996a6608a677fb012c8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40483 } }
I20260807 10:41:27.761042 10135 leader_election.cc:302] T 00000000000000000000000000000000 P d006d50932654996a6608a677fb012c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d006d50932654996a6608a677fb012c8; no voters:
I20260807 10:41:27.761777 10135 leader_election.cc:288] T 00000000000000000000000000000000 P d006d50932654996a6608a677fb012c8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 10:41:27.761950 10145 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d006d50932654996a6608a677fb012c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:41:27.762709 10145 raft_consensus.cc:686] T 00000000000000000000000000000000 P d006d50932654996a6608a677fb012c8 [term 1 LEADER]: Becoming Leader. State: Replica: d006d50932654996a6608a677fb012c8, State: Running, Role: LEADER
I20260807 10:41:27.763248 10145 consensus_queue.cc:237] T 00000000000000000000000000000000 P d006d50932654996a6608a677fb012c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d006d50932654996a6608a677fb012c8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40483 } }
I20260807 10:41:27.764024 10135 sys_catalog.cc:564] T 00000000000000000000000000000000 P d006d50932654996a6608a677fb012c8 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 10:41:27.766350 10147 sys_catalog.cc:455] T 00000000000000000000000000000000 P d006d50932654996a6608a677fb012c8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d006d50932654996a6608a677fb012c8. Latest consensus state: current_term: 1 leader_uuid: "d006d50932654996a6608a677fb012c8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d006d50932654996a6608a677fb012c8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40483 } } }
I20260807 10:41:27.766762 10147 sys_catalog.cc:458] T 00000000000000000000000000000000 P d006d50932654996a6608a677fb012c8 [sys.catalog]: This master's current role is: LEADER
I20260807 10:41:27.766712 10146 sys_catalog.cc:455] T 00000000000000000000000000000000 P d006d50932654996a6608a677fb012c8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d006d50932654996a6608a677fb012c8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d006d50932654996a6608a677fb012c8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40483 } } }
I20260807 10:41:27.767079 10146 sys_catalog.cc:458] T 00000000000000000000000000000000 P d006d50932654996a6608a677fb012c8 [sys.catalog]: This master's current role is: LEADER
I20260807 10:41:27.768164 10150 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 10:41:27.773685 10150 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 10:41:27.783665 10150 catalog_manager.cc:1347] Generated new cluster ID: 1900063027634557a0667c8c6d7d39d3
I20260807 10:41:27.783805 10150 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 10:41:27.794451 10150 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 10:41:27.795722 10150 catalog_manager.cc:1504] Loading token signing keys...
I20260807 10:41:27.804877 10150 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d006d50932654996a6608a677fb012c8: Generated new TSK 0
I20260807 10:41:27.805676 10150 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 10:41:27.817595 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 10064
W20260807 10:41:27.818631 10130 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:42779
W20260807 10:41:27.819433 21165 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 10064: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260807 10:41:27.819588 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 10064
2026-08-07T10:41:27Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (2082 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786098956060137-21165-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 10:41:27 dist-test-slave-0b58 krb5kdc[10166](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 10:41:27 dist-test-slave-0b58 krb5kdc[10166](info): set up 2 sockets
Aug 07 10:41:27 dist-test-slave-0b58 krb5kdc[10166](info): commencing operation
krb5kdc: starting...
W20260807 10:41:28.999330 21165 mini_kdc.cc:121] Time spent starting KDC: real 1.139s user 0.002s sys 0.051s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786098956060137-21165-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786098956060137-21165-0/krb5kdc/test-user.keytab.
Aug 07 10:41:29 dist-test-slave-0b58 krb5kdc[10166](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099289, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T10:41:29Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T10:41:29Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786098956060137-21165-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786098956060137-21165-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 10:41:29.359444 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786098956060137-21165-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786098956060137-21165-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786098956060137-21165-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44213
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786098956060137-21165-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:37789
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:44213
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786098956060137-21165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786098956060137-21165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786098956060137-21165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:41:29.714473 10179 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:41:29.714797 10179 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:41:29.714958 10179 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:41:29.724213 10179 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 10:41:29.724350 10179 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:41:29.724472 10179 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:41:29.724572 10179 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 10:41:29.724639 10179 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 10:41:29.734952 10179 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:37789
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786098956060137-21165-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786098956060137-21165-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:44213
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786098956060137-21165-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44213
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786098956060137-21165-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:41:29.736544 10179 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:41:29.738639 10179 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:41:29.752960 10185 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:41:29.752988 10184 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:41:29.753645 10187 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:41:29.754081 10179 server_base.cc:1034] running on GCE node
I20260807 10:41:29.755087 10179 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:41:29.757100 10179 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:41:29.758397 10179 hybrid_clock.cc:648] HybridClock initialized: now 1786099289758304 us; error 75 us; skew 500 ppm
I20260807 10:41:29.758816 10179 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:41:29 dist-test-slave-0b58 krb5kdc[10166](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099289, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:41:29.766966 10179 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 10:41:29.769030 10179 webserver.cc:460] Webserver started at http://127.0.0.1:45849/ using document root <none> and password file <none>
I20260807 10:41:29.769968 10179 fs_manager.cc:359] Metadata directory not provided
I20260807 10:41:29.770135 10179 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:41:29.770552 10179 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:41:29.773784 10179 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786098956060137-21165-0/minicluster-data/master-0/data/instance:
uuid: "e80f5cb4f64540669d16b5de95b84765"
format_stamp: "Formatted at 2026-08-07 10:41:29 on dist-test-slave-0b58"
server_key: "8a8e0745fd281e3a2d0b420a35777b09"
server_key_iv: "afa10796fc20977320d5f444a9f34c09"
server_key_version: "encryptionkey@0"
I20260807 10:41:29.774734 10179 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786098956060137-21165-0/minicluster-data/master-0/wal/instance:
uuid: "e80f5cb4f64540669d16b5de95b84765"
format_stamp: "Formatted at 2026-08-07 10:41:29 on dist-test-slave-0b58"
server_key: "8a8e0745fd281e3a2d0b420a35777b09"
server_key_iv: "afa10796fc20977320d5f444a9f34c09"
server_key_version: "encryptionkey@0"
I20260807 10:41:29.780208 10179 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260807 10:41:29.783934 10194 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:41:29.785429 10179 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 10:41:29.785619 10179 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786098956060137-21165-0/minicluster-data/master-0/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786098956060137-21165-0/minicluster-data/master-0/wal
uuid: "e80f5cb4f64540669d16b5de95b84765"
format_stamp: "Formatted at 2026-08-07 10:41:29 on dist-test-slave-0b58"
server_key: "8a8e0745fd281e3a2d0b420a35777b09"
server_key_iv: "afa10796fc20977320d5f444a9f34c09"
server_key_version: "encryptionkey@0"
I20260807 10:41:29.785832 10179 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786098956060137-21165-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786098956060137-21165-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786098956060137-21165-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:41:29.791664 10179 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:41:29.796011 10179 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:41:29.796391 10179 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:41:29.816793 10179 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:44213
I20260807 10:41:29.816833 10247 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:44213 every 8 connection(s)
I20260807 10:41:29.818142 10179 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
I20260807 10:41:29.822846 10248 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:41:29.825122 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 10179
I20260807 10:41:29.825345 21165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786098956060137-21165-0/minicluster-data/master-0/wal/instance
I20260807 10:41:29.825820 21165 external_mini_cluster.cc:1428] Setting key a0a42d6fd7023410072168201f5d5123
I20260807 10:41:29.833768 10251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:29.827684 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50109 (local address 127.0.0.1:44213)
0807 10:41:29.828574 (+ 890us) server_negotiation.cc:206] Beginning negotiation
0807 10:41:29.828588 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0807 10:41:29.828631 (+ 43us) server_negotiation.cc:407] Connection header received
0807 10:41:29.830374 (+ 1743us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:41:29.830396 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:41:29.830701 (+ 305us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:41:29.831064 (+ 363us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:41:29.832114 (+ 1050us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:41:29.832123 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:41:29.832135 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:41:29.832152 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:41:29.832206 (+ 54us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:41:29.832242 (+ 36us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:41:29.832543 (+ 301us) server_negotiation.cc:1035] Waiting for connection context
0807 10:41:29.832694 (+ 151us) server_negotiation.cc:299] Negotiation successful
0807 10:41:29.832862 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":672,"thread_start_us":383,"threads_started":1}
I20260807 10:41:29.835139 10248 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e80f5cb4f64540669d16b5de95b84765: Bootstrap starting.
I20260807 10:41:29.837646 21165 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 10:41:29.838596 10248 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e80f5cb4f64540669d16b5de95b84765: Neither blocks nor log segments found. Creating new log.
I20260807 10:41:29.839648 10248 log.cc:824] T 00000000000000000000000000000000 P e80f5cb4f64540669d16b5de95b84765: Log is configured to *not* fsync() on all Append() calls
I20260807 10:41:29.842634 10248 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e80f5cb4f64540669d16b5de95b84765: No bootstrap required, opened a new log
I20260807 10:41:29.845186 10251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:29.842510 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58927 (local address 127.0.0.1:44213)
0807 10:41:29.842702 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0807 10:41:29.842709 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:41:29.843004 (+ 295us) server_negotiation.cc:407] Connection header received
0807 10:41:29.843251 (+ 247us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:41:29.843256 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:41:29.843302 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:41:29.843421 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:41:29.844494 (+ 1073us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:41:29.844505 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:41:29.844509 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:41:29.844527 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:41:29.844569 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:41:29.844587 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:41:29.844723 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0807 10:41:29.844841 (+ 118us) server_negotiation.cc:299] Negotiation successful
0807 10:41:29.844909 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260807 10:41:29.851331 10248 raft_consensus.cc:348] T 00000000000000000000000000000000 P e80f5cb4f64540669d16b5de95b84765 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e80f5cb4f64540669d16b5de95b84765" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44213 } }
I20260807 10:41:29.851761 10248 raft_consensus.cc:374] T 00000000000000000000000000000000 P e80f5cb4f64540669d16b5de95b84765 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:41:29.851888 10248 raft_consensus.cc:729] T 00000000000000000000000000000000 P e80f5cb4f64540669d16b5de95b84765 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e80f5cb4f64540669d16b5de95b84765, State: Initialized, Role: FOLLOWER
I20260807 10:41:29.852578 10248 consensus_queue.cc:260] T 00000000000000000000000000000000 P e80f5cb4f64540669d16b5de95b84765 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e80f5cb4f64540669d16b5de95b84765" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44213 } }
I20260807 10:41:29.852845 10248 raft_consensus.cc:388] T 00000000000000000000000000000000 P e80f5cb4f64540669d16b5de95b84765 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 10:41:29.853040 10248 raft_consensus.cc:482] T 00000000000000000000000000000000 P e80f5cb4f64540669d16b5de95b84765 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 10:41:29.853222 10248 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e80f5cb4f64540669d16b5de95b84765 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:41:29.855568 10248 raft_consensus.cc:504] T 00000000000000000000000000000000 P e80f5cb4f64540669d16b5de95b84765 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e80f5cb4f64540669d16b5de95b84765" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44213 } }
I20260807 10:41:29.856088 10248 leader_election.cc:302] T 00000000000000000000000000000000 P e80f5cb4f64540669d16b5de95b84765 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e80f5cb4f64540669d16b5de95b84765; no voters:
I20260807 10:41:29.856791 10248 leader_election.cc:288] T 00000000000000000000000000000000 P e80f5cb4f64540669d16b5de95b84765 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 10:41:29.856925 10258 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e80f5cb4f64540669d16b5de95b84765 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:41:29.857682 10258 raft_consensus.cc:686] T 00000000000000000000000000000000 P e80f5cb4f64540669d16b5de95b84765 [term 1 LEADER]: Becoming Leader. State: Replica: e80f5cb4f64540669d16b5de95b84765, State: Running, Role: LEADER
I20260807 10:41:29.858242 10258 consensus_queue.cc:237] T 00000000000000000000000000000000 P e80f5cb4f64540669d16b5de95b84765 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e80f5cb4f64540669d16b5de95b84765" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44213 } }
I20260807 10:41:29.859283 10248 sys_catalog.cc:564] T 00000000000000000000000000000000 P e80f5cb4f64540669d16b5de95b84765 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 10:41:29.861364 10260 sys_catalog.cc:455] T 00000000000000000000000000000000 P e80f5cb4f64540669d16b5de95b84765 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e80f5cb4f64540669d16b5de95b84765. Latest consensus state: current_term: 1 leader_uuid: "e80f5cb4f64540669d16b5de95b84765" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e80f5cb4f64540669d16b5de95b84765" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44213 } } }
I20260807 10:41:29.861873 10260 sys_catalog.cc:458] T 00000000000000000000000000000000 P e80f5cb4f64540669d16b5de95b84765 [sys.catalog]: This master's current role is: LEADER
I20260807 10:41:29.864332 10259 sys_catalog.cc:455] T 00000000000000000000000000000000 P e80f5cb4f64540669d16b5de95b84765 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e80f5cb4f64540669d16b5de95b84765" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e80f5cb4f64540669d16b5de95b84765" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44213 } } }
I20260807 10:41:29.864727 10259 sys_catalog.cc:458] T 00000000000000000000000000000000 P e80f5cb4f64540669d16b5de95b84765 [sys.catalog]: This master's current role is: LEADER
I20260807 10:41:29.866014 10266 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 10:41:29.871376 10266 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 10:41:29.881423 10266 catalog_manager.cc:1347] Generated new cluster ID: b038d0fe8637409a87f3f7e4fa13f339
I20260807 10:41:29.881549 10266 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 10:41:29.893158 10266 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 10:41:29.893584 10266 catalog_manager.cc:1504] Loading token signing keys...
I20260807 10:41:29.902175 10266 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e80f5cb4f64540669d16b5de95b84765: Generated new TSK 0
I20260807 10:41:29.902966 10266 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 10:41:29.909104 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 10179
W20260807 10:41:29.910239 10242 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:50109
W20260807 10:41:29.910965 21165 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 10179: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260807 10:41:29.911118 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 10179
2026-08-07T10:41:29Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (2091 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786098956060137-21165-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 10:41:30 dist-test-slave-0b58 krb5kdc[10280](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 10:41:30 dist-test-slave-0b58 krb5kdc[10280](info): set up 2 sockets
Aug 07 10:41:30 dist-test-slave-0b58 krb5kdc[10280](info): commencing operation
krb5kdc: starting...
W20260807 10:41:31.086535 21165 mini_kdc.cc:121] Time spent starting KDC: real 1.135s user 0.000s sys 0.055s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786098956060137-21165-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786098956060137-21165-0/krb5kdc/test-user.keytab.
Aug 07 10:41:31 dist-test-slave-0b58 krb5kdc[10280](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099291, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T10:41:31Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T10:41:31Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786098956060137-21165-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786098956060137-21165-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 10:41:31.455019 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786098956060137-21165-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786098956060137-21165-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786098956060137-21165-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37095
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786098956060137-21165-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40695
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:37095
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786098956060137-21165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786098956060137-21165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786098956060137-21165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:41:31.805316 10293 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:41:31.805589 10293 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:41:31.805794 10293 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:41:31.813246 10293 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 10:41:31.813364 10293 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:41:31.813464 10293 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:41:31.813572 10293 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 10:41:31.813657 10293 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 10:41:31.823462 10293 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40695
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786098956060137-21165-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786098956060137-21165-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:37095
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786098956060137-21165-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37095
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786098956060137-21165-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:41:31.824779 10293 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:41:31.826078 10293 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:41:31.837848 10298 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:41:31.837805 10299 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:41:31.837875 10301 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:41:31.838798 10293 server_base.cc:1034] running on GCE node
I20260807 10:41:31.839534 10293 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:41:31.840975 10293 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:41:31.842228 10293 hybrid_clock.cc:648] HybridClock initialized: now 1786099291842193 us; error 46 us; skew 500 ppm
I20260807 10:41:31.842617 10293 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:41:31 dist-test-slave-0b58 krb5kdc[10280](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099291, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:41:31.846065 10293 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 10:41:31.847846 10293 webserver.cc:460] Webserver started at http://127.0.0.1:33857/ using document root <none> and password file <none>
I20260807 10:41:31.848690 10293 fs_manager.cc:359] Metadata directory not provided
I20260807 10:41:31.848861 10293 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:41:31.849196 10293 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:41:31.852444 10293 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786098956060137-21165-0/minicluster-data/master-0/data/instance:
uuid: "4441110019364c00ba4911aa72b87ade"
format_stamp: "Formatted at 2026-08-07 10:41:31 on dist-test-slave-0b58"
server_key: "01d2f94c64e183c3a0bf3acb816b6a13"
server_key_iv: "e8319f5d5b14dcbf5a8b42a75919ad3e"
server_key_version: "encryptionkey@0"
I20260807 10:41:31.853299 10293 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786098956060137-21165-0/minicluster-data/master-0/wal/instance:
uuid: "4441110019364c00ba4911aa72b87ade"
format_stamp: "Formatted at 2026-08-07 10:41:31 on dist-test-slave-0b58"
server_key: "01d2f94c64e183c3a0bf3acb816b6a13"
server_key_iv: "e8319f5d5b14dcbf5a8b42a75919ad3e"
server_key_version: "encryptionkey@0"
I20260807 10:41:31.858870 10293 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260807 10:41:31.862561 10308 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:41:31.863897 10293 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 10:41:31.864113 10293 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786098956060137-21165-0/minicluster-data/master-0/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786098956060137-21165-0/minicluster-data/master-0/wal
uuid: "4441110019364c00ba4911aa72b87ade"
format_stamp: "Formatted at 2026-08-07 10:41:31 on dist-test-slave-0b58"
server_key: "01d2f94c64e183c3a0bf3acb816b6a13"
server_key_iv: "e8319f5d5b14dcbf5a8b42a75919ad3e"
server_key_version: "encryptionkey@0"
I20260807 10:41:31.864428 10293 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786098956060137-21165-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786098956060137-21165-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786098956060137-21165-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:41:31.889417 10293 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:41:31.894196 10293 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:41:31.894541 10293 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:41:31.914621 10293 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:37095
I20260807 10:41:31.914655 10361 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:37095 every 8 connection(s)
I20260807 10:41:31.916067 10293 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
I20260807 10:41:31.919869 10362 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:41:31.920790 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 10293
I20260807 10:41:31.921002 21165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786098956060137-21165-0/minicluster-data/master-0/wal/instance
I20260807 10:41:31.921484 21165 external_mini_cluster.cc:1428] Setting key 2bf8d3664ecba9e98a9510e1ab414039
I20260807 10:41:31.935047 10362 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4441110019364c00ba4911aa72b87ade: Bootstrap starting.
Aug 07 10:41:31 dist-test-slave-0b58 krb5kdc[10280](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099291, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260807 10:41:31.938315 10362 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4441110019364c00ba4911aa72b87ade: Neither blocks nor log segments found. Creating new log.
I20260807 10:41:31.939733 10362 log.cc:824] T 00000000000000000000000000000000 P 4441110019364c00ba4911aa72b87ade: Log is configured to *not* fsync() on all Append() calls
I20260807 10:41:31.943190 10362 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4441110019364c00ba4911aa72b87ade: No bootstrap required, opened a new log
I20260807 10:41:31.947461 10365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:31.923550 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.101:46801 (local address 127.0.0.1:37095)
0807 10:41:31.924353 (+ 803us) server_negotiation.cc:206] Beginning negotiation
0807 10:41:31.924369 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 10:41:31.924430 (+ 61us) server_negotiation.cc:407] Connection header received
0807 10:41:31.926960 (+ 2530us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:41:31.926992 (+ 32us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:41:31.927548 (+ 556us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:41:31.928013 (+ 465us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:41:31.929476 (+ 1463us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:31.931536 (+ 2060us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:31.932913 (+ 1377us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:31.933974 (+ 1061us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:31.934150 (+ 176us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:31.938457 (+ 4307us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:41:31.938471 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:41:31.938491 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:41:31.938552 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:41:31.942538 (+ 3986us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:41:31.943442 (+ 904us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:41:31.943453 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:41:31.943464 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:41:31.943695 (+ 231us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:41:31.944179 (+ 484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:41:31.944184 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:41:31.944187 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:41:31.944923 (+ 736us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:41:31.945289 (+ 366us) server_negotiation.cc:1035] Waiting for connection context
0807 10:41:31.945645 (+ 356us) server_negotiation.cc:299] Negotiation successful
0807 10:41:31.946019 (+ 374us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":542,"thread_start_us":318,"threads_started":1}
I20260807 10:41:31.951601 21165 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 10:41:31.953336 10362 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4441110019364c00ba4911aa72b87ade [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4441110019364c00ba4911aa72b87ade" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37095 } }
I20260807 10:41:31.953730 10362 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4441110019364c00ba4911aa72b87ade [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:41:31.953841 10362 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4441110019364c00ba4911aa72b87ade [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4441110019364c00ba4911aa72b87ade, State: Initialized, Role: FOLLOWER
I20260807 10:41:31.954586 10362 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4441110019364c00ba4911aa72b87ade [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4441110019364c00ba4911aa72b87ade" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37095 } }
I20260807 10:41:31.954916 10362 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4441110019364c00ba4911aa72b87ade [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 10:41:31.955081 10362 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4441110019364c00ba4911aa72b87ade [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 10:41:31.955260 10362 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4441110019364c00ba4911aa72b87ade [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:41:31.958724 10362 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4441110019364c00ba4911aa72b87ade [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4441110019364c00ba4911aa72b87ade" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37095 } }
I20260807 10:41:31.959419 10362 leader_election.cc:302] T 00000000000000000000000000000000 P 4441110019364c00ba4911aa72b87ade [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4441110019364c00ba4911aa72b87ade; no voters:
I20260807 10:41:31.960103 10362 leader_election.cc:288] T 00000000000000000000000000000000 P 4441110019364c00ba4911aa72b87ade [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 10:41:31.960286 10372 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4441110019364c00ba4911aa72b87ade [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:41:31.962342 10362 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4441110019364c00ba4911aa72b87ade [sys.catalog]: configured and running, proceeding with master startup.
I20260807 10:41:31.967873 10372 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4441110019364c00ba4911aa72b87ade [term 1 LEADER]: Becoming Leader. State: Replica: 4441110019364c00ba4911aa72b87ade, State: Running, Role: LEADER
I20260807 10:41:31.968786 10372 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4441110019364c00ba4911aa72b87ade [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4441110019364c00ba4911aa72b87ade" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37095 } }
I20260807 10:41:31.973774 10374 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4441110019364c00ba4911aa72b87ade [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4441110019364c00ba4911aa72b87ade. Latest consensus state: current_term: 1 leader_uuid: "4441110019364c00ba4911aa72b87ade" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4441110019364c00ba4911aa72b87ade" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37095 } } }
I20260807 10:41:31.974346 10374 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4441110019364c00ba4911aa72b87ade [sys.catalog]: This master's current role is: LEADER
I20260807 10:41:31.977643 10373 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4441110019364c00ba4911aa72b87ade [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4441110019364c00ba4911aa72b87ade" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4441110019364c00ba4911aa72b87ade" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37095 } } }
I20260807 10:41:31.978050 10373 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4441110019364c00ba4911aa72b87ade [sys.catalog]: This master's current role is: LEADER
I20260807 10:41:31.978094 10365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:31.956443 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.101:51465 (local address 127.0.0.1:37095)
0807 10:41:31.956686 (+ 243us) server_negotiation.cc:206] Beginning negotiation
0807 10:41:31.956693 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:41:31.957083 (+ 390us) server_negotiation.cc:407] Connection header received
0807 10:41:31.957256 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:41:31.957259 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:41:31.957329 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:41:31.957413 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:41:31.959420 (+ 2007us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:31.960572 (+ 1152us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:31.963132 (+ 2560us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:31.964127 (+ 995us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:31.965248 (+ 1121us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:31.968624 (+ 3376us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:41:31.968633 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:41:31.968638 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:41:31.968679 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:41:31.973440 (+ 4761us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:41:31.974637 (+ 1197us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:41:31.974644 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:41:31.974651 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:41:31.974837 (+ 186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:41:31.975577 (+ 740us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:41:31.975586 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:41:31.975592 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:41:31.976148 (+ 556us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:41:31.976518 (+ 370us) server_negotiation.cc:1035] Waiting for connection context
0807 10:41:31.977570 (+ 1052us) server_negotiation.cc:299] Negotiation successful
0807 10:41:31.977755 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260807 10:41:31.979997 10383 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 10:41:31.984889 10383 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 10:41:31.993898 10383 catalog_manager.cc:1347] Generated new cluster ID: 0f0e8cbb39544ea48d4823e1dc66891f
I20260807 10:41:31.994045 10383 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 10:41:32.011355 10383 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 10:41:32.013443 10383 catalog_manager.cc:1504] Loading token signing keys...
I20260807 10:41:32.029336 10383 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4441110019364c00ba4911aa72b87ade: Generated new TSK 0
I20260807 10:41:32.030529 10383 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 10:41:32.040187 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 10293
I20260807 10:41:32.041553 10357 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:41:32.136233 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 10293
W20260807 10:41:32.157790 10278 connection.cc:535] client connection to 127.0.0.1:37095 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:37095): Connection reset by peer (error 104)
2026-08-07T10:41:32Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (2225 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786098956060137-21165-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 10:41:32 dist-test-slave-0b58 krb5kdc[10395](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 10:41:32 dist-test-slave-0b58 krb5kdc[10395](info): set up 2 sockets
Aug 07 10:41:32 dist-test-slave-0b58 krb5kdc[10395](info): commencing operation
krb5kdc: starting...
W20260807 10:41:33.307353 21165 mini_kdc.cc:121] Time spent starting KDC: real 1.129s user 0.000s sys 0.057s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786098956060137-21165-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786098956060137-21165-0/krb5kdc/test-user.keytab.
Aug 07 10:41:33 dist-test-slave-0b58 krb5kdc[10395](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099293, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T10:41:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T10:41:33Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786098956060137-21165-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786098956060137-21165-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 10:41:33.692215 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786098956060137-21165-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786098956060137-21165-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786098956060137-21165-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42131
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786098956060137-21165-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:41991
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42131
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786098956060137-21165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786098956060137-21165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786098956060137-21165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:41:34.052238 10409 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:41:34.052582 10409 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:41:34.052680 10409 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:41:34.060999 10409 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 10:41:34.061133 10409 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:41:34.061182 10409 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:41:34.061247 10409 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 10:41:34.061295 10409 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 10:41:34.071926 10409 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:41991
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786098956060137-21165-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786098956060137-21165-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42131
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786098956060137-21165-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42131
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786098956060137-21165-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:41:34.073441 10409 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:41:34.074802 10409 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:41:34.087420 10417 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:41:34.087380 10415 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:41:34.087792 10414 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:41:34.088599 10409 server_base.cc:1034] running on GCE node
I20260807 10:41:34.089514 10409 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:41:34.091058 10409 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:41:34.092346 10409 hybrid_clock.cc:648] HybridClock initialized: now 1786099294092241 us; error 36 us; skew 500 ppm
I20260807 10:41:34.092727 10409 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:41:34 dist-test-slave-0b58 krb5kdc[10395](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099294, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:41:34.096072 10409 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 10:41:34.097744 10409 webserver.cc:460] Webserver started at http://127.0.0.1:39405/ using document root <none> and password file <none>
I20260807 10:41:34.098493 10409 fs_manager.cc:359] Metadata directory not provided
I20260807 10:41:34.098654 10409 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:41:34.098985 10409 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:41:34.102270 10409 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786098956060137-21165-0/minicluster-data/master-0/data/instance:
uuid: "b2e6ea4412874d198564a2f12afddcde"
format_stamp: "Formatted at 2026-08-07 10:41:34 on dist-test-slave-0b58"
server_key: "f33ac776c67573d7f4860eaf550a7b4f"
server_key_iv: "04e809d305d88f6fbf67606101d08f8d"
server_key_version: "encryptionkey@0"
I20260807 10:41:34.103118 10409 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786098956060137-21165-0/minicluster-data/master-0/wal/instance:
uuid: "b2e6ea4412874d198564a2f12afddcde"
format_stamp: "Formatted at 2026-08-07 10:41:34 on dist-test-slave-0b58"
server_key: "f33ac776c67573d7f4860eaf550a7b4f"
server_key_iv: "04e809d305d88f6fbf67606101d08f8d"
server_key_version: "encryptionkey@0"
I20260807 10:41:34.108844 10409 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.005s
I20260807 10:41:34.112465 10424 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:41:34.113790 10409 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260807 10:41:34.113986 10409 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786098956060137-21165-0/minicluster-data/master-0/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786098956060137-21165-0/minicluster-data/master-0/wal
uuid: "b2e6ea4412874d198564a2f12afddcde"
format_stamp: "Formatted at 2026-08-07 10:41:34 on dist-test-slave-0b58"
server_key: "f33ac776c67573d7f4860eaf550a7b4f"
server_key_iv: "04e809d305d88f6fbf67606101d08f8d"
server_key_version: "encryptionkey@0"
I20260807 10:41:34.114207 10409 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786098956060137-21165-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786098956060137-21165-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786098956060137-21165-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:41:34.134147 10409 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:41:34.138864 10409 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:41:34.139254 10409 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:41:34.160356 10409 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42131
I20260807 10:41:34.160421 10476 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42131 every 8 connection(s)
I20260807 10:41:34.161855 10409 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
I20260807 10:41:34.165759 10477 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:41:34.170034 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 10409
I20260807 10:41:34.170249 21165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786098956060137-21165-0/minicluster-data/master-0/wal/instance
I20260807 10:41:34.170711 21165 external_mini_cluster.cc:1428] Setting key d910ed5cec5f59fddeac24857f205165
I20260807 10:41:34.178830 10477 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b2e6ea4412874d198564a2f12afddcde: Bootstrap starting.
I20260807 10:41:34.182149 10477 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b2e6ea4412874d198564a2f12afddcde: Neither blocks nor log segments found. Creating new log.
I20260807 10:41:34.183404 10477 log.cc:824] T 00000000000000000000000000000000 P b2e6ea4412874d198564a2f12afddcde: Log is configured to *not* fsync() on all Append() calls
I20260807 10:41:34.184020 10480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:34.172601 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.101:44781 (local address 127.0.0.1:42131)
0807 10:41:34.173404 (+ 803us) server_negotiation.cc:206] Beginning negotiation
0807 10:41:34.173416 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 10:41:34.173459 (+ 43us) server_negotiation.cc:407] Connection header received
0807 10:41:34.175138 (+ 1679us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:41:34.175162 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:41:34.175605 (+ 443us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:41:34.176014 (+ 409us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:41:34.176664 (+ 650us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:34.177992 (+ 1328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:34.179442 (+ 1450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:34.180124 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:34.180385 (+ 261us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:34.181661 (+ 1276us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:41:34.181669 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:41:34.181683 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:41:34.182213 (+ 530us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:41:34.182328 (+ 115us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:41:34.182366 (+ 38us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:41:34.182568 (+ 202us) server_negotiation.cc:1035] Waiting for connection context
0807 10:41:34.182841 (+ 273us) server_negotiation.cc:299] Negotiation successful
0807 10:41:34.183005 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":584,"thread_start_us":355,"threads_started":1}
I20260807 10:41:34.186471 10477 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b2e6ea4412874d198564a2f12afddcde: No bootstrap required, opened a new log
I20260807 10:41:34.187996 21165 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 10:41:34.195410 10477 raft_consensus.cc:348] T 00000000000000000000000000000000 P b2e6ea4412874d198564a2f12afddcde [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b2e6ea4412874d198564a2f12afddcde" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42131 } }
I20260807 10:41:34.195981 10477 raft_consensus.cc:374] T 00000000000000000000000000000000 P b2e6ea4412874d198564a2f12afddcde [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:41:34.196099 10477 raft_consensus.cc:729] T 00000000000000000000000000000000 P b2e6ea4412874d198564a2f12afddcde [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2e6ea4412874d198564a2f12afddcde, State: Initialized, Role: FOLLOWER
I20260807 10:41:34.196774 10477 consensus_queue.cc:260] T 00000000000000000000000000000000 P b2e6ea4412874d198564a2f12afddcde [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b2e6ea4412874d198564a2f12afddcde" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42131 } }
I20260807 10:41:34.197032 10477 raft_consensus.cc:388] T 00000000000000000000000000000000 P b2e6ea4412874d198564a2f12afddcde [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 10:41:34.197211 10477 raft_consensus.cc:482] T 00000000000000000000000000000000 P b2e6ea4412874d198564a2f12afddcde [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 10:41:34.197412 10477 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b2e6ea4412874d198564a2f12afddcde [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:41:34.200099 10480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:34.192682 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.101:46867 (local address 127.0.0.1:42131)
0807 10:41:34.192910 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0807 10:41:34.192916 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:41:34.193373 (+ 457us) server_negotiation.cc:407] Connection header received
0807 10:41:34.193532 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:41:34.193542 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:41:34.193643 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:41:34.193763 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:41:34.194311 (+ 548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:34.195438 (+ 1127us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:34.197237 (+ 1799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:34.198018 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:34.198162 (+ 144us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:34.199284 (+ 1122us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:41:34.199292 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:41:34.199302 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:41:34.199328 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:41:34.199376 (+ 48us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:41:34.199407 (+ 31us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:41:34.199539 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0807 10:41:34.199697 (+ 158us) server_negotiation.cc:299] Negotiation successful
0807 10:41:34.199753 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":78}
I20260807 10:41:34.200693 10477 raft_consensus.cc:504] T 00000000000000000000000000000000 P b2e6ea4412874d198564a2f12afddcde [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b2e6ea4412874d198564a2f12afddcde" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42131 } }
I20260807 10:41:34.201261 10477 leader_election.cc:302] T 00000000000000000000000000000000 P b2e6ea4412874d198564a2f12afddcde [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b2e6ea4412874d198564a2f12afddcde; no voters:
I20260807 10:41:34.201917 10477 leader_election.cc:288] T 00000000000000000000000000000000 P b2e6ea4412874d198564a2f12afddcde [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 10:41:34.202087 10487 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b2e6ea4412874d198564a2f12afddcde [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:41:34.202869 10487 raft_consensus.cc:686] T 00000000000000000000000000000000 P b2e6ea4412874d198564a2f12afddcde [term 1 LEADER]: Becoming Leader. State: Replica: b2e6ea4412874d198564a2f12afddcde, State: Running, Role: LEADER
I20260807 10:41:34.203550 10487 consensus_queue.cc:237] T 00000000000000000000000000000000 P b2e6ea4412874d198564a2f12afddcde [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b2e6ea4412874d198564a2f12afddcde" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42131 } }
I20260807 10:41:34.204512 10477 sys_catalog.cc:564] T 00000000000000000000000000000000 P b2e6ea4412874d198564a2f12afddcde [sys.catalog]: configured and running, proceeding with master startup.
I20260807 10:41:34.206634 10488 sys_catalog.cc:455] T 00000000000000000000000000000000 P b2e6ea4412874d198564a2f12afddcde [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b2e6ea4412874d198564a2f12afddcde" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b2e6ea4412874d198564a2f12afddcde" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42131 } } }
I20260807 10:41:34.206643 10489 sys_catalog.cc:455] T 00000000000000000000000000000000 P b2e6ea4412874d198564a2f12afddcde [sys.catalog]: SysCatalogTable state changed. Reason: New leader b2e6ea4412874d198564a2f12afddcde. Latest consensus state: current_term: 1 leader_uuid: "b2e6ea4412874d198564a2f12afddcde" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b2e6ea4412874d198564a2f12afddcde" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42131 } } }
I20260807 10:41:34.207195 10488 sys_catalog.cc:458] T 00000000000000000000000000000000 P b2e6ea4412874d198564a2f12afddcde [sys.catalog]: This master's current role is: LEADER
I20260807 10:41:34.207191 10489 sys_catalog.cc:458] T 00000000000000000000000000000000 P b2e6ea4412874d198564a2f12afddcde [sys.catalog]: This master's current role is: LEADER
I20260807 10:41:34.209285 10492 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 10:41:34.214887 10492 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 10:41:34.228827 10492 catalog_manager.cc:1347] Generated new cluster ID: e850a7a29547494e9db8680e81c73c71
I20260807 10:41:34.228969 10492 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 10:41:34.241096 10492 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 10:41:34.242651 10492 catalog_manager.cc:1504] Loading token signing keys...
I20260807 10:41:34.251338 10492 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b2e6ea4412874d198564a2f12afddcde: Generated new TSK 0
I20260807 10:41:34.252355 10492 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 10:41:34.259582 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 10409
W20260807 10:41:34.260833 10472 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.101:44781
W20260807 10:41:34.261695 21165 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 10409: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260807 10:41:34.261864 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 10409
W20260807 10:41:34.282823 10393 connection.cc:535] client connection to 127.0.0.1:42131 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:42131): Connection reset by peer (error 104)
2026-08-07T10:41:34Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (2124 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786098956060137-21165-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 10:41:34 dist-test-slave-0b58 krb5kdc[10508](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 10:41:34 dist-test-slave-0b58 krb5kdc[10508](info): set up 2 sockets
Aug 07 10:41:34 dist-test-slave-0b58 krb5kdc[10508](info): commencing operation
krb5kdc: starting...
W20260807 10:41:35.443486 21165 mini_kdc.cc:121] Time spent starting KDC: real 1.141s user 0.000s sys 0.059s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786098956060137-21165-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786098956060137-21165-0/krb5kdc/test-user.keytab.
Aug 07 10:41:35 dist-test-slave-0b58 krb5kdc[10508](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099295, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T10:41:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T10:41:35Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786098956060137-21165-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786098956060137-21165-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 10:41:35.820873 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786098956060137-21165-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786098956060137-21165-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786098956060137-21165-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33589
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786098956060137-21165-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40273
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:33589
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786098956060137-21165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786098956060137-21165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786098956060137-21165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:41:36.187824 10521 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:41:36.188122 10521 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:41:36.188339 10521 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:41:36.196000 10521 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 10:41:36.196134 10521 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:41:36.196313 10521 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:41:36.196432 10521 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 10:41:36.196523 10521 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 10:41:36.206631 10521 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40273
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786098956060137-21165-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786098956060137-21165-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:33589
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786098956060137-21165-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33589
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786098956060137-21165-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:41:36.207993 10521 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:41:36.209357 10521 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:41:36.221532 10527 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:41:36.221633 10531 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:41:36.221596 10529 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:41:36.222846 10521 server_base.cc:1034] running on GCE node
I20260807 10:41:36.224104 10521 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:41:36.225752 10521 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:41:36.226977 10521 hybrid_clock.cc:648] HybridClock initialized: now 1786099296226923 us; error 47 us; skew 500 ppm
I20260807 10:41:36.227458 10521 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:41:36 dist-test-slave-0b58 krb5kdc[10508](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099296, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:41:36.236555 10521 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 10:41:36.238214 10521 webserver.cc:460] Webserver started at http://127.0.0.1:35545/ using document root <none> and password file <none>
I20260807 10:41:36.238976 10521 fs_manager.cc:359] Metadata directory not provided
I20260807 10:41:36.239082 10521 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:41:36.239338 10521 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:41:36.242530 10521 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786098956060137-21165-0/minicluster-data/master-0/data/instance:
uuid: "22efc72b05f548c8b437a7a83c60dbae"
format_stamp: "Formatted at 2026-08-07 10:41:36 on dist-test-slave-0b58"
server_key: "1e81df21550b2539ad8cad687bcc50a2"
server_key_iv: "43566b286eb1da6350e95a75a56a9c67"
server_key_version: "encryptionkey@0"
I20260807 10:41:36.243286 10521 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786098956060137-21165-0/minicluster-data/master-0/wal/instance:
uuid: "22efc72b05f548c8b437a7a83c60dbae"
format_stamp: "Formatted at 2026-08-07 10:41:36 on dist-test-slave-0b58"
server_key: "1e81df21550b2539ad8cad687bcc50a2"
server_key_iv: "43566b286eb1da6350e95a75a56a9c67"
server_key_version: "encryptionkey@0"
I20260807 10:41:36.248935 10521 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.003s
I20260807 10:41:36.252394 10538 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:41:36.253695 10521 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260807 10:41:36.253882 10521 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786098956060137-21165-0/minicluster-data/master-0/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786098956060137-21165-0/minicluster-data/master-0/wal
uuid: "22efc72b05f548c8b437a7a83c60dbae"
format_stamp: "Formatted at 2026-08-07 10:41:36 on dist-test-slave-0b58"
server_key: "1e81df21550b2539ad8cad687bcc50a2"
server_key_iv: "43566b286eb1da6350e95a75a56a9c67"
server_key_version: "encryptionkey@0"
I20260807 10:41:36.254097 10521 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786098956060137-21165-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786098956060137-21165-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786098956060137-21165-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:41:36.259820 10521 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:41:36.264156 10521 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:41:36.264518 10521 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:41:36.283752 10521 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:33589
I20260807 10:41:36.283798 10590 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:33589 every 8 connection(s)
I20260807 10:41:36.285387 10521 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
I20260807 10:41:36.288051 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 10521
I20260807 10:41:36.288285 21165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786098956060137-21165-0/minicluster-data/master-0/wal/instance
I20260807 10:41:36.288846 21165 external_mini_cluster.cc:1428] Setting key 34abf50b7f210f1387a6874251e67a88
I20260807 10:41:36.289815 10591 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:41:36.296756 10594 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:36.290699 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.101:47531 (local address 127.0.0.1:33589)
0807 10:41:36.291617 (+ 918us) server_negotiation.cc:206] Beginning negotiation
0807 10:41:36.291628 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 10:41:36.291671 (+ 43us) server_negotiation.cc:407] Connection header received
0807 10:41:36.293318 (+ 1647us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:41:36.293339 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:41:36.293680 (+ 341us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:41:36.294008 (+ 328us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:41:36.295082 (+ 1074us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:41:36.295088 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:41:36.295100 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:41:36.295114 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:41:36.295193 (+ 79us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:41:36.295236 (+ 43us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:41:36.295402 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0807 10:41:36.295521 (+ 119us) server_negotiation.cc:299] Negotiation successful
0807 10:41:36.295742 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":614,"thread_start_us":385,"threads_started":1}
I20260807 10:41:36.300680 21165 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 10:41:36.304028 10591 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 22efc72b05f548c8b437a7a83c60dbae: Bootstrap starting.
I20260807 10:41:36.307874 10591 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 22efc72b05f548c8b437a7a83c60dbae: Neither blocks nor log segments found. Creating new log.
I20260807 10:41:36.308306 10594 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:36.305475 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.101:55111 (local address 127.0.0.1:33589)
0807 10:41:36.305651 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0807 10:41:36.305655 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 10:41:36.306163 (+ 508us) server_negotiation.cc:407] Connection header received
0807 10:41:36.306403 (+ 240us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:41:36.306407 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:41:36.306462 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:41:36.306573 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:41:36.307620 (+ 1047us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:41:36.307625 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:41:36.307628 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:41:36.307644 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:41:36.307684 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:41:36.307698 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:41:36.307824 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0807 10:41:36.307937 (+ 113us) server_negotiation.cc:299] Negotiation successful
0807 10:41:36.308001 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260807 10:41:36.309238 10591 log.cc:824] T 00000000000000000000000000000000 P 22efc72b05f548c8b437a7a83c60dbae: Log is configured to *not* fsync() on all Append() calls
I20260807 10:41:36.312173 10591 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 22efc72b05f548c8b437a7a83c60dbae: No bootstrap required, opened a new log
I20260807 10:41:36.320031 10591 raft_consensus.cc:348] T 00000000000000000000000000000000 P 22efc72b05f548c8b437a7a83c60dbae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "22efc72b05f548c8b437a7a83c60dbae" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33589 } }
I20260807 10:41:36.320587 10591 raft_consensus.cc:374] T 00000000000000000000000000000000 P 22efc72b05f548c8b437a7a83c60dbae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:41:36.320698 10591 raft_consensus.cc:729] T 00000000000000000000000000000000 P 22efc72b05f548c8b437a7a83c60dbae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22efc72b05f548c8b437a7a83c60dbae, State: Initialized, Role: FOLLOWER
I20260807 10:41:36.321455 10591 consensus_queue.cc:260] T 00000000000000000000000000000000 P 22efc72b05f548c8b437a7a83c60dbae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "22efc72b05f548c8b437a7a83c60dbae" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33589 } }
I20260807 10:41:36.321681 10591 raft_consensus.cc:388] T 00000000000000000000000000000000 P 22efc72b05f548c8b437a7a83c60dbae [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 10:41:36.321789 10591 raft_consensus.cc:482] T 00000000000000000000000000000000 P 22efc72b05f548c8b437a7a83c60dbae [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 10:41:36.321914 10591 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 22efc72b05f548c8b437a7a83c60dbae [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:41:36.324062 10591 raft_consensus.cc:504] T 00000000000000000000000000000000 P 22efc72b05f548c8b437a7a83c60dbae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "22efc72b05f548c8b437a7a83c60dbae" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33589 } }
I20260807 10:41:36.324592 10591 leader_election.cc:302] T 00000000000000000000000000000000 P 22efc72b05f548c8b437a7a83c60dbae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 22efc72b05f548c8b437a7a83c60dbae; no voters:
I20260807 10:41:36.325183 10591 leader_election.cc:288] T 00000000000000000000000000000000 P 22efc72b05f548c8b437a7a83c60dbae [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 10:41:36.325328 10601 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 22efc72b05f548c8b437a7a83c60dbae [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:41:36.326076 10601 raft_consensus.cc:686] T 00000000000000000000000000000000 P 22efc72b05f548c8b437a7a83c60dbae [term 1 LEADER]: Becoming Leader. State: Replica: 22efc72b05f548c8b437a7a83c60dbae, State: Running, Role: LEADER
I20260807 10:41:36.326679 10601 consensus_queue.cc:237] T 00000000000000000000000000000000 P 22efc72b05f548c8b437a7a83c60dbae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "22efc72b05f548c8b437a7a83c60dbae" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33589 } }
I20260807 10:41:36.327680 10591 sys_catalog.cc:564] T 00000000000000000000000000000000 P 22efc72b05f548c8b437a7a83c60dbae [sys.catalog]: configured and running, proceeding with master startup.
I20260807 10:41:36.329861 10603 sys_catalog.cc:455] T 00000000000000000000000000000000 P 22efc72b05f548c8b437a7a83c60dbae [sys.catalog]: SysCatalogTable state changed. Reason: New leader 22efc72b05f548c8b437a7a83c60dbae. Latest consensus state: current_term: 1 leader_uuid: "22efc72b05f548c8b437a7a83c60dbae" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "22efc72b05f548c8b437a7a83c60dbae" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33589 } } }
I20260807 10:41:36.329834 10602 sys_catalog.cc:455] T 00000000000000000000000000000000 P 22efc72b05f548c8b437a7a83c60dbae [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "22efc72b05f548c8b437a7a83c60dbae" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "22efc72b05f548c8b437a7a83c60dbae" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33589 } } }
I20260807 10:41:36.330320 10603 sys_catalog.cc:458] T 00000000000000000000000000000000 P 22efc72b05f548c8b437a7a83c60dbae [sys.catalog]: This master's current role is: LEADER
I20260807 10:41:36.330334 10602 sys_catalog.cc:458] T 00000000000000000000000000000000 P 22efc72b05f548c8b437a7a83c60dbae [sys.catalog]: This master's current role is: LEADER
I20260807 10:41:36.331946 10607 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 10:41:36.337520 10607 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 10:41:36.346644 10607 catalog_manager.cc:1347] Generated new cluster ID: 2c7efb2b8b1747b4afb0119269b35d76
I20260807 10:41:36.346755 10607 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 10:41:36.360606 10607 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 10:41:36.361047 10607 catalog_manager.cc:1504] Loading token signing keys...
I20260807 10:41:36.371423 10607 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 22efc72b05f548c8b437a7a83c60dbae: Generated new TSK 0
I20260807 10:41:36.372301 10607 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 10:41:36.383781 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 10521
W20260807 10:41:36.385099 10586 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.101:47531
W20260807 10:41:36.385851 21165 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 10521: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260807 10:41:36.386003 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 10521
2026-08-07T10:41:36Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (2123 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786098956060137-21165-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 10:41:36 dist-test-slave-0b58 krb5kdc[10623](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 10:41:36 dist-test-slave-0b58 krb5kdc[10623](info): set up 2 sockets
Aug 07 10:41:36 dist-test-slave-0b58 krb5kdc[10623](info): commencing operation
krb5kdc: starting...
W20260807 10:41:37.546478 21165 mini_kdc.cc:121] Time spent starting KDC: real 1.120s user 0.003s sys 0.053s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786098956060137-21165-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786098956060137-21165-0/krb5kdc/test-user.keytab.
Aug 07 10:41:37 dist-test-slave-0b58 krb5kdc[10623](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099297, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T10:41:37Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T10:41:37Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786098956060137-21165-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786098956060137-21165-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 10:41:37.901742 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786098956060137-21165-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786098956060137-21165-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786098956060137-21165-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34673
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786098956060137-21165-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:43035
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:34673
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786098956060137-21165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786098956060137-21165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786098956060137-21165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:41:38.261070 10637 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:41:38.261363 10637 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:41:38.261457 10637 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:41:38.268980 10637 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 10:41:38.269096 10637 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:41:38.269151 10637 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:41:38.269227 10637 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 10:41:38.269270 10637 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 10:41:38.279423 10637 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:43035
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786098956060137-21165-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786098956060137-21165-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:34673
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786098956060137-21165-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34673
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786098956060137-21165-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:41:38.280777 10637 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:41:38.282006 10637 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:41:38.293756 10642 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:41:38.293865 10645 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:41:38.294044 10643 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:41:38.295118 10637 server_base.cc:1034] running on GCE node
I20260807 10:41:38.295840 10637 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:41:38.297236 10637 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:41:38.298488 10637 hybrid_clock.cc:648] HybridClock initialized: now 1786099298298433 us; error 39 us; skew 500 ppm
I20260807 10:41:38.298875 10637 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:41:38 dist-test-slave-0b58 krb5kdc[10623](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099298, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:41:38.302059 10637 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 10:41:38.303534 10637 webserver.cc:460] Webserver started at http://127.0.0.1:42793/ using document root <none> and password file <none>
I20260807 10:41:38.304168 10637 fs_manager.cc:359] Metadata directory not provided
I20260807 10:41:38.304349 10637 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:41:38.304615 10637 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:41:38.307488 10637 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786098956060137-21165-0/minicluster-data/master-0/data/instance:
uuid: "19335c42d39c433ca679e35ab595ab2d"
format_stamp: "Formatted at 2026-08-07 10:41:38 on dist-test-slave-0b58"
server_key: "46ec68f0907023e4a607a3733ed59a2f"
server_key_iv: "e75f3b672f8af26ec2716423ec18d9db"
server_key_version: "encryptionkey@0"
I20260807 10:41:38.308205 10637 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786098956060137-21165-0/minicluster-data/master-0/wal/instance:
uuid: "19335c42d39c433ca679e35ab595ab2d"
format_stamp: "Formatted at 2026-08-07 10:41:38 on dist-test-slave-0b58"
server_key: "46ec68f0907023e4a607a3733ed59a2f"
server_key_iv: "e75f3b672f8af26ec2716423ec18d9db"
server_key_version: "encryptionkey@0"
I20260807 10:41:38.313251 10637 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260807 10:41:38.316708 10652 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:41:38.318017 10637 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260807 10:41:38.318212 10637 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786098956060137-21165-0/minicluster-data/master-0/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786098956060137-21165-0/minicluster-data/master-0/wal
uuid: "19335c42d39c433ca679e35ab595ab2d"
format_stamp: "Formatted at 2026-08-07 10:41:38 on dist-test-slave-0b58"
server_key: "46ec68f0907023e4a607a3733ed59a2f"
server_key_iv: "e75f3b672f8af26ec2716423ec18d9db"
server_key_version: "encryptionkey@0"
I20260807 10:41:38.318423 10637 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786098956060137-21165-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786098956060137-21165-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786098956060137-21165-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:41:38.342585 10637 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:41:38.347230 10637 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:41:38.347476 10637 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:41:38.366117 10637 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:34673
I20260807 10:41:38.366161 10705 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:34673 every 8 connection(s)
I20260807 10:41:38.367657 10637 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
I20260807 10:41:38.371590 10706 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:41:38.377792 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 10637
I20260807 10:41:38.378008 21165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786098956060137-21165-0/minicluster-data/master-0/wal/instance
I20260807 10:41:38.378561 21165 external_mini_cluster.cc:1428] Setting key 6cc642daba5a09ce8c2d895914ffb005
I20260807 10:41:38.383126 10706 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 19335c42d39c433ca679e35ab595ab2d: Bootstrap starting.
I20260807 10:41:38.387012 10706 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 19335c42d39c433ca679e35ab595ab2d: Neither blocks nor log segments found. Creating new log.
I20260807 10:41:38.388304 10706 log.cc:824] T 00000000000000000000000000000000 P 19335c42d39c433ca679e35ab595ab2d: Log is configured to *not* fsync() on all Append() calls
I20260807 10:41:38.391678 10706 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 19335c42d39c433ca679e35ab595ab2d: No bootstrap required, opened a new log
Aug 07 10:41:38 dist-test-slave-0b58 krb5kdc[10623](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099297, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260807 10:41:38.400565 10706 raft_consensus.cc:348] T 00000000000000000000000000000000 P 19335c42d39c433ca679e35ab595ab2d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "19335c42d39c433ca679e35ab595ab2d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34673 } }
I20260807 10:41:38.400978 10706 raft_consensus.cc:374] T 00000000000000000000000000000000 P 19335c42d39c433ca679e35ab595ab2d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:41:38.401118 10706 raft_consensus.cc:729] T 00000000000000000000000000000000 P 19335c42d39c433ca679e35ab595ab2d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19335c42d39c433ca679e35ab595ab2d, State: Initialized, Role: FOLLOWER
I20260807 10:41:38.401815 10706 consensus_queue.cc:260] T 00000000000000000000000000000000 P 19335c42d39c433ca679e35ab595ab2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "19335c42d39c433ca679e35ab595ab2d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34673 } }
I20260807 10:41:38.402086 10706 raft_consensus.cc:388] T 00000000000000000000000000000000 P 19335c42d39c433ca679e35ab595ab2d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 10:41:38.402275 10706 raft_consensus.cc:482] T 00000000000000000000000000000000 P 19335c42d39c433ca679e35ab595ab2d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 10:41:38.402506 10706 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 19335c42d39c433ca679e35ab595ab2d [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:41:38.403710 10709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:38.380643 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.101:44817 (local address 127.0.0.1:34673)
0807 10:41:38.381523 (+ 880us) server_negotiation.cc:206] Beginning negotiation
0807 10:41:38.381535 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 10:41:38.381576 (+ 41us) server_negotiation.cc:407] Connection header received
0807 10:41:38.383430 (+ 1854us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:41:38.383459 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:41:38.383844 (+ 385us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:41:38.384186 (+ 342us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:41:38.386127 (+ 1941us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:38.387571 (+ 1444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:38.389469 (+ 1898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:38.390229 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:38.390363 (+ 134us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:38.395394 (+ 5031us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:41:38.395404 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:41:38.395423 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:41:38.395468 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:41:38.398843 (+ 3375us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:41:38.399741 (+ 898us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:41:38.399748 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:41:38.399754 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:41:38.399942 (+ 188us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:41:38.400527 (+ 585us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:41:38.400530 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:41:38.400533 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:41:38.401261 (+ 728us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:41:38.401622 (+ 361us) server_negotiation.cc:1035] Waiting for connection context
0807 10:41:38.402165 (+ 543us) server_negotiation.cc:299] Negotiation successful
0807 10:41:38.402553 (+ 388us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":653,"thread_start_us":426,"threads_started":1}
I20260807 10:41:38.405202 10706 raft_consensus.cc:504] T 00000000000000000000000000000000 P 19335c42d39c433ca679e35ab595ab2d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "19335c42d39c433ca679e35ab595ab2d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34673 } }
I20260807 10:41:38.405751 10706 leader_election.cc:302] T 00000000000000000000000000000000 P 19335c42d39c433ca679e35ab595ab2d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 19335c42d39c433ca679e35ab595ab2d; no voters:
I20260807 10:41:38.406493 10706 leader_election.cc:288] T 00000000000000000000000000000000 P 19335c42d39c433ca679e35ab595ab2d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 10:41:38.406636 10711 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 19335c42d39c433ca679e35ab595ab2d [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:41:38.407831 10711 raft_consensus.cc:686] T 00000000000000000000000000000000 P 19335c42d39c433ca679e35ab595ab2d [term 1 LEADER]: Becoming Leader. State: Replica: 19335c42d39c433ca679e35ab595ab2d, State: Running, Role: LEADER
I20260807 10:41:38.408241 21165 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 10:41:38.408727 10711 consensus_queue.cc:237] T 00000000000000000000000000000000 P 19335c42d39c433ca679e35ab595ab2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "19335c42d39c433ca679e35ab595ab2d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34673 } }
I20260807 10:41:38.409060 10706 sys_catalog.cc:564] T 00000000000000000000000000000000 P 19335c42d39c433ca679e35ab595ab2d [sys.catalog]: configured and running, proceeding with master startup.
I20260807 10:41:38.414543 10712 sys_catalog.cc:455] T 00000000000000000000000000000000 P 19335c42d39c433ca679e35ab595ab2d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "19335c42d39c433ca679e35ab595ab2d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "19335c42d39c433ca679e35ab595ab2d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34673 } } }
I20260807 10:41:38.415035 10712 sys_catalog.cc:458] T 00000000000000000000000000000000 P 19335c42d39c433ca679e35ab595ab2d [sys.catalog]: This master's current role is: LEADER
I20260807 10:41:38.415228 10713 sys_catalog.cc:455] T 00000000000000000000000000000000 P 19335c42d39c433ca679e35ab595ab2d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 19335c42d39c433ca679e35ab595ab2d. Latest consensus state: current_term: 1 leader_uuid: "19335c42d39c433ca679e35ab595ab2d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "19335c42d39c433ca679e35ab595ab2d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34673 } } }
I20260807 10:41:38.415688 10713 sys_catalog.cc:458] T 00000000000000000000000000000000 P 19335c42d39c433ca679e35ab595ab2d [sys.catalog]: This master's current role is: LEADER
I20260807 10:41:38.423488 10725 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 10:41:38.429112 10725 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 10:41:38.439834 10725 catalog_manager.cc:1347] Generated new cluster ID: 85598d330a7342f5b0c71ee5f555c6f0
I20260807 10:41:38.439965 10725 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 10:41:38.449409 10709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:38.424680 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.101:52499 (local address 127.0.0.1:34673)
0807 10:41:38.424873 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0807 10:41:38.424879 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:41:38.432106 (+ 7227us) server_negotiation.cc:407] Connection header received
0807 10:41:38.433256 (+ 1150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:41:38.433265 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:41:38.433386 (+ 121us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:41:38.433514 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:41:38.436066 (+ 2552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:38.437248 (+ 1182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:38.439200 (+ 1952us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:38.439892 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:38.439995 (+ 103us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:38.442985 (+ 2990us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:41:38.442992 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:41:38.442996 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:41:38.443042 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:41:38.446213 (+ 3171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:41:38.447053 (+ 840us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:41:38.447060 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:41:38.447064 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:41:38.447235 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:41:38.447743 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:41:38.447747 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:41:38.447749 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:41:38.448047 (+ 298us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:41:38.448361 (+ 314us) server_negotiation.cc:1035] Waiting for connection context
0807 10:41:38.448774 (+ 413us) server_negotiation.cc:299] Negotiation successful
0807 10:41:38.448967 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260807 10:41:38.453727 10725 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 10:41:38.455117 10725 catalog_manager.cc:1504] Loading token signing keys...
I20260807 10:41:38.464000 10725 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 19335c42d39c433ca679e35ab595ab2d: Generated new TSK 0
I20260807 10:41:38.465147 10725 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 10:41:38.478103 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 10637
I20260807 10:41:38.479276 10701 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:41:38.571941 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 10637
W20260807 10:41:38.593897 10621 connection.cc:535] client connection to 127.0.0.1:34673 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:34673): Connection reset by peer (error 104)
2026-08-07T10:41:38Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (2186 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786098956060137-21165-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 10:41:38 dist-test-slave-0b58 krb5kdc[10740](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 10:41:38 dist-test-slave-0b58 krb5kdc[10740](info): set up 2 sockets
Aug 07 10:41:38 dist-test-slave-0b58 krb5kdc[10740](info): commencing operation
krb5kdc: starting...
W20260807 10:41:39.738847 21165 mini_kdc.cc:121] Time spent starting KDC: real 1.126s user 0.000s sys 0.055s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786098956060137-21165-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786098956060137-21165-0/krb5kdc/test-user.keytab.
Aug 07 10:41:39 dist-test-slave-0b58 krb5kdc[10740](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099299, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T10:41:40Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T10:41:40Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786098956060137-21165-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786098956060137-21165-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 10:41:40.107833 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786098956060137-21165-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786098956060137-21165-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786098956060137-21165-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35733
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786098956060137-21165-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:45477
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:35733
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786098956060137-21165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786098956060137-21165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786098956060137-21165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:41:40.462589 10755 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:41:40.462918 10755 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:41:40.463130 10755 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:41:40.470831 10755 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 10:41:40.470968 10755 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:41:40.471108 10755 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:41:40.471195 10755 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 10:41:40.471262 10755 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 10:41:40.481629 10755 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:45477
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786098956060137-21165-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786098956060137-21165-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:35733
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786098956060137-21165-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35733
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786098956060137-21165-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:41:40.483086 10755 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:41:40.484498 10755 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:41:40.497414 10761 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:41:40.497654 10763 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:41:40.497687 10760 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:41:40.498720 10755 server_base.cc:1034] running on GCE node
I20260807 10:41:40.499599 10755 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:41:40.501219 10755 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:41:40.502470 10755 hybrid_clock.cc:648] HybridClock initialized: now 1786099300502424 us; error 42 us; skew 500 ppm
I20260807 10:41:40.502844 10755 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:41:40 dist-test-slave-0b58 krb5kdc[10740](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099300, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:41:40.506295 10755 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 10:41:40.507861 10755 webserver.cc:460] Webserver started at http://127.0.0.1:46261/ using document root <none> and password file <none>
I20260807 10:41:40.508665 10755 fs_manager.cc:359] Metadata directory not provided
I20260807 10:41:40.508819 10755 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:41:40.509136 10755 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:41:40.512401 10755 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786098956060137-21165-0/minicluster-data/master-0/data/instance:
uuid: "5b2f7afe68b44be58c4d3081929c2504"
format_stamp: "Formatted at 2026-08-07 10:41:40 on dist-test-slave-0b58"
server_key: "7d2e50fbdb5d4476bf8c5b6a8dc19d64"
server_key_iv: "1d601438176d4dd0d013134890071dba"
server_key_version: "encryptionkey@0"
I20260807 10:41:40.513213 10755 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786098956060137-21165-0/minicluster-data/master-0/wal/instance:
uuid: "5b2f7afe68b44be58c4d3081929c2504"
format_stamp: "Formatted at 2026-08-07 10:41:40 on dist-test-slave-0b58"
server_key: "7d2e50fbdb5d4476bf8c5b6a8dc19d64"
server_key_iv: "1d601438176d4dd0d013134890071dba"
server_key_version: "encryptionkey@0"
I20260807 10:41:40.518811 10755 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260807 10:41:40.522675 10770 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:41:40.524097 10755 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 10:41:40.524384 10755 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786098956060137-21165-0/minicluster-data/master-0/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786098956060137-21165-0/minicluster-data/master-0/wal
uuid: "5b2f7afe68b44be58c4d3081929c2504"
format_stamp: "Formatted at 2026-08-07 10:41:40 on dist-test-slave-0b58"
server_key: "7d2e50fbdb5d4476bf8c5b6a8dc19d64"
server_key_iv: "1d601438176d4dd0d013134890071dba"
server_key_version: "encryptionkey@0"
I20260807 10:41:40.524624 10755 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786098956060137-21165-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786098956060137-21165-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786098956060137-21165-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:41:40.543919 10755 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:41:40.548889 10755 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:41:40.549149 10755 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:41:40.570197 10755 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:35733
I20260807 10:41:40.570232 10824 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:35733 every 8 connection(s)
I20260807 10:41:40.571707 10755 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
I20260807 10:41:40.574926 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 10755
I20260807 10:41:40.575120 21165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786098956060137-21165-0/minicluster-data/master-0/wal/instance
I20260807 10:41:40.575587 21165 external_mini_cluster.cc:1428] Setting key 57047ad1f1776e5c95a67140a7ebb74e
I20260807 10:41:40.575857 10825 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:41:40.590683 10825 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5b2f7afe68b44be58c4d3081929c2504: Bootstrap starting.
I20260807 10:41:40.591197 10829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:40.577534 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.101:41807 (local address 127.0.0.1:35733)
0807 10:41:40.578332 (+ 798us) server_negotiation.cc:206] Beginning negotiation
0807 10:41:40.578343 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 10:41:40.578386 (+ 43us) server_negotiation.cc:407] Connection header received
0807 10:41:40.580787 (+ 2401us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:41:40.580810 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:41:40.581346 (+ 536us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:41:40.581919 (+ 573us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:41:40.582646 (+ 727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:40.584892 (+ 2246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:40.586323 (+ 1431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:40.587059 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:40.587284 (+ 225us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:40.588739 (+ 1455us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:41:40.588749 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:41:40.588765 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:41:40.589355 (+ 590us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:41:40.589436 (+ 81us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:41:40.589463 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:41:40.589645 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0807 10:41:40.589945 (+ 300us) server_negotiation.cc:299] Negotiation successful
0807 10:41:40.590135 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":580,"thread_start_us":344,"threads_started":1}
I20260807 10:41:40.594637 10825 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5b2f7afe68b44be58c4d3081929c2504: Neither blocks nor log segments found. Creating new log.
I20260807 10:41:40.595748 21165 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 10:41:40.596135 10825 log.cc:824] T 00000000000000000000000000000000 P 5b2f7afe68b44be58c4d3081929c2504: Log is configured to *not* fsync() on all Append() calls
I20260807 10:41:40.599759 10825 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5b2f7afe68b44be58c4d3081929c2504: No bootstrap required, opened a new log
I20260807 10:41:40.608412 10829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:40.601127 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.101:60637 (local address 127.0.0.1:35733)
0807 10:41:40.601315 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0807 10:41:40.601321 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:41:40.601768 (+ 447us) server_negotiation.cc:407] Connection header received
0807 10:41:40.601918 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:41:40.601924 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:41:40.602017 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:41:40.602141 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:41:40.602663 (+ 522us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:40.603911 (+ 1248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:40.605370 (+ 1459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:40.606109 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:40.606267 (+ 158us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:40.607450 (+ 1183us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:41:40.607458 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:41:40.607463 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:41:40.607486 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:41:40.607550 (+ 64us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:41:40.607570 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:41:40.607682 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0807 10:41:40.607946 (+ 264us) server_negotiation.cc:299] Negotiation successful
0807 10:41:40.608008 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260807 10:41:40.610551 10825 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5b2f7afe68b44be58c4d3081929c2504 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5b2f7afe68b44be58c4d3081929c2504" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35733 } }
I20260807 10:41:40.610980 10825 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5b2f7afe68b44be58c4d3081929c2504 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:41:40.611107 10825 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5b2f7afe68b44be58c4d3081929c2504 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b2f7afe68b44be58c4d3081929c2504, State: Initialized, Role: FOLLOWER
I20260807 10:41:40.611716 10825 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5b2f7afe68b44be58c4d3081929c2504 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5b2f7afe68b44be58c4d3081929c2504" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35733 } }
I20260807 10:41:40.611981 10825 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5b2f7afe68b44be58c4d3081929c2504 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 10:41:40.612154 10825 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5b2f7afe68b44be58c4d3081929c2504 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 10:41:40.612360 10825 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5b2f7afe68b44be58c4d3081929c2504 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:41:40.614697 10825 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5b2f7afe68b44be58c4d3081929c2504 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5b2f7afe68b44be58c4d3081929c2504" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35733 } }
I20260807 10:41:40.615355 10825 leader_election.cc:302] T 00000000000000000000000000000000 P 5b2f7afe68b44be58c4d3081929c2504 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5b2f7afe68b44be58c4d3081929c2504; no voters:
I20260807 10:41:40.616065 10825 leader_election.cc:288] T 00000000000000000000000000000000 P 5b2f7afe68b44be58c4d3081929c2504 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 10:41:40.616163 10837 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5b2f7afe68b44be58c4d3081929c2504 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:41:40.617025 10837 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5b2f7afe68b44be58c4d3081929c2504 [term 1 LEADER]: Becoming Leader. State: Replica: 5b2f7afe68b44be58c4d3081929c2504, State: Running, Role: LEADER
I20260807 10:41:40.617662 10837 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5b2f7afe68b44be58c4d3081929c2504 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5b2f7afe68b44be58c4d3081929c2504" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35733 } }
I20260807 10:41:40.618471 10825 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5b2f7afe68b44be58c4d3081929c2504 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 10:41:40.620888 10838 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5b2f7afe68b44be58c4d3081929c2504 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5b2f7afe68b44be58c4d3081929c2504" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5b2f7afe68b44be58c4d3081929c2504" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35733 } } }
I20260807 10:41:40.621387 10838 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5b2f7afe68b44be58c4d3081929c2504 [sys.catalog]: This master's current role is: LEADER
I20260807 10:41:40.620884 10839 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5b2f7afe68b44be58c4d3081929c2504 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5b2f7afe68b44be58c4d3081929c2504. Latest consensus state: current_term: 1 leader_uuid: "5b2f7afe68b44be58c4d3081929c2504" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5b2f7afe68b44be58c4d3081929c2504" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35733 } } }
I20260807 10:41:40.621501 10839 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5b2f7afe68b44be58c4d3081929c2504 [sys.catalog]: This master's current role is: LEADER
I20260807 10:41:40.623525 10843 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 10:41:40.629863 10843 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 10:41:40.640792 10843 catalog_manager.cc:1347] Generated new cluster ID: 549e766e3ce94aefb144a60b7b7a6b8e
I20260807 10:41:40.641008 10843 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 10:41:40.657255 10843 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 10:41:40.659265 10843 catalog_manager.cc:1504] Loading token signing keys...
I20260807 10:41:40.672431 10843 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5b2f7afe68b44be58c4d3081929c2504: Generated new TSK 0
I20260807 10:41:40.673628 10843 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 10:41:40.682252 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 10755
W20260807 10:41:40.684418 10820 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.101:41807
W20260807 10:41:40.685284 21165 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 10755: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260807 10:41:40.685453 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 10755
W20260807 10:41:40.706815 10738 connection.cc:535] client connection to 127.0.0.1:35733 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:35733): Connection reset by peer (error 104)
2026-08-07T10:41:40Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (2118 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786098956060137-21165-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 10:41:40 dist-test-slave-0b58 krb5kdc[10858](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 10:41:40 dist-test-slave-0b58 krb5kdc[10858](info): set up 2 sockets
Aug 07 10:41:40 dist-test-slave-0b58 krb5kdc[10858](info): commencing operation
krb5kdc: starting...
W20260807 10:41:41.874905 21165 mini_kdc.cc:121] Time spent starting KDC: real 1.143s user 0.000s sys 0.057s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786098956060137-21165-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786098956060137-21165-0/krb5kdc/test-user.keytab.
Aug 07 10:41:42 dist-test-slave-0b58 krb5kdc[10858](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099302, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T10:41:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T10:41:42Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786098956060137-21165-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786098956060137-21165-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 10:41:42.233608 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786098956060137-21165-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786098956060137-21165-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786098956060137-21165-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38875
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786098956060137-21165-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:43457
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:38875
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786098956060137-21165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786098956060137-21165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786098956060137-21165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:41:42.582664 10871 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:41:42.583035 10871 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:41:42.583204 10871 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:41:42.591849 10871 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 10:41:42.591998 10871 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:41:42.592085 10871 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:41:42.592177 10871 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 10:41:42.592248 10871 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 10:41:42.602608 10871 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:43457
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786098956060137-21165-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786098956060137-21165-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:38875
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786098956060137-21165-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38875
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786098956060137-21165-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:41:42.604051 10871 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:41:42.605430 10871 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:41:42.617580 10876 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:41:42.617609 10879 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:41:42.617525 10877 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:41:42.618587 10871 server_base.cc:1034] running on GCE node
I20260807 10:41:42.619344 10871 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:41:42.620831 10871 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:41:42.622033 10871 hybrid_clock.cc:648] HybridClock initialized: now 1786099302621993 us; error 29 us; skew 500 ppm
I20260807 10:41:42.622421 10871 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:41:42 dist-test-slave-0b58 krb5kdc[10858](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099302, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:41:42.630012 10871 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 10:41:42.631536 10871 webserver.cc:460] Webserver started at http://127.0.0.1:41101/ using document root <none> and password file <none>
I20260807 10:41:42.632220 10871 fs_manager.cc:359] Metadata directory not provided
I20260807 10:41:42.632418 10871 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:41:42.632742 10871 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:41:42.635748 10871 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786098956060137-21165-0/minicluster-data/master-0/data/instance:
uuid: "a427543e7f0844cda8d31957c38e0fe3"
format_stamp: "Formatted at 2026-08-07 10:41:42 on dist-test-slave-0b58"
server_key: "18b309239be40c33cc2fa2692bbda894"
server_key_iv: "d3755deb2e6eaf30042df9dc8a29a708"
server_key_version: "encryptionkey@0"
I20260807 10:41:42.636591 10871 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786098956060137-21165-0/minicluster-data/master-0/wal/instance:
uuid: "a427543e7f0844cda8d31957c38e0fe3"
format_stamp: "Formatted at 2026-08-07 10:41:42 on dist-test-slave-0b58"
server_key: "18b309239be40c33cc2fa2692bbda894"
server_key_iv: "d3755deb2e6eaf30042df9dc8a29a708"
server_key_version: "encryptionkey@0"
I20260807 10:41:42.641721 10871 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.004s
I20260807 10:41:42.647992 10888 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:41:42.649461 10871 fs_manager.cc:725] Time spent opening block manager: real 0.006s user 0.004s sys 0.002s
I20260807 10:41:42.649664 10871 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786098956060137-21165-0/minicluster-data/master-0/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786098956060137-21165-0/minicluster-data/master-0/wal
uuid: "a427543e7f0844cda8d31957c38e0fe3"
format_stamp: "Formatted at 2026-08-07 10:41:42 on dist-test-slave-0b58"
server_key: "18b309239be40c33cc2fa2692bbda894"
server_key_iv: "d3755deb2e6eaf30042df9dc8a29a708"
server_key_version: "encryptionkey@0"
I20260807 10:41:42.649890 10871 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786098956060137-21165-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786098956060137-21165-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786098956060137-21165-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:41:42.655750 10871 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:41:42.659762 10871 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:41:42.660077 10871 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:41:42.679607 10871 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:38875
I20260807 10:41:42.679654 10941 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:38875 every 8 connection(s)
I20260807 10:41:42.681159 10871 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
I20260807 10:41:42.685122 10942 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:41:42.688874 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 10871
I20260807 10:41:42.689060 21165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786098956060137-21165-0/minicluster-data/master-0/wal/instance
I20260807 10:41:42.689532 21165 external_mini_cluster.cc:1428] Setting key 32992309b1ce2619e6058843019782be
I20260807 10:41:42.698194 10945 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:42.691427 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.101:40469 (local address 127.0.0.1:38875)
0807 10:41:42.692240 (+ 813us) server_negotiation.cc:206] Beginning negotiation
0807 10:41:42.692278 (+ 38us) server_negotiation.cc:399] Waiting for connection header
0807 10:41:42.692330 (+ 52us) server_negotiation.cc:407] Connection header received
0807 10:41:42.694231 (+ 1901us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:41:42.694265 (+ 34us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:41:42.694724 (+ 459us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:41:42.695180 (+ 456us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:41:42.696202 (+ 1022us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:41:42.696211 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:41:42.696233 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:41:42.696290 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:41:42.696361 (+ 71us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:41:42.696388 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:41:42.696624 (+ 236us) server_negotiation.cc:1035] Waiting for connection context
0807 10:41:42.696759 (+ 135us) server_negotiation.cc:299] Negotiation successful
0807 10:41:42.696971 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":568,"thread_start_us":318,"threads_started":1}
I20260807 10:41:42.698975 10942 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a427543e7f0844cda8d31957c38e0fe3: Bootstrap starting.
I20260807 10:41:42.701872 21165 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 10:41:42.702343 10942 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a427543e7f0844cda8d31957c38e0fe3: Neither blocks nor log segments found. Creating new log.
I20260807 10:41:42.703578 10942 log.cc:824] T 00000000000000000000000000000000 P a427543e7f0844cda8d31957c38e0fe3: Log is configured to *not* fsync() on all Append() calls
I20260807 10:41:42.706983 10942 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a427543e7f0844cda8d31957c38e0fe3: No bootstrap required, opened a new log
I20260807 10:41:42.709537 10945 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:42.707087 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.101:50953 (local address 127.0.0.1:38875)
0807 10:41:42.707249 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0807 10:41:42.707258 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 10:41:42.707628 (+ 370us) server_negotiation.cc:407] Connection header received
0807 10:41:42.707759 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:41:42.707765 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:41:42.707836 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:41:42.707944 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:41:42.708888 (+ 944us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:41:42.708894 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:41:42.708899 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:41:42.708918 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:41:42.708970 (+ 52us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:41:42.708995 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:41:42.709121 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0807 10:41:42.709190 (+ 69us) server_negotiation.cc:299] Negotiation successful
0807 10:41:42.709252 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260807 10:41:42.715101 10942 raft_consensus.cc:348] T 00000000000000000000000000000000 P a427543e7f0844cda8d31957c38e0fe3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a427543e7f0844cda8d31957c38e0fe3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38875 } }
I20260807 10:41:42.715438 10942 raft_consensus.cc:374] T 00000000000000000000000000000000 P a427543e7f0844cda8d31957c38e0fe3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:41:42.715512 10942 raft_consensus.cc:729] T 00000000000000000000000000000000 P a427543e7f0844cda8d31957c38e0fe3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a427543e7f0844cda8d31957c38e0fe3, State: Initialized, Role: FOLLOWER
I20260807 10:41:42.715983 10942 consensus_queue.cc:260] T 00000000000000000000000000000000 P a427543e7f0844cda8d31957c38e0fe3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a427543e7f0844cda8d31957c38e0fe3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38875 } }
I20260807 10:41:42.716183 10942 raft_consensus.cc:388] T 00000000000000000000000000000000 P a427543e7f0844cda8d31957c38e0fe3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 10:41:42.716342 10942 raft_consensus.cc:482] T 00000000000000000000000000000000 P a427543e7f0844cda8d31957c38e0fe3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 10:41:42.716526 10942 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a427543e7f0844cda8d31957c38e0fe3 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:41:42.718703 10942 raft_consensus.cc:504] T 00000000000000000000000000000000 P a427543e7f0844cda8d31957c38e0fe3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a427543e7f0844cda8d31957c38e0fe3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38875 } }
I20260807 10:41:42.719185 10942 leader_election.cc:302] T 00000000000000000000000000000000 P a427543e7f0844cda8d31957c38e0fe3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a427543e7f0844cda8d31957c38e0fe3; no voters:
I20260807 10:41:42.719772 10942 leader_election.cc:288] T 00000000000000000000000000000000 P a427543e7f0844cda8d31957c38e0fe3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 10:41:42.719915 10952 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a427543e7f0844cda8d31957c38e0fe3 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:41:42.720690 10952 raft_consensus.cc:686] T 00000000000000000000000000000000 P a427543e7f0844cda8d31957c38e0fe3 [term 1 LEADER]: Becoming Leader. State: Replica: a427543e7f0844cda8d31957c38e0fe3, State: Running, Role: LEADER
I20260807 10:41:42.721267 10952 consensus_queue.cc:237] T 00000000000000000000000000000000 P a427543e7f0844cda8d31957c38e0fe3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a427543e7f0844cda8d31957c38e0fe3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38875 } }
I20260807 10:41:42.721992 10942 sys_catalog.cc:564] T 00000000000000000000000000000000 P a427543e7f0844cda8d31957c38e0fe3 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 10:41:42.724577 10953 sys_catalog.cc:455] T 00000000000000000000000000000000 P a427543e7f0844cda8d31957c38e0fe3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a427543e7f0844cda8d31957c38e0fe3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a427543e7f0844cda8d31957c38e0fe3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38875 } } }
I20260807 10:41:42.724529 10954 sys_catalog.cc:455] T 00000000000000000000000000000000 P a427543e7f0844cda8d31957c38e0fe3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a427543e7f0844cda8d31957c38e0fe3. Latest consensus state: current_term: 1 leader_uuid: "a427543e7f0844cda8d31957c38e0fe3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a427543e7f0844cda8d31957c38e0fe3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38875 } } }
I20260807 10:41:42.725083 10953 sys_catalog.cc:458] T 00000000000000000000000000000000 P a427543e7f0844cda8d31957c38e0fe3 [sys.catalog]: This master's current role is: LEADER
I20260807 10:41:42.725121 10954 sys_catalog.cc:458] T 00000000000000000000000000000000 P a427543e7f0844cda8d31957c38e0fe3 [sys.catalog]: This master's current role is: LEADER
I20260807 10:41:42.729825 10958 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 10:41:42.735666 10958 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 10:41:42.744707 10958 catalog_manager.cc:1347] Generated new cluster ID: 887746d0b82c444eb4297bde5afbe94b
I20260807 10:41:42.744853 10958 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 10:41:42.758728 10958 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 10:41:42.759295 10958 catalog_manager.cc:1504] Loading token signing keys...
I20260807 10:41:42.770563 10958 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a427543e7f0844cda8d31957c38e0fe3: Generated new TSK 0
I20260807 10:41:42.771458 10958 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 10:41:42.786337 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 10871
W20260807 10:41:42.787477 10937 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.101:40469
W20260807 10:41:42.788205 21165 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 10871: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260807 10:41:42.788421 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 10871
2026-08-07T10:41:42Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (2097 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786098956060137-21165-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 10:41:42 dist-test-slave-0b58 krb5kdc[10973](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 10:41:42 dist-test-slave-0b58 krb5kdc[10973](info): set up 2 sockets
Aug 07 10:41:42 dist-test-slave-0b58 krb5kdc[10973](info): commencing operation
krb5kdc: starting...
W20260807 10:41:43.942438 21165 mini_kdc.cc:121] Time spent starting KDC: real 1.114s user 0.006s sys 0.047s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786098956060137-21165-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786098956060137-21165-0/krb5kdc/test-user.keytab.
Aug 07 10:41:44 dist-test-slave-0b58 krb5kdc[10973](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099304, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T10:41:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T10:41:44Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.171.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.171.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.171.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.126.keytab.
Entry for principal kudu/127.20.171.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.126.keytab.
I20260807 10:41:44.297876 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786098956060137-21165-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786098956060137-21165-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786098956060137-21165-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.171.126:34539
--webserver_interface=127.20.171.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.126.keytab
--principal=kudu/127.20.171.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.171.84:42309
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.171.126:34539
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786098956060137-21165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786098956060137-21165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786098956060137-21165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:41:44.647914 10986 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:41:44.648262 10986 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:41:44.648486 10986 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:41:44.655853 10986 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 10:41:44.656000 10986 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:41:44.656108 10986 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:41:44.656212 10986 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 10:41:44.656306 10986 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 10:41:44.666389 10986 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.171.84:42309
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786098956060137-21165-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786098956060137-21165-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.171.126:34539
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.126.keytab
--principal=kudu/127.20.171.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.171.126:34539
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.171.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786098956060137-21165-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:41:44.667755 10986 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:41:44.669131 10986 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:41:44.681324 10991 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:41:44.681315 10992 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:41:44.681241 10994 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:41:44.682543 10986 server_base.cc:1034] running on GCE node
I20260807 10:41:44.683327 10986 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:41:44.684801 10986 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:41:44.686034 10986 hybrid_clock.cc:648] HybridClock initialized: now 1786099304685997 us; error 47 us; skew 500 ppm
I20260807 10:41:44.686420 10986 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:41:44 dist-test-slave-0b58 krb5kdc[10973](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099304, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:41:44.689575 10986 init.cc:377] Logged in from keytab as kudu/127.20.171.126@KRBTEST.COM (short username kudu)
I20260807 10:41:44.691141 10986 webserver.cc:460] Webserver started at http://127.20.171.126:39715/ using document root <none> and password file <none>
I20260807 10:41:44.691840 10986 fs_manager.cc:359] Metadata directory not provided
I20260807 10:41:44.691992 10986 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:41:44.692378 10986 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:41:44.695375 10986 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786098956060137-21165-0/minicluster-data/master-0/data/instance:
uuid: "94491d45ffc64d3b9fa65ee886361855"
format_stamp: "Formatted at 2026-08-07 10:41:44 on dist-test-slave-0b58"
server_key: "0a4244a9d260424dbcd3a350a3670130"
server_key_iv: "6e55529c4400e8086f98d27780724c4c"
server_key_version: "encryptionkey@0"
I20260807 10:41:44.696171 10986 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786098956060137-21165-0/minicluster-data/master-0/wal/instance:
uuid: "94491d45ffc64d3b9fa65ee886361855"
format_stamp: "Formatted at 2026-08-07 10:41:44 on dist-test-slave-0b58"
server_key: "0a4244a9d260424dbcd3a350a3670130"
server_key_iv: "6e55529c4400e8086f98d27780724c4c"
server_key_version: "encryptionkey@0"
I20260807 10:41:44.701483 10986 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260807 10:41:44.705030 11001 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:41:44.706327 10986 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260807 10:41:44.706533 10986 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786098956060137-21165-0/minicluster-data/master-0/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786098956060137-21165-0/minicluster-data/master-0/wal
uuid: "94491d45ffc64d3b9fa65ee886361855"
format_stamp: "Formatted at 2026-08-07 10:41:44 on dist-test-slave-0b58"
server_key: "0a4244a9d260424dbcd3a350a3670130"
server_key_iv: "6e55529c4400e8086f98d27780724c4c"
server_key_version: "encryptionkey@0"
I20260807 10:41:44.706745 10986 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786098956060137-21165-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786098956060137-21165-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786098956060137-21165-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:41:44.726548 10986 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:41:44.730716 10986 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:41:44.731011 10986 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:41:44.750834 10986 rpc_server.cc:307] RPC server started. Bound to: 127.20.171.126:34539
I20260807 10:41:44.750842 11055 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.171.126:34539 every 8 connection(s)
I20260807 10:41:44.752318 10986 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
I20260807 10:41:44.755980 11056 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:41:44.762452 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 10986
I20260807 10:41:44.762655 21165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786098956060137-21165-0/minicluster-data/master-0/wal/instance
I20260807 10:41:44.763088 21165 external_mini_cluster.cc:1428] Setting key 20686e83f84a686796f9897a894d2b1a
I20260807 10:41:44.767486 11056 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 94491d45ffc64d3b9fa65ee886361855: Bootstrap starting.
I20260807 10:41:44.771970 11056 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 94491d45ffc64d3b9fa65ee886361855: Neither blocks nor log segments found. Creating new log.
I20260807 10:41:44.773589 11056 log.cc:824] T 00000000000000000000000000000000 P 94491d45ffc64d3b9fa65ee886361855: Log is configured to *not* fsync() on all Append() calls
I20260807 10:41:44.777112 11056 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 94491d45ffc64d3b9fa65ee886361855: No bootstrap required, opened a new log
Aug 07 10:41:44 dist-test-slave-0b58 krb5kdc[10973](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099304, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.171.126@KRBTEST.COM
I20260807 10:41:44.786386 11056 raft_consensus.cc:348] T 00000000000000000000000000000000 P 94491d45ffc64d3b9fa65ee886361855 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "94491d45ffc64d3b9fa65ee886361855" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 34539 } }
I20260807 10:41:44.786952 11056 raft_consensus.cc:374] T 00000000000000000000000000000000 P 94491d45ffc64d3b9fa65ee886361855 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:41:44.787074 11056 raft_consensus.cc:729] T 00000000000000000000000000000000 P 94491d45ffc64d3b9fa65ee886361855 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 94491d45ffc64d3b9fa65ee886361855, State: Initialized, Role: FOLLOWER
I20260807 10:41:44.787858 11056 consensus_queue.cc:260] T 00000000000000000000000000000000 P 94491d45ffc64d3b9fa65ee886361855 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "94491d45ffc64d3b9fa65ee886361855" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 34539 } }
I20260807 10:41:44.788308 11056 raft_consensus.cc:388] T 00000000000000000000000000000000 P 94491d45ffc64d3b9fa65ee886361855 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 10:41:44.788499 11056 raft_consensus.cc:482] T 00000000000000000000000000000000 P 94491d45ffc64d3b9fa65ee886361855 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 10:41:44.788693 11056 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 94491d45ffc64d3b9fa65ee886361855 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:41:44.791399 11060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:44.765114 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60987 (local address 127.20.171.126:34539)
0807 10:41:44.765921 (+ 807us) server_negotiation.cc:206] Beginning negotiation
0807 10:41:44.765940 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0807 10:41:44.765993 (+ 53us) server_negotiation.cc:407] Connection header received
0807 10:41:44.768503 (+ 2510us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:41:44.768530 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:41:44.769037 (+ 507us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:41:44.769539 (+ 502us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:41:44.771848 (+ 2309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:44.774139 (+ 2291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:44.776490 (+ 2351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:44.777574 (+ 1084us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:44.777771 (+ 197us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:44.782926 (+ 5155us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:41:44.782934 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:41:44.782949 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:41:44.782995 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:41:44.786300 (+ 3305us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:41:44.787414 (+ 1114us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:41:44.787421 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:41:44.787428 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:41:44.787644 (+ 216us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:41:44.788231 (+ 587us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:41:44.788236 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:41:44.788240 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:41:44.789041 (+ 801us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:41:44.789292 (+ 251us) server_negotiation.cc:1035] Waiting for connection context
0807 10:41:44.789981 (+ 689us) server_negotiation.cc:299] Negotiation successful
0807 10:41:44.790374 (+ 393us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":567,"thread_start_us":353,"threads_started":1}
I20260807 10:41:44.791608 11056 raft_consensus.cc:504] T 00000000000000000000000000000000 P 94491d45ffc64d3b9fa65ee886361855 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "94491d45ffc64d3b9fa65ee886361855" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 34539 } }
I20260807 10:41:44.792228 11056 leader_election.cc:302] T 00000000000000000000000000000000 P 94491d45ffc64d3b9fa65ee886361855 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 94491d45ffc64d3b9fa65ee886361855; no voters:
I20260807 10:41:44.792959 11056 leader_election.cc:288] T 00000000000000000000000000000000 P 94491d45ffc64d3b9fa65ee886361855 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 10:41:44.793097 11062 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 94491d45ffc64d3b9fa65ee886361855 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:41:44.795274 11056 sys_catalog.cc:564] T 00000000000000000000000000000000 P 94491d45ffc64d3b9fa65ee886361855 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 10:41:44.796216 21165 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 10:41:44.796661 11062 raft_consensus.cc:686] T 00000000000000000000000000000000 P 94491d45ffc64d3b9fa65ee886361855 [term 1 LEADER]: Becoming Leader. State: Replica: 94491d45ffc64d3b9fa65ee886361855, State: Running, Role: LEADER
I20260807 10:41:44.797297 11062 consensus_queue.cc:237] T 00000000000000000000000000000000 P 94491d45ffc64d3b9fa65ee886361855 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "94491d45ffc64d3b9fa65ee886361855" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 34539 } }
I20260807 10:41:44.801846 11065 sys_catalog.cc:455] T 00000000000000000000000000000000 P 94491d45ffc64d3b9fa65ee886361855 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 94491d45ffc64d3b9fa65ee886361855. Latest consensus state: current_term: 1 leader_uuid: "94491d45ffc64d3b9fa65ee886361855" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "94491d45ffc64d3b9fa65ee886361855" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 34539 } } }
I20260807 10:41:44.802332 11065 sys_catalog.cc:458] T 00000000000000000000000000000000 P 94491d45ffc64d3b9fa65ee886361855 [sys.catalog]: This master's current role is: LEADER
I20260807 10:41:44.803540 11064 sys_catalog.cc:455] T 00000000000000000000000000000000 P 94491d45ffc64d3b9fa65ee886361855 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "94491d45ffc64d3b9fa65ee886361855" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "94491d45ffc64d3b9fa65ee886361855" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 34539 } } }
I20260807 10:41:44.806268 11064 sys_catalog.cc:458] T 00000000000000000000000000000000 P 94491d45ffc64d3b9fa65ee886361855 [sys.catalog]: This master's current role is: LEADER
I20260807 10:41:44.809602 11072 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 10:41:44.818185 11072 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 10:41:44.832216 11060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:44.805890 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41043 (local address 127.20.171.126:34539)
0807 10:41:44.806108 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0807 10:41:44.806114 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:41:44.806151 (+ 37us) server_negotiation.cc:407] Connection header received
0807 10:41:44.806250 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:41:44.806257 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:41:44.806353 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:41:44.806493 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:41:44.809297 (+ 2804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:44.811075 (+ 1778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:44.814115 (+ 3040us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:44.815217 (+ 1102us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:44.815414 (+ 197us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:44.819840 (+ 4426us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:41:44.819851 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:41:44.819859 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:41:44.819924 (+ 65us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:41:44.825594 (+ 5670us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:41:44.827265 (+ 1671us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:41:44.827274 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:41:44.827280 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:41:44.827548 (+ 268us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:41:44.828492 (+ 944us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:41:44.828500 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:41:44.828506 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:41:44.829120 (+ 614us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:41:44.831072 (+ 1952us) server_negotiation.cc:1035] Waiting for connection context
0807 10:41:44.831339 (+ 267us) server_negotiation.cc:299] Negotiation successful
0807 10:41:44.831636 (+ 297us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":98}
I20260807 10:41:44.836326 11072 catalog_manager.cc:1347] Generated new cluster ID: eccb96c08d3e40459f4a2f3e374296d5
I20260807 10:41:44.836504 11072 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 10:41:44.852339 11072 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 10:41:44.854357 11072 catalog_manager.cc:1504] Loading token signing keys...
I20260807 10:41:44.874353 11072 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 94491d45ffc64d3b9fa65ee886361855: Generated new TSK 0
I20260807 10:41:44.875669 11072 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 10:41:44.893247 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 10986
I20260807 10:41:44.894556 11050 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:41:44.990233 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 10986
W20260807 10:41:45.011374 10971 connection.cc:535] client connection to 127.20.171.126:34539 recv error: Network error: failed to read from TLS socket (remote: 127.20.171.126:34539): Connection reset by peer (error 104)
2026-08-07T10:41:45Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (2201 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786098956060137-21165-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 10:41:45 dist-test-slave-0b58 krb5kdc[11091](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 10:41:45 dist-test-slave-0b58 krb5kdc[11091](info): set up 2 sockets
Aug 07 10:41:45 dist-test-slave-0b58 krb5kdc[11091](info): commencing operation
krb5kdc: starting...
W20260807 10:41:46.147264 21165 mini_kdc.cc:121] Time spent starting KDC: real 1.117s user 0.000s sys 0.054s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786098956060137-21165-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786098956060137-21165-0/krb5kdc/test-user.keytab.
Aug 07 10:41:46 dist-test-slave-0b58 krb5kdc[11091](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099306, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T10:41:46Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T10:41:46Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.171.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.171.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.171.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.126.keytab.
Entry for principal kudu/127.20.171.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.126.keytab.
I20260807 10:41:46.502816 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786098956060137-21165-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786098956060137-21165-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786098956060137-21165-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.171.126:46591
--webserver_interface=127.20.171.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.126.keytab
--principal=kudu/127.20.171.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.171.84:46461
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.171.126:46591
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786098956060137-21165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786098956060137-21165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786098956060137-21165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:41:46.852442 11104 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:41:46.852805 11104 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:41:46.852993 11104 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:41:46.860354 11104 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 10:41:46.860572 11104 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:41:46.860673 11104 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:41:46.860778 11104 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 10:41:46.860872 11104 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 10:41:46.871357 11104 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.171.84:46461
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786098956060137-21165-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786098956060137-21165-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.171.126:46591
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.126.keytab
--principal=kudu/127.20.171.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.171.126:46591
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.171.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786098956060137-21165-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:41:46.872718 11104 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:41:46.874018 11104 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:41:46.885946 11109 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:41:46.885915 11112 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:41:46.886132 11110 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:41:46.886937 11104 server_base.cc:1034] running on GCE node
I20260807 10:41:46.887686 11104 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:41:46.889132 11104 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:41:46.890365 11104 hybrid_clock.cc:648] HybridClock initialized: now 1786099306890333 us; error 45 us; skew 500 ppm
I20260807 10:41:46.890712 11104 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:41:46 dist-test-slave-0b58 krb5kdc[11091](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099306, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:41:46.894035 11104 init.cc:377] Logged in from keytab as kudu/127.20.171.126@KRBTEST.COM (short username kudu)
I20260807 10:41:46.895515 11104 webserver.cc:460] Webserver started at http://127.20.171.126:34697/ using document root <none> and password file <none>
I20260807 10:41:46.896210 11104 fs_manager.cc:359] Metadata directory not provided
I20260807 10:41:46.896384 11104 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:41:46.896762 11104 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:41:46.899799 11104 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786098956060137-21165-0/minicluster-data/master-0/data/instance:
uuid: "1c39744d77494eec9bbcce3fe12c552d"
format_stamp: "Formatted at 2026-08-07 10:41:46 on dist-test-slave-0b58"
server_key: "9462441dbdc05a1561093fe9193ca297"
server_key_iv: "c0a0760880b1321c6173a5874c5b1dd9"
server_key_version: "encryptionkey@0"
I20260807 10:41:46.900669 11104 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786098956060137-21165-0/minicluster-data/master-0/wal/instance:
uuid: "1c39744d77494eec9bbcce3fe12c552d"
format_stamp: "Formatted at 2026-08-07 10:41:46 on dist-test-slave-0b58"
server_key: "9462441dbdc05a1561093fe9193ca297"
server_key_iv: "c0a0760880b1321c6173a5874c5b1dd9"
server_key_version: "encryptionkey@0"
I20260807 10:41:46.905884 11104 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260807 10:41:46.909400 11120 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:41:46.910684 11104 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260807 10:41:46.910880 11104 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786098956060137-21165-0/minicluster-data/master-0/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786098956060137-21165-0/minicluster-data/master-0/wal
uuid: "1c39744d77494eec9bbcce3fe12c552d"
format_stamp: "Formatted at 2026-08-07 10:41:46 on dist-test-slave-0b58"
server_key: "9462441dbdc05a1561093fe9193ca297"
server_key_iv: "c0a0760880b1321c6173a5874c5b1dd9"
server_key_version: "encryptionkey@0"
I20260807 10:41:46.911083 11104 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786098956060137-21165-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786098956060137-21165-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786098956060137-21165-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:41:46.922695 11104 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:41:46.927155 11104 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:41:46.927420 11104 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:41:46.945978 11104 rpc_server.cc:307] RPC server started. Bound to: 127.20.171.126:46591
I20260807 10:41:46.945990 11171 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.171.126:46591 every 8 connection(s)
I20260807 10:41:46.947381 11104 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
I20260807 10:41:46.947866 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 11104
I20260807 10:41:46.948068 21165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786098956060137-21165-0/minicluster-data/master-0/wal/instance
I20260807 10:41:46.948781 21165 external_mini_cluster.cc:1428] Setting key be486e3797ea703f4b2315c3331688bd
I20260807 10:41:46.951834 11172 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:41:46.961937 11175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:46.950593 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59401 (local address 127.20.171.126:46591)
0807 10:41:46.951382 (+ 789us) server_negotiation.cc:206] Beginning negotiation
0807 10:41:46.951395 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 10:41:46.951446 (+ 51us) server_negotiation.cc:407] Connection header received
0807 10:41:46.953253 (+ 1807us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:41:46.953275 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:41:46.953630 (+ 355us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:41:46.954021 (+ 391us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:41:46.954584 (+ 563us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:46.955932 (+ 1348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:46.957360 (+ 1428us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:46.958038 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:46.958236 (+ 198us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:46.959602 (+ 1366us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:41:46.959609 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:41:46.959622 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:41:46.960179 (+ 557us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:41:46.960313 (+ 134us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:41:46.960353 (+ 40us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:41:46.960549 (+ 196us) server_negotiation.cc:1035] Waiting for connection context
0807 10:41:46.960808 (+ 259us) server_negotiation.cc:299] Negotiation successful
0807 10:41:46.960988 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":584,"thread_start_us":371,"threads_started":1}
I20260807 10:41:46.962694 11172 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1c39744d77494eec9bbcce3fe12c552d: Bootstrap starting.
I20260807 10:41:46.966032 21165 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 10:41:46.966440 11172 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1c39744d77494eec9bbcce3fe12c552d: Neither blocks nor log segments found. Creating new log.
I20260807 10:41:46.967453 11172 log.cc:824] T 00000000000000000000000000000000 P 1c39744d77494eec9bbcce3fe12c552d: Log is configured to *not* fsync() on all Append() calls
I20260807 10:41:46.970423 11172 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1c39744d77494eec9bbcce3fe12c552d: No bootstrap required, opened a new log
I20260807 10:41:46.978003 11175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:46.971056 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58809 (local address 127.20.171.126:46591)
0807 10:41:46.971277 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0807 10:41:46.971283 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:41:46.971640 (+ 357us) server_negotiation.cc:407] Connection header received
0807 10:41:46.971829 (+ 189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:41:46.971833 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:41:46.971898 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:41:46.971976 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:41:46.972603 (+ 627us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:46.973395 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:46.975303 (+ 1908us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:46.975772 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:46.975870 (+ 98us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:46.977183 (+ 1313us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:41:46.977187 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:41:46.977191 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:41:46.977211 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:41:46.977249 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:41:46.977266 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:41:46.977350 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0807 10:41:46.977554 (+ 204us) server_negotiation.cc:299] Negotiation successful
0807 10:41:46.977601 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260807 10:41:46.980964 11172 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1c39744d77494eec9bbcce3fe12c552d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c39744d77494eec9bbcce3fe12c552d" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 46591 } }
I20260807 10:41:46.981405 11172 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1c39744d77494eec9bbcce3fe12c552d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:41:46.981516 11172 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1c39744d77494eec9bbcce3fe12c552d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c39744d77494eec9bbcce3fe12c552d, State: Initialized, Role: FOLLOWER
I20260807 10:41:46.982159 11172 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1c39744d77494eec9bbcce3fe12c552d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c39744d77494eec9bbcce3fe12c552d" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 46591 } }
I20260807 10:41:46.982414 11172 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1c39744d77494eec9bbcce3fe12c552d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 10:41:46.982569 11172 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1c39744d77494eec9bbcce3fe12c552d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 10:41:46.982744 11172 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1c39744d77494eec9bbcce3fe12c552d [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:41:46.985510 11172 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1c39744d77494eec9bbcce3fe12c552d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c39744d77494eec9bbcce3fe12c552d" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 46591 } }
I20260807 10:41:46.986042 11172 leader_election.cc:302] T 00000000000000000000000000000000 P 1c39744d77494eec9bbcce3fe12c552d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1c39744d77494eec9bbcce3fe12c552d; no voters:
I20260807 10:41:46.986667 11172 leader_election.cc:288] T 00000000000000000000000000000000 P 1c39744d77494eec9bbcce3fe12c552d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 10:41:46.986802 11184 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1c39744d77494eec9bbcce3fe12c552d [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:41:46.987587 11184 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1c39744d77494eec9bbcce3fe12c552d [term 1 LEADER]: Becoming Leader. State: Replica: 1c39744d77494eec9bbcce3fe12c552d, State: Running, Role: LEADER
I20260807 10:41:46.988173 11184 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1c39744d77494eec9bbcce3fe12c552d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c39744d77494eec9bbcce3fe12c552d" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 46591 } }
I20260807 10:41:46.988973 11172 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1c39744d77494eec9bbcce3fe12c552d [sys.catalog]: configured and running, proceeding with master startup.
I20260807 10:41:46.991497 11185 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1c39744d77494eec9bbcce3fe12c552d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1c39744d77494eec9bbcce3fe12c552d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c39744d77494eec9bbcce3fe12c552d" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 46591 } } }
I20260807 10:41:46.991423 11186 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1c39744d77494eec9bbcce3fe12c552d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1c39744d77494eec9bbcce3fe12c552d. Latest consensus state: current_term: 1 leader_uuid: "1c39744d77494eec9bbcce3fe12c552d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c39744d77494eec9bbcce3fe12c552d" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 46591 } } }
I20260807 10:41:46.992043 11185 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1c39744d77494eec9bbcce3fe12c552d [sys.catalog]: This master's current role is: LEADER
I20260807 10:41:46.992072 11186 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1c39744d77494eec9bbcce3fe12c552d [sys.catalog]: This master's current role is: LEADER
I20260807 10:41:46.994445 11190 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 10:41:47.000790 11190 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 10:41:47.010040 11190 catalog_manager.cc:1347] Generated new cluster ID: 65750f8709084839816d997292e9ece9
I20260807 10:41:47.010160 11190 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 10:41:47.054142 11190 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 10:41:47.056118 11190 catalog_manager.cc:1504] Loading token signing keys...
I20260807 10:41:47.067564 11190 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1c39744d77494eec9bbcce3fe12c552d: Generated new TSK 0
I20260807 10:41:47.068657 11190 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 10:41:47.087038 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 11104
W20260807 10:41:47.088271 11167 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:59401
W20260807 10:41:47.089154 21165 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 11104: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260807 10:41:47.089336 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 11104
W20260807 10:41:47.110248 11089 connection.cc:535] client connection to 127.20.171.126:46591 recv error: Network error: failed to read from TLS socket (remote: 127.20.171.126:46591): Connection reset by peer (error 104)
2026-08-07T10:41:47Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (2098 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786098956060137-21165-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 10:41:47 dist-test-slave-0b58 krb5kdc[11206](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 10:41:47 dist-test-slave-0b58 krb5kdc[11206](info): set up 2 sockets
Aug 07 10:41:47 dist-test-slave-0b58 krb5kdc[11206](info): commencing operation
krb5kdc: starting...
W20260807 10:41:48.245630 21165 mini_kdc.cc:121] Time spent starting KDC: real 1.116s user 0.003s sys 0.049s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786098956060137-21165-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786098956060137-21165-0/krb5kdc/test-user.keytab.
Aug 07 10:41:48 dist-test-slave-0b58 krb5kdc[11206](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099308, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T10:41:48Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T10:41:48Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.171.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.171.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.171.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.126.keytab.
Entry for principal kudu/127.20.171.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.126.keytab.
I20260807 10:41:48.608355 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786098956060137-21165-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786098956060137-21165-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786098956060137-21165-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.171.126:35307
--webserver_interface=127.20.171.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.126.keytab
--principal=kudu/127.20.171.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.171.84:39411
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.171.126:35307
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786098956060137-21165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786098956060137-21165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786098956060137-21165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:41:48.958580 11219 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:41:48.958874 11219 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:41:48.959067 11219 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:41:48.966431 11219 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 10:41:48.966540 11219 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:41:48.966667 11219 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:41:48.966771 11219 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 10:41:48.966840 11219 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 10:41:48.976990 11219 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.171.84:39411
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786098956060137-21165-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786098956060137-21165-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.171.126:35307
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.126.keytab
--principal=kudu/127.20.171.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.171.126:35307
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.171.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786098956060137-21165-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:41:48.978329 11219 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:41:48.979689 11219 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:41:48.991966 11225 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:41:48.991997 11227 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:41:48.992763 11224 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:41:48.993217 11219 server_base.cc:1034] running on GCE node
I20260807 10:41:48.994004 11219 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:41:48.995411 11219 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:41:48.996623 11219 hybrid_clock.cc:648] HybridClock initialized: now 1786099308996585 us; error 26 us; skew 500 ppm
I20260807 10:41:48.997020 11219 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:41:48 dist-test-slave-0b58 krb5kdc[11206](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099308, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:41:49.003535 11219 init.cc:377] Logged in from keytab as kudu/127.20.171.126@KRBTEST.COM (short username kudu)
I20260807 10:41:49.005183 11219 webserver.cc:460] Webserver started at http://127.20.171.126:43881/ using document root <none> and password file <none>
I20260807 10:41:49.005920 11219 fs_manager.cc:359] Metadata directory not provided
I20260807 10:41:49.006062 11219 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:41:49.006395 11219 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:41:49.009512 11219 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786098956060137-21165-0/minicluster-data/master-0/data/instance:
uuid: "23ceffb981144caeb43eab31c678d0ab"
format_stamp: "Formatted at 2026-08-07 10:41:49 on dist-test-slave-0b58"
server_key: "7db4aa8168cc4548905bf4f794d3282f"
server_key_iv: "5e9d12a5207c003a6af8635a3064c30b"
server_key_version: "encryptionkey@0"
I20260807 10:41:49.010293 11219 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786098956060137-21165-0/minicluster-data/master-0/wal/instance:
uuid: "23ceffb981144caeb43eab31c678d0ab"
format_stamp: "Formatted at 2026-08-07 10:41:49 on dist-test-slave-0b58"
server_key: "7db4aa8168cc4548905bf4f794d3282f"
server_key_iv: "5e9d12a5207c003a6af8635a3064c30b"
server_key_version: "encryptionkey@0"
I20260807 10:41:49.015450 11219 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260807 10:41:49.018918 11234 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:41:49.020236 11219 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 10:41:49.020494 11219 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786098956060137-21165-0/minicluster-data/master-0/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786098956060137-21165-0/minicluster-data/master-0/wal
uuid: "23ceffb981144caeb43eab31c678d0ab"
format_stamp: "Formatted at 2026-08-07 10:41:49 on dist-test-slave-0b58"
server_key: "7db4aa8168cc4548905bf4f794d3282f"
server_key_iv: "5e9d12a5207c003a6af8635a3064c30b"
server_key_version: "encryptionkey@0"
I20260807 10:41:49.020697 11219 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786098956060137-21165-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786098956060137-21165-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786098956060137-21165-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:41:49.026391 11219 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:41:49.030452 11219 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:41:49.030740 11219 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:41:49.050119 11219 rpc_server.cc:307] RPC server started. Bound to: 127.20.171.126:35307
I20260807 10:41:49.050172 11287 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.171.126:35307 every 8 connection(s)
I20260807 10:41:49.051504 11219 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
I20260807 10:41:49.053210 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 11219
I20260807 10:41:49.053421 21165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786098956060137-21165-0/minicluster-data/master-0/wal/instance
I20260807 10:41:49.053906 21165 external_mini_cluster.cc:1428] Setting key 579e80ab42e66f62ba71deddbef90205
I20260807 10:41:49.055871 11288 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:41:49.062806 11292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:49.055669 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46771 (local address 127.20.171.126:35307)
0807 10:41:49.056574 (+ 905us) server_negotiation.cc:206] Beginning negotiation
0807 10:41:49.056589 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 10:41:49.056658 (+ 69us) server_negotiation.cc:407] Connection header received
0807 10:41:49.058916 (+ 2258us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:41:49.058943 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:41:49.059380 (+ 437us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:41:49.059831 (+ 451us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:41:49.060849 (+ 1018us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:41:49.060858 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:41:49.060874 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:41:49.060891 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:41:49.060993 (+ 102us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:41:49.061032 (+ 39us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:41:49.061249 (+ 217us) server_negotiation.cc:1035] Waiting for connection context
0807 10:41:49.061388 (+ 139us) server_negotiation.cc:299] Negotiation successful
0807 10:41:49.061582 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":644,"thread_start_us":382,"threads_started":1}
I20260807 10:41:49.066601 21165 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 10:41:49.069902 11288 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 23ceffb981144caeb43eab31c678d0ab: Bootstrap starting.
I20260807 10:41:49.073583 11288 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 23ceffb981144caeb43eab31c678d0ab: Neither blocks nor log segments found. Creating new log.
I20260807 10:41:49.074290 11292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:49.071557 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57103 (local address 127.20.171.126:35307)
0807 10:41:49.071732 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0807 10:41:49.071738 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:41:49.072239 (+ 501us) server_negotiation.cc:407] Connection header received
0807 10:41:49.072423 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:41:49.072427 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:41:49.072473 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:41:49.072550 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:41:49.073587 (+ 1037us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:41:49.073591 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:41:49.073594 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:41:49.073609 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:41:49.073647 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:41:49.073661 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:41:49.073818 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0807 10:41:49.073927 (+ 109us) server_negotiation.cc:299] Negotiation successful
0807 10:41:49.073975 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260807 10:41:49.074872 11288 log.cc:824] T 00000000000000000000000000000000 P 23ceffb981144caeb43eab31c678d0ab: Log is configured to *not* fsync() on all Append() calls
I20260807 10:41:49.077623 11288 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 23ceffb981144caeb43eab31c678d0ab: No bootstrap required, opened a new log
I20260807 10:41:49.084801 11288 raft_consensus.cc:348] T 00000000000000000000000000000000 P 23ceffb981144caeb43eab31c678d0ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23ceffb981144caeb43eab31c678d0ab" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 35307 } }
I20260807 10:41:49.085178 11288 raft_consensus.cc:374] T 00000000000000000000000000000000 P 23ceffb981144caeb43eab31c678d0ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:41:49.085320 11288 raft_consensus.cc:729] T 00000000000000000000000000000000 P 23ceffb981144caeb43eab31c678d0ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23ceffb981144caeb43eab31c678d0ab, State: Initialized, Role: FOLLOWER
I20260807 10:41:49.085951 11288 consensus_queue.cc:260] T 00000000000000000000000000000000 P 23ceffb981144caeb43eab31c678d0ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23ceffb981144caeb43eab31c678d0ab" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 35307 } }
I20260807 10:41:49.086203 11288 raft_consensus.cc:388] T 00000000000000000000000000000000 P 23ceffb981144caeb43eab31c678d0ab [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 10:41:49.086367 11288 raft_consensus.cc:482] T 00000000000000000000000000000000 P 23ceffb981144caeb43eab31c678d0ab [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 10:41:49.086553 11288 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 23ceffb981144caeb43eab31c678d0ab [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:41:49.088835 11288 raft_consensus.cc:504] T 00000000000000000000000000000000 P 23ceffb981144caeb43eab31c678d0ab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23ceffb981144caeb43eab31c678d0ab" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 35307 } }
I20260807 10:41:49.089323 11288 leader_election.cc:302] T 00000000000000000000000000000000 P 23ceffb981144caeb43eab31c678d0ab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 23ceffb981144caeb43eab31c678d0ab; no voters:
I20260807 10:41:49.089951 11288 leader_election.cc:288] T 00000000000000000000000000000000 P 23ceffb981144caeb43eab31c678d0ab [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 10:41:49.090095 11299 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 23ceffb981144caeb43eab31c678d0ab [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:41:49.090766 11299 raft_consensus.cc:686] T 00000000000000000000000000000000 P 23ceffb981144caeb43eab31c678d0ab [term 1 LEADER]: Becoming Leader. State: Replica: 23ceffb981144caeb43eab31c678d0ab, State: Running, Role: LEADER
I20260807 10:41:49.091305 11299 consensus_queue.cc:237] T 00000000000000000000000000000000 P 23ceffb981144caeb43eab31c678d0ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23ceffb981144caeb43eab31c678d0ab" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 35307 } }
I20260807 10:41:49.092195 11288 sys_catalog.cc:564] T 00000000000000000000000000000000 P 23ceffb981144caeb43eab31c678d0ab [sys.catalog]: configured and running, proceeding with master startup.
I20260807 10:41:49.094204 11301 sys_catalog.cc:455] T 00000000000000000000000000000000 P 23ceffb981144caeb43eab31c678d0ab [sys.catalog]: SysCatalogTable state changed. Reason: New leader 23ceffb981144caeb43eab31c678d0ab. Latest consensus state: current_term: 1 leader_uuid: "23ceffb981144caeb43eab31c678d0ab" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23ceffb981144caeb43eab31c678d0ab" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 35307 } } }
I20260807 10:41:49.094647 11301 sys_catalog.cc:458] T 00000000000000000000000000000000 P 23ceffb981144caeb43eab31c678d0ab [sys.catalog]: This master's current role is: LEADER
I20260807 10:41:49.094254 11300 sys_catalog.cc:455] T 00000000000000000000000000000000 P 23ceffb981144caeb43eab31c678d0ab [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "23ceffb981144caeb43eab31c678d0ab" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23ceffb981144caeb43eab31c678d0ab" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 35307 } } }
I20260807 10:41:49.095470 11300 sys_catalog.cc:458] T 00000000000000000000000000000000 P 23ceffb981144caeb43eab31c678d0ab [sys.catalog]: This master's current role is: LEADER
I20260807 10:41:49.097107 11307 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 10:41:49.102213 11307 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 10:41:49.110838 11307 catalog_manager.cc:1347] Generated new cluster ID: 551bfb6cee4648d4b93dcf9699de0334
I20260807 10:41:49.110944 11307 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 10:41:49.135165 11307 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 10:41:49.135635 11307 catalog_manager.cc:1504] Loading token signing keys...
I20260807 10:41:49.143939 11307 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 23ceffb981144caeb43eab31c678d0ab: Generated new TSK 0
I20260807 10:41:49.144770 11307 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 10:41:49.150580 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 11219
W20260807 10:41:49.151746 11283 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:46771
W20260807 10:41:49.152526 21165 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 11219: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260807 10:41:49.152662 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 11219
2026-08-07T10:41:49Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (2062 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786098956060137-21165-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 10:41:49 dist-test-slave-0b58 krb5kdc[11320](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 10:41:49 dist-test-slave-0b58 krb5kdc[11320](info): set up 2 sockets
Aug 07 10:41:49 dist-test-slave-0b58 krb5kdc[11320](info): commencing operation
krb5kdc: starting...
W20260807 10:41:50.314966 21165 mini_kdc.cc:121] Time spent starting KDC: real 1.123s user 0.000s sys 0.053s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786098956060137-21165-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786098956060137-21165-0/krb5kdc/test-user.keytab.
Aug 07 10:41:50 dist-test-slave-0b58 krb5kdc[11320](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099310, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T10:41:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T10:41:50Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.171.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.171.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.171.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.126.keytab.
Entry for principal kudu/127.20.171.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.126.keytab.
I20260807 10:41:50.661589 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786098956060137-21165-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786098956060137-21165-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786098956060137-21165-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.171.126:37769
--webserver_interface=127.20.171.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.126.keytab
--principal=kudu/127.20.171.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.171.84:35175
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.171.126:37769
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786098956060137-21165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786098956060137-21165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786098956060137-21165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:41:51.010304 11334 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:41:51.010612 11334 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:41:51.010736 11334 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:41:51.017856 11334 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 10:41:51.017977 11334 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:41:51.018025 11334 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:41:51.018129 11334 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 10:41:51.018198 11334 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 10:41:51.027967 11334 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.171.84:35175
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786098956060137-21165-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786098956060137-21165-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.171.126:37769
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.126.keytab
--principal=kudu/127.20.171.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.171.126:37769
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.171.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786098956060137-21165-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:41:51.029269 11334 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:41:51.030666 11334 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:41:51.042769 11342 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:41:51.042840 11339 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:41:51.042884 11340 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:41:51.043551 11334 server_base.cc:1034] running on GCE node
I20260807 10:41:51.044464 11334 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:41:51.045881 11334 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:41:51.047113 11334 hybrid_clock.cc:648] HybridClock initialized: now 1786099311047061 us; error 55 us; skew 500 ppm
I20260807 10:41:51.047458 11334 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:41:51 dist-test-slave-0b58 krb5kdc[11320](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099311, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:41:51.050505 11334 init.cc:377] Logged in from keytab as kudu/127.20.171.126@KRBTEST.COM (short username kudu)
I20260807 10:41:51.051911 11334 webserver.cc:460] Webserver started at http://127.20.171.126:40129/ using document root <none> and password file <none>
I20260807 10:41:51.052649 11334 fs_manager.cc:359] Metadata directory not provided
I20260807 10:41:51.052794 11334 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:41:51.053102 11334 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:41:51.056362 11334 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786098956060137-21165-0/minicluster-data/master-0/data/instance:
uuid: "29d02b4ef1c5404f8b709911563dc601"
format_stamp: "Formatted at 2026-08-07 10:41:51 on dist-test-slave-0b58"
server_key: "9fe9258a8b358d8b41966f28791dc85e"
server_key_iv: "9ce1e057c0c67a37093cfb36cfd52b8b"
server_key_version: "encryptionkey@0"
I20260807 10:41:51.057210 11334 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786098956060137-21165-0/minicluster-data/master-0/wal/instance:
uuid: "29d02b4ef1c5404f8b709911563dc601"
format_stamp: "Formatted at 2026-08-07 10:41:51 on dist-test-slave-0b58"
server_key: "9fe9258a8b358d8b41966f28791dc85e"
server_key_iv: "9ce1e057c0c67a37093cfb36cfd52b8b"
server_key_version: "encryptionkey@0"
I20260807 10:41:51.062481 11334 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260807 10:41:51.065904 11350 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:41:51.067199 11334 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260807 10:41:51.067378 11334 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786098956060137-21165-0/minicluster-data/master-0/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786098956060137-21165-0/minicluster-data/master-0/wal
uuid: "29d02b4ef1c5404f8b709911563dc601"
format_stamp: "Formatted at 2026-08-07 10:41:51 on dist-test-slave-0b58"
server_key: "9fe9258a8b358d8b41966f28791dc85e"
server_key_iv: "9ce1e057c0c67a37093cfb36cfd52b8b"
server_key_version: "encryptionkey@0"
I20260807 10:41:51.067577 11334 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786098956060137-21165-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786098956060137-21165-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786098956060137-21165-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:41:51.104053 11334 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:41:51.108112 11334 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:41:51.108426 11334 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:41:51.132249 11334 rpc_server.cc:307] RPC server started. Bound to: 127.20.171.126:37769
I20260807 10:41:51.132360 11403 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.171.126:37769 every 8 connection(s)
I20260807 10:41:51.134090 11334 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
I20260807 10:41:51.136122 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 11334
I20260807 10:41:51.136341 21165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786098956060137-21165-0/minicluster-data/master-0/wal/instance
I20260807 10:41:51.136863 21165 external_mini_cluster.cc:1428] Setting key b5c30fa0a11fa7a16bbc45025337e274
I20260807 10:41:51.139539 11404 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:41:51.154913 11404 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 29d02b4ef1c5404f8b709911563dc601: Bootstrap starting.
Aug 07 10:41:51 dist-test-slave-0b58 krb5kdc[11320](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099310, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.171.126@KRBTEST.COM
I20260807 10:41:51.159132 11404 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 29d02b4ef1c5404f8b709911563dc601: Neither blocks nor log segments found. Creating new log.
I20260807 10:41:51.160951 11404 log.cc:824] T 00000000000000000000000000000000 P 29d02b4ef1c5404f8b709911563dc601: Log is configured to *not* fsync() on all Append() calls
I20260807 10:41:51.164441 11404 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 29d02b4ef1c5404f8b709911563dc601: No bootstrap required, opened a new log
I20260807 10:41:51.170874 11407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:51.138775 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46821 (local address 127.20.171.126:37769)
0807 10:41:51.139614 (+ 839us) server_negotiation.cc:206] Beginning negotiation
0807 10:41:51.139626 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 10:41:51.139670 (+ 44us) server_negotiation.cc:407] Connection header received
0807 10:41:51.142763 (+ 3093us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:41:51.142809 (+ 46us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:41:51.143392 (+ 583us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:41:51.143865 (+ 473us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:41:51.145817 (+ 1952us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:51.148505 (+ 2688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:51.150356 (+ 1851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:51.151416 (+ 1060us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:51.151607 (+ 191us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:51.158063 (+ 6456us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:41:51.158078 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:41:51.158098 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:41:51.158152 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:41:51.163521 (+ 5369us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:41:51.164824 (+ 1303us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:41:51.164836 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:41:51.164848 (+ 12us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:41:51.165166 (+ 318us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:41:51.165784 (+ 618us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:41:51.165791 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:41:51.165796 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:41:51.166698 (+ 902us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:41:51.168402 (+ 1704us) server_negotiation.cc:1035] Waiting for connection context
0807 10:41:51.168797 (+ 395us) server_negotiation.cc:299] Negotiation successful
0807 10:41:51.169337 (+ 540us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":624,"thread_start_us":372,"threads_started":1}
I20260807 10:41:51.175024 21165 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 10:41:51.175287 11404 raft_consensus.cc:348] T 00000000000000000000000000000000 P 29d02b4ef1c5404f8b709911563dc601 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "29d02b4ef1c5404f8b709911563dc601" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 37769 } }
I20260807 10:41:51.175680 11404 raft_consensus.cc:374] T 00000000000000000000000000000000 P 29d02b4ef1c5404f8b709911563dc601 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:41:51.175789 11404 raft_consensus.cc:729] T 00000000000000000000000000000000 P 29d02b4ef1c5404f8b709911563dc601 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29d02b4ef1c5404f8b709911563dc601, State: Initialized, Role: FOLLOWER
I20260807 10:41:51.176440 11404 consensus_queue.cc:260] T 00000000000000000000000000000000 P 29d02b4ef1c5404f8b709911563dc601 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "29d02b4ef1c5404f8b709911563dc601" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 37769 } }
I20260807 10:41:51.176681 11404 raft_consensus.cc:388] T 00000000000000000000000000000000 P 29d02b4ef1c5404f8b709911563dc601 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 10:41:51.176827 11404 raft_consensus.cc:482] T 00000000000000000000000000000000 P 29d02b4ef1c5404f8b709911563dc601 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 10:41:51.177011 11404 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 29d02b4ef1c5404f8b709911563dc601 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:41:51.179556 11404 raft_consensus.cc:504] T 00000000000000000000000000000000 P 29d02b4ef1c5404f8b709911563dc601 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "29d02b4ef1c5404f8b709911563dc601" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 37769 } }
I20260807 10:41:51.180176 11404 leader_election.cc:302] T 00000000000000000000000000000000 P 29d02b4ef1c5404f8b709911563dc601 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 29d02b4ef1c5404f8b709911563dc601; no voters:
I20260807 10:41:51.181025 11404 leader_election.cc:288] T 00000000000000000000000000000000 P 29d02b4ef1c5404f8b709911563dc601 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 10:41:51.181173 11414 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 29d02b4ef1c5404f8b709911563dc601 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:41:51.183398 11404 sys_catalog.cc:564] T 00000000000000000000000000000000 P 29d02b4ef1c5404f8b709911563dc601 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 10:41:51.184557 11414 raft_consensus.cc:686] T 00000000000000000000000000000000 P 29d02b4ef1c5404f8b709911563dc601 [term 1 LEADER]: Becoming Leader. State: Replica: 29d02b4ef1c5404f8b709911563dc601, State: Running, Role: LEADER
I20260807 10:41:51.185184 11414 consensus_queue.cc:237] T 00000000000000000000000000000000 P 29d02b4ef1c5404f8b709911563dc601 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "29d02b4ef1c5404f8b709911563dc601" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 37769 } }
I20260807 10:41:51.188165 11416 sys_catalog.cc:455] T 00000000000000000000000000000000 P 29d02b4ef1c5404f8b709911563dc601 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 29d02b4ef1c5404f8b709911563dc601. Latest consensus state: current_term: 1 leader_uuid: "29d02b4ef1c5404f8b709911563dc601" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "29d02b4ef1c5404f8b709911563dc601" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 37769 } } }
I20260807 10:41:51.188714 11416 sys_catalog.cc:458] T 00000000000000000000000000000000 P 29d02b4ef1c5404f8b709911563dc601 [sys.catalog]: This master's current role is: LEADER
I20260807 10:41:51.188556 11415 sys_catalog.cc:455] T 00000000000000000000000000000000 P 29d02b4ef1c5404f8b709911563dc601 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "29d02b4ef1c5404f8b709911563dc601" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "29d02b4ef1c5404f8b709911563dc601" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 37769 } } }
I20260807 10:41:51.188930 11415 sys_catalog.cc:458] T 00000000000000000000000000000000 P 29d02b4ef1c5404f8b709911563dc601 [sys.catalog]: This master's current role is: LEADER
I20260807 10:41:51.199257 11419 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 10:41:51.202433 11407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:51.180046 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42491 (local address 127.20.171.126:37769)
0807 10:41:51.180339 (+ 293us) server_negotiation.cc:206] Beginning negotiation
0807 10:41:51.180348 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 10:41:51.180773 (+ 425us) server_negotiation.cc:407] Connection header received
0807 10:41:51.180993 (+ 220us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:41:51.180999 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:41:51.181091 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:41:51.181229 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:41:51.184004 (+ 2775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:51.185296 (+ 1292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:51.187148 (+ 1852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:51.187637 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:51.187774 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:51.193729 (+ 5955us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:41:51.193739 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:41:51.193747 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:41:51.193795 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:41:51.198540 (+ 4745us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:41:51.199435 (+ 895us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:41:51.199438 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:41:51.199441 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:41:51.199590 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:41:51.200005 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:41:51.200011 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:41:51.200032 (+ 21us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:41:51.200458 (+ 426us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:41:51.200771 (+ 313us) server_negotiation.cc:1035] Waiting for connection context
0807 10:41:51.202011 (+ 1240us) server_negotiation.cc:299] Negotiation successful
0807 10:41:51.202181 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":91}
I20260807 10:41:51.210580 11419 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 10:41:51.219604 11419 catalog_manager.cc:1347] Generated new cluster ID: 16ef560242da462f97f27cf965c9e4c9
I20260807 10:41:51.219722 11419 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 10:41:51.251034 11419 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 10:41:51.252476 11419 catalog_manager.cc:1504] Loading token signing keys...
I20260807 10:41:51.263202 11419 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 29d02b4ef1c5404f8b709911563dc601: Generated new TSK 0
I20260807 10:41:51.264381 11419 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 10:41:51.278484 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 11334
I20260807 10:41:51.279582 11399 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:41:51.376245 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 11334
2026-08-07T10:41:51Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (2223 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786098956060137-21165-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 10:41:51 dist-test-slave-0b58 krb5kdc[11436](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 10:41:51 dist-test-slave-0b58 krb5kdc[11436](info): set up 2 sockets
Aug 07 10:41:51 dist-test-slave-0b58 krb5kdc[11436](info): commencing operation
krb5kdc: starting...
W20260807 10:41:52.530562 21165 mini_kdc.cc:121] Time spent starting KDC: real 1.114s user 0.017s sys 0.036s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786098956060137-21165-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786098956060137-21165-0/krb5kdc/test-user.keytab.
Aug 07 10:41:52 dist-test-slave-0b58 krb5kdc[11436](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099312, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T10:41:52Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T10:41:52Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.171.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.171.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.171.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.126.keytab.
Entry for principal kudu/127.20.171.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.126.keytab.
I20260807 10:41:52.881295 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786098956060137-21165-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786098956060137-21165-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786098956060137-21165-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.171.126:34887
--webserver_interface=127.20.171.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.126.keytab
--principal=kudu/127.20.171.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.171.84:38249
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.171.126:34887
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786098956060137-21165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786098956060137-21165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786098956060137-21165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:41:53.224370 11450 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:41:53.224721 11450 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:41:53.224897 11450 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:41:53.232178 11450 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 10:41:53.232375 11450 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:41:53.232481 11450 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:41:53.232592 11450 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 10:41:53.232679 11450 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 10:41:53.242558 11450 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.171.84:38249
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786098956060137-21165-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786098956060137-21165-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.171.126:34887
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.126.keytab
--principal=kudu/127.20.171.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.171.126:34887
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.171.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786098956060137-21165-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:41:53.243906 11450 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:41:53.245273 11450 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:41:53.257457 11459 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:41:53.257432 11456 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:41:53.257853 11455 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:41:53.258388 11450 server_base.cc:1034] running on GCE node
I20260807 10:41:53.259212 11450 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:41:53.260648 11450 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:41:53.261849 11450 hybrid_clock.cc:648] HybridClock initialized: now 1786099313261811 us; error 33 us; skew 500 ppm
I20260807 10:41:53.262154 11450 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:41:53 dist-test-slave-0b58 krb5kdc[11436](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099313, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:41:53.265254 11450 init.cc:377] Logged in from keytab as kudu/127.20.171.126@KRBTEST.COM (short username kudu)
I20260807 10:41:53.266773 11450 webserver.cc:460] Webserver started at http://127.20.171.126:46491/ using document root <none> and password file <none>
I20260807 10:41:53.267426 11450 fs_manager.cc:359] Metadata directory not provided
I20260807 10:41:53.267526 11450 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:41:53.267779 11450 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:41:53.270848 11450 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786098956060137-21165-0/minicluster-data/master-0/data/instance:
uuid: "c6f4d49832a84c179d3c1d525f6d8e4b"
format_stamp: "Formatted at 2026-08-07 10:41:53 on dist-test-slave-0b58"
server_key: "875f8f642eb5228830cc39cc541a0282"
server_key_iv: "906f3b98595e9207f3b9d179827c258e"
server_key_version: "encryptionkey@0"
I20260807 10:41:53.271582 11450 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786098956060137-21165-0/minicluster-data/master-0/wal/instance:
uuid: "c6f4d49832a84c179d3c1d525f6d8e4b"
format_stamp: "Formatted at 2026-08-07 10:41:53 on dist-test-slave-0b58"
server_key: "875f8f642eb5228830cc39cc541a0282"
server_key_iv: "906f3b98595e9207f3b9d179827c258e"
server_key_version: "encryptionkey@0"
I20260807 10:41:53.276903 11450 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.003s
I20260807 10:41:53.280179 11466 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:41:53.281554 11450 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260807 10:41:53.281693 11450 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786098956060137-21165-0/minicluster-data/master-0/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786098956060137-21165-0/minicluster-data/master-0/wal
uuid: "c6f4d49832a84c179d3c1d525f6d8e4b"
format_stamp: "Formatted at 2026-08-07 10:41:53 on dist-test-slave-0b58"
server_key: "875f8f642eb5228830cc39cc541a0282"
server_key_iv: "906f3b98595e9207f3b9d179827c258e"
server_key_version: "encryptionkey@0"
I20260807 10:41:53.281853 11450 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786098956060137-21165-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786098956060137-21165-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786098956060137-21165-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:41:53.296478 11450 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:41:53.300406 11450 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:41:53.300638 11450 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:41:53.320065 11450 rpc_server.cc:307] RPC server started. Bound to: 127.20.171.126:34887
I20260807 10:41:53.320091 11517 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.171.126:34887 every 8 connection(s)
I20260807 10:41:53.321494 11450 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
I20260807 10:41:53.325165 11518 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:41:53.327275 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 11450
I20260807 10:41:53.327471 21165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786098956060137-21165-0/minicluster-data/master-0/wal/instance
I20260807 10:41:53.328063 21165 external_mini_cluster.cc:1428] Setting key ad75a54e049f08a21ae613e67e3028a8
I20260807 10:41:53.339555 11518 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c6f4d49832a84c179d3c1d525f6d8e4b: Bootstrap starting.
I20260807 10:41:53.341265 11521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:53.329896 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50089 (local address 127.20.171.126:34887)
0807 10:41:53.330755 (+ 859us) server_negotiation.cc:206] Beginning negotiation
0807 10:41:53.330765 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 10:41:53.330807 (+ 42us) server_negotiation.cc:407] Connection header received
0807 10:41:53.332518 (+ 1711us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:41:53.332544 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:41:53.332919 (+ 375us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:41:53.333219 (+ 300us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:41:53.333794 (+ 575us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:53.335051 (+ 1257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:53.336944 (+ 1893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:53.337603 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:53.337725 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:53.339023 (+ 1298us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:41:53.339030 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:41:53.339043 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:41:53.339568 (+ 525us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:41:53.339668 (+ 100us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:41:53.339703 (+ 35us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:41:53.339800 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0807 10:41:53.340022 (+ 222us) server_negotiation.cc:299] Negotiation successful
0807 10:41:53.340330 (+ 308us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":646,"thread_start_us":419,"threads_started":1}
I20260807 10:41:53.342932 11518 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c6f4d49832a84c179d3c1d525f6d8e4b: Neither blocks nor log segments found. Creating new log.
I20260807 10:41:53.344156 11518 log.cc:824] T 00000000000000000000000000000000 P c6f4d49832a84c179d3c1d525f6d8e4b: Log is configured to *not* fsync() on all Append() calls
I20260807 10:41:53.344894 21165 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 10:41:53.346901 11518 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c6f4d49832a84c179d3c1d525f6d8e4b: No bootstrap required, opened a new log
I20260807 10:41:53.356003 11521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:53.349173 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47555 (local address 127.20.171.126:34887)
0807 10:41:53.349384 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0807 10:41:53.349391 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:41:53.349969 (+ 578us) server_negotiation.cc:407] Connection header received
0807 10:41:53.350152 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:41:53.350156 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:41:53.350214 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:41:53.350312 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:41:53.350914 (+ 602us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:53.351626 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:53.353562 (+ 1936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:53.354020 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:53.354116 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:53.355283 (+ 1167us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:41:53.355291 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:41:53.355294 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:41:53.355312 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:41:53.355351 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:41:53.355366 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:41:53.355431 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0807 10:41:53.355593 (+ 162us) server_negotiation.cc:299] Negotiation successful
0807 10:41:53.355664 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260807 10:41:53.357209 11518 raft_consensus.cc:348] T 00000000000000000000000000000000 P c6f4d49832a84c179d3c1d525f6d8e4b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c6f4d49832a84c179d3c1d525f6d8e4b" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 34887 } }
I20260807 10:41:53.357591 11518 raft_consensus.cc:374] T 00000000000000000000000000000000 P c6f4d49832a84c179d3c1d525f6d8e4b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:41:53.357712 11518 raft_consensus.cc:729] T 00000000000000000000000000000000 P c6f4d49832a84c179d3c1d525f6d8e4b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6f4d49832a84c179d3c1d525f6d8e4b, State: Initialized, Role: FOLLOWER
I20260807 10:41:53.358264 11518 consensus_queue.cc:260] T 00000000000000000000000000000000 P c6f4d49832a84c179d3c1d525f6d8e4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c6f4d49832a84c179d3c1d525f6d8e4b" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 34887 } }
I20260807 10:41:53.358503 11518 raft_consensus.cc:388] T 00000000000000000000000000000000 P c6f4d49832a84c179d3c1d525f6d8e4b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 10:41:53.358676 11518 raft_consensus.cc:482] T 00000000000000000000000000000000 P c6f4d49832a84c179d3c1d525f6d8e4b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 10:41:53.358837 11518 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c6f4d49832a84c179d3c1d525f6d8e4b [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:41:53.361562 11518 raft_consensus.cc:504] T 00000000000000000000000000000000 P c6f4d49832a84c179d3c1d525f6d8e4b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c6f4d49832a84c179d3c1d525f6d8e4b" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 34887 } }
I20260807 10:41:53.362075 11518 leader_election.cc:302] T 00000000000000000000000000000000 P c6f4d49832a84c179d3c1d525f6d8e4b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c6f4d49832a84c179d3c1d525f6d8e4b; no voters:
I20260807 10:41:53.362643 11518 leader_election.cc:288] T 00000000000000000000000000000000 P c6f4d49832a84c179d3c1d525f6d8e4b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 10:41:53.362798 11528 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c6f4d49832a84c179d3c1d525f6d8e4b [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:41:53.363590 11528 raft_consensus.cc:686] T 00000000000000000000000000000000 P c6f4d49832a84c179d3c1d525f6d8e4b [term 1 LEADER]: Becoming Leader. State: Replica: c6f4d49832a84c179d3c1d525f6d8e4b, State: Running, Role: LEADER
I20260807 10:41:53.364176 11528 consensus_queue.cc:237] T 00000000000000000000000000000000 P c6f4d49832a84c179d3c1d525f6d8e4b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c6f4d49832a84c179d3c1d525f6d8e4b" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 34887 } }
I20260807 10:41:53.364974 11518 sys_catalog.cc:564] T 00000000000000000000000000000000 P c6f4d49832a84c179d3c1d525f6d8e4b [sys.catalog]: configured and running, proceeding with master startup.
I20260807 10:41:53.367026 11529 sys_catalog.cc:455] T 00000000000000000000000000000000 P c6f4d49832a84c179d3c1d525f6d8e4b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c6f4d49832a84c179d3c1d525f6d8e4b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c6f4d49832a84c179d3c1d525f6d8e4b" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 34887 } } }
I20260807 10:41:53.367717 11529 sys_catalog.cc:458] T 00000000000000000000000000000000 P c6f4d49832a84c179d3c1d525f6d8e4b [sys.catalog]: This master's current role is: LEADER
I20260807 10:41:53.370496 11530 sys_catalog.cc:455] T 00000000000000000000000000000000 P c6f4d49832a84c179d3c1d525f6d8e4b [sys.catalog]: SysCatalogTable state changed. Reason: New leader c6f4d49832a84c179d3c1d525f6d8e4b. Latest consensus state: current_term: 1 leader_uuid: "c6f4d49832a84c179d3c1d525f6d8e4b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c6f4d49832a84c179d3c1d525f6d8e4b" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 34887 } } }
I20260807 10:41:53.370792 11530 sys_catalog.cc:458] T 00000000000000000000000000000000 P c6f4d49832a84c179d3c1d525f6d8e4b [sys.catalog]: This master's current role is: LEADER
I20260807 10:41:53.370873 11533 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 10:41:53.376317 11533 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 10:41:53.385509 11533 catalog_manager.cc:1347] Generated new cluster ID: f325e0235fc2497db8c7e04db1c04f37
I20260807 10:41:53.385617 11533 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 10:41:53.409314 11533 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 10:41:53.411285 11533 catalog_manager.cc:1504] Loading token signing keys...
I20260807 10:41:53.423926 11533 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c6f4d49832a84c179d3c1d525f6d8e4b: Generated new TSK 0
I20260807 10:41:53.424829 11533 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 10:41:53.438426 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 11450
W20260807 10:41:53.439752 11513 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:50089
W20260807 10:41:53.440490 21165 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 11450: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260807 10:41:53.440636 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 11450
2026-08-07T10:41:53Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (2064 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786098956060137-21165-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 10:41:53 dist-test-slave-0b58 krb5kdc[11550](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 10:41:53 dist-test-slave-0b58 krb5kdc[11550](info): set up 2 sockets
Aug 07 10:41:53 dist-test-slave-0b58 krb5kdc[11550](info): commencing operation
krb5kdc: starting...
W20260807 10:41:54.594717 21165 mini_kdc.cc:121] Time spent starting KDC: real 1.114s user 0.000s sys 0.054s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786098956060137-21165-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786098956060137-21165-0/krb5kdc/test-user.keytab.
Aug 07 10:41:54 dist-test-slave-0b58 krb5kdc[11550](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099314, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T10:41:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T10:41:54Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.171.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.171.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.171.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.126.keytab.
Entry for principal kudu/127.20.171.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.126.keytab.
I20260807 10:41:54.953644 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786098956060137-21165-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786098956060137-21165-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786098956060137-21165-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.171.126:36537
--webserver_interface=127.20.171.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.126.keytab
--principal=kudu/127.20.171.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.171.84:42179
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.171.126:36537
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786098956060137-21165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786098956060137-21165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786098956060137-21165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:41:55.300977 11565 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:41:55.301273 11565 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:41:55.301468 11565 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:41:55.308852 11565 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 10:41:55.308992 11565 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:41:55.309082 11565 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:41:55.309183 11565 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 10:41:55.309250 11565 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 10:41:55.319350 11565 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.171.84:42179
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786098956060137-21165-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786098956060137-21165-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.171.126:36537
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.126.keytab
--principal=kudu/127.20.171.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.171.126:36537
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.171.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786098956060137-21165-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:41:55.320823 11565 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:41:55.322193 11565 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:41:55.334071 11570 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:41:55.334115 11571 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:41:55.334532 11573 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:41:55.335505 11565 server_base.cc:1034] running on GCE node
I20260807 10:41:55.336309 11565 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:41:55.337925 11565 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:41:55.339210 11565 hybrid_clock.cc:648] HybridClock initialized: now 1786099315339125 us; error 52 us; skew 500 ppm
I20260807 10:41:55.339592 11565 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:41:55 dist-test-slave-0b58 krb5kdc[11550](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099315, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:41:55.347761 11565 init.cc:377] Logged in from keytab as kudu/127.20.171.126@KRBTEST.COM (short username kudu)
I20260807 10:41:55.349385 11565 webserver.cc:460] Webserver started at http://127.20.171.126:38813/ using document root <none> and password file <none>
I20260807 10:41:55.350083 11565 fs_manager.cc:359] Metadata directory not provided
I20260807 10:41:55.350191 11565 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:41:55.350455 11565 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:41:55.353582 11565 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786098956060137-21165-0/minicluster-data/master-0/data/instance:
uuid: "b1b2a8797bb948b8801c47a7b22163fc"
format_stamp: "Formatted at 2026-08-07 10:41:55 on dist-test-slave-0b58"
server_key: "1f3aaf7b433be3e1c98bcd2b53ec2e40"
server_key_iv: "fb24b0fe16d41448289d13093ce4f76a"
server_key_version: "encryptionkey@0"
I20260807 10:41:55.354442 11565 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786098956060137-21165-0/minicluster-data/master-0/wal/instance:
uuid: "b1b2a8797bb948b8801c47a7b22163fc"
format_stamp: "Formatted at 2026-08-07 10:41:55 on dist-test-slave-0b58"
server_key: "1f3aaf7b433be3e1c98bcd2b53ec2e40"
server_key_iv: "fb24b0fe16d41448289d13093ce4f76a"
server_key_version: "encryptionkey@0"
I20260807 10:41:55.359793 11565 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260807 10:41:55.363260 11581 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:41:55.364676 11565 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 10:41:55.364817 11565 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786098956060137-21165-0/minicluster-data/master-0/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786098956060137-21165-0/minicluster-data/master-0/wal
uuid: "b1b2a8797bb948b8801c47a7b22163fc"
format_stamp: "Formatted at 2026-08-07 10:41:55 on dist-test-slave-0b58"
server_key: "1f3aaf7b433be3e1c98bcd2b53ec2e40"
server_key_iv: "fb24b0fe16d41448289d13093ce4f76a"
server_key_version: "encryptionkey@0"
I20260807 10:41:55.365007 11565 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786098956060137-21165-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786098956060137-21165-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786098956060137-21165-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:41:55.370775 11565 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:41:55.375136 11565 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:41:55.375388 11565 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:41:55.394604 11565 rpc_server.cc:307] RPC server started. Bound to: 127.20.171.126:36537
I20260807 10:41:55.394637 11634 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.171.126:36537 every 8 connection(s)
I20260807 10:41:55.396050 11565 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
I20260807 10:41:55.397516 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 11565
I20260807 10:41:55.397694 21165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786098956060137-21165-0/minicluster-data/master-0/wal/instance
I20260807 10:41:55.398145 21165 external_mini_cluster.cc:1428] Setting key 351085516911c9cbe3a1e70179c6046a
I20260807 10:41:55.400312 11635 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:41:55.407793 11638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:55.400232 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49087 (local address 127.20.171.126:36537)
0807 10:41:55.401635 (+ 1403us) server_negotiation.cc:206] Beginning negotiation
0807 10:41:55.401651 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 10:41:55.401706 (+ 55us) server_negotiation.cc:407] Connection header received
0807 10:41:55.403830 (+ 2124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:41:55.403857 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:41:55.404353 (+ 496us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:41:55.404799 (+ 446us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:41:55.405790 (+ 991us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:41:55.405798 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:41:55.405815 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:41:55.405844 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:41:55.405949 (+ 105us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:41:55.405976 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:41:55.406206 (+ 230us) server_negotiation.cc:1035] Waiting for connection context
0807 10:41:55.406340 (+ 134us) server_negotiation.cc:299] Negotiation successful
0807 10:41:55.406533 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1083,"thread_start_us":802,"threads_started":1}
I20260807 10:41:55.411530 21165 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 10:41:55.414776 11635 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b1b2a8797bb948b8801c47a7b22163fc: Bootstrap starting.
I20260807 10:41:55.418318 11635 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b1b2a8797bb948b8801c47a7b22163fc: Neither blocks nor log segments found. Creating new log.
I20260807 10:41:55.418570 11638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:55.415908 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34769 (local address 127.20.171.126:36537)
0807 10:41:55.416104 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0807 10:41:55.416110 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:41:55.416675 (+ 565us) server_negotiation.cc:407] Connection header received
0807 10:41:55.416816 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:41:55.416821 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:41:55.416888 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:41:55.416992 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:41:55.417871 (+ 879us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:41:55.417888 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:41:55.417892 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:41:55.417911 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:41:55.417956 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:41:55.417977 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:41:55.418100 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0807 10:41:55.418174 (+ 74us) server_negotiation.cc:299] Negotiation successful
0807 10:41:55.418242 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260807 10:41:55.419495 11635 log.cc:824] T 00000000000000000000000000000000 P b1b2a8797bb948b8801c47a7b22163fc: Log is configured to *not* fsync() on all Append() calls
I20260807 10:41:55.422240 11635 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b1b2a8797bb948b8801c47a7b22163fc: No bootstrap required, opened a new log
I20260807 10:41:55.429565 11635 raft_consensus.cc:348] T 00000000000000000000000000000000 P b1b2a8797bb948b8801c47a7b22163fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1b2a8797bb948b8801c47a7b22163fc" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 36537 } }
I20260807 10:41:55.429943 11635 raft_consensus.cc:374] T 00000000000000000000000000000000 P b1b2a8797bb948b8801c47a7b22163fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:41:55.430055 11635 raft_consensus.cc:729] T 00000000000000000000000000000000 P b1b2a8797bb948b8801c47a7b22163fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1b2a8797bb948b8801c47a7b22163fc, State: Initialized, Role: FOLLOWER
I20260807 10:41:55.430801 11635 consensus_queue.cc:260] T 00000000000000000000000000000000 P b1b2a8797bb948b8801c47a7b22163fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1b2a8797bb948b8801c47a7b22163fc" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 36537 } }
I20260807 10:41:55.431067 11635 raft_consensus.cc:388] T 00000000000000000000000000000000 P b1b2a8797bb948b8801c47a7b22163fc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 10:41:55.431247 11635 raft_consensus.cc:482] T 00000000000000000000000000000000 P b1b2a8797bb948b8801c47a7b22163fc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 10:41:55.431428 11635 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b1b2a8797bb948b8801c47a7b22163fc [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:41:55.433687 11635 raft_consensus.cc:504] T 00000000000000000000000000000000 P b1b2a8797bb948b8801c47a7b22163fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1b2a8797bb948b8801c47a7b22163fc" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 36537 } }
I20260807 10:41:55.434173 11635 leader_election.cc:302] T 00000000000000000000000000000000 P b1b2a8797bb948b8801c47a7b22163fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b1b2a8797bb948b8801c47a7b22163fc; no voters:
I20260807 10:41:55.434743 11635 leader_election.cc:288] T 00000000000000000000000000000000 P b1b2a8797bb948b8801c47a7b22163fc [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 10:41:55.434906 11645 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b1b2a8797bb948b8801c47a7b22163fc [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:41:55.435581 11645 raft_consensus.cc:686] T 00000000000000000000000000000000 P b1b2a8797bb948b8801c47a7b22163fc [term 1 LEADER]: Becoming Leader. State: Replica: b1b2a8797bb948b8801c47a7b22163fc, State: Running, Role: LEADER
I20260807 10:41:55.436137 11645 consensus_queue.cc:237] T 00000000000000000000000000000000 P b1b2a8797bb948b8801c47a7b22163fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1b2a8797bb948b8801c47a7b22163fc" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 36537 } }
I20260807 10:41:55.436866 11635 sys_catalog.cc:564] T 00000000000000000000000000000000 P b1b2a8797bb948b8801c47a7b22163fc [sys.catalog]: configured and running, proceeding with master startup.
I20260807 10:41:55.440032 11646 sys_catalog.cc:455] T 00000000000000000000000000000000 P b1b2a8797bb948b8801c47a7b22163fc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b1b2a8797bb948b8801c47a7b22163fc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1b2a8797bb948b8801c47a7b22163fc" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 36537 } } }
I20260807 10:41:55.440500 11646 sys_catalog.cc:458] T 00000000000000000000000000000000 P b1b2a8797bb948b8801c47a7b22163fc [sys.catalog]: This master's current role is: LEADER
I20260807 10:41:55.444664 11647 sys_catalog.cc:455] T 00000000000000000000000000000000 P b1b2a8797bb948b8801c47a7b22163fc [sys.catalog]: SysCatalogTable state changed. Reason: New leader b1b2a8797bb948b8801c47a7b22163fc. Latest consensus state: current_term: 1 leader_uuid: "b1b2a8797bb948b8801c47a7b22163fc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1b2a8797bb948b8801c47a7b22163fc" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 36537 } } }
I20260807 10:41:55.445046 11647 sys_catalog.cc:458] T 00000000000000000000000000000000 P b1b2a8797bb948b8801c47a7b22163fc [sys.catalog]: This master's current role is: LEADER
I20260807 10:41:55.446481 11654 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 10:41:55.451944 11654 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 10:41:55.460604 11654 catalog_manager.cc:1347] Generated new cluster ID: 7dbcab1dc7e74e889a7384f31934a42d
I20260807 10:41:55.460721 11654 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 10:41:55.490123 11654 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 10:41:55.490628 11654 catalog_manager.cc:1504] Loading token signing keys...
I20260807 10:41:55.507375 11654 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b1b2a8797bb948b8801c47a7b22163fc: Generated new TSK 0
I20260807 10:41:55.508450 11654 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 10:41:55.522694 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 11565
W20260807 10:41:55.524019 11630 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:49087
W20260807 10:41:55.524755 21165 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 11565: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260807 10:41:55.524916 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 11565
2026-08-07T10:41:55Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (2084 ms)
[----------] 18 tests from AuthTokenIssuingTest (38467 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786098956060137-21165-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 10:41:55 dist-test-slave-0b58 krb5kdc[11668](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 10:41:55 dist-test-slave-0b58 krb5kdc[11668](info): set up 2 sockets
Aug 07 10:41:55 dist-test-slave-0b58 krb5kdc[11668](info): commencing operation
krb5kdc: starting...
W20260807 10:41:56.691326 21165 mini_kdc.cc:121] Time spent starting KDC: real 1.126s user 0.001s sys 0.053s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786098956060137-21165-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786098956060137-21165-0/krb5kdc/test-user.keytab.
Aug 07 10:41:56 dist-test-slave-0b58 krb5kdc[11668](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099316, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T10:41:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T10:41:56Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.171.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.171.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.171.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.126.keytab.
Entry for principal kudu/127.20.171.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.126.keytab.
I20260807 10:41:57.047637 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786098956060137-21165-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786098956060137-21165-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786098956060137-21165-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.171.126:35415
--webserver_interface=127.20.171.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.126.keytab
--principal=kudu/127.20.171.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.171.84:46267
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.171.126:35415,127.20.171.125:36019,127.20.171.124:40255
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786098956060137-21165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786098956060137-21165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786098956060137-21165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:41:57.396456 11682 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260807 10:41:57.396807 11682 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:41:57.396966 11682 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:41:57.397087 11682 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:41:57.404524 11682 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 10:41:57.404608 11682 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:41:57.404702 11682 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:41:57.404795 11682 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 10:41:57.404902 11682 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 10:41:57.414774 11682 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.171.84:46267
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786098956060137-21165-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786098956060137-21165-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.171.126:35415,127.20.171.125:36019,127.20.171.124:40255
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.126.keytab
--principal=kudu/127.20.171.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.171.126:35415
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.171.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786098956060137-21165-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:41:57.416054 11682 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:41:57.417466 11682 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:41:57.429245 11691 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:41:57.429361 11687 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:41:57.429612 11689 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:41:57.430706 11682 server_base.cc:1034] running on GCE node
I20260807 10:41:57.431502 11682 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:41:57.432961 11682 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:41:57.434240 11682 hybrid_clock.cc:648] HybridClock initialized: now 1786099317434175 us; error 39 us; skew 500 ppm
I20260807 10:41:57.434568 11682 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:41:57 dist-test-slave-0b58 krb5kdc[11668](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099317, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:41:57.437703 11682 init.cc:377] Logged in from keytab as kudu/127.20.171.126@KRBTEST.COM (short username kudu)
I20260807 10:41:57.439060 11682 webserver.cc:460] Webserver started at http://127.20.171.126:34511/ using document root <none> and password file <none>
I20260807 10:41:57.439778 11682 fs_manager.cc:359] Metadata directory not provided
I20260807 10:41:57.439913 11682 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:41:57.440248 11682 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:41:57.443742 11682 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786098956060137-21165-0/minicluster-data/master-0/data/instance:
uuid: "fbc4f691c95c4b0bafe6254f69ea12e7"
format_stamp: "Formatted at 2026-08-07 10:41:57 on dist-test-slave-0b58"
server_key: "487abc5707710703497ef29415c14d9a"
server_key_iv: "4be89f89883a18347b46370ce3157ff3"
server_key_version: "encryptionkey@0"
I20260807 10:41:57.444634 11682 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786098956060137-21165-0/minicluster-data/master-0/wal/instance:
uuid: "fbc4f691c95c4b0bafe6254f69ea12e7"
format_stamp: "Formatted at 2026-08-07 10:41:57 on dist-test-slave-0b58"
server_key: "487abc5707710703497ef29415c14d9a"
server_key_iv: "4be89f89883a18347b46370ce3157ff3"
server_key_version: "encryptionkey@0"
I20260807 10:41:57.449748 11682 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260807 10:41:57.453135 11698 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:41:57.454383 11682 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260807 10:41:57.454564 11682 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786098956060137-21165-0/minicluster-data/master-0/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786098956060137-21165-0/minicluster-data/master-0/wal
uuid: "fbc4f691c95c4b0bafe6254f69ea12e7"
format_stamp: "Formatted at 2026-08-07 10:41:57 on dist-test-slave-0b58"
server_key: "487abc5707710703497ef29415c14d9a"
server_key_iv: "4be89f89883a18347b46370ce3157ff3"
server_key_version: "encryptionkey@0"
I20260807 10:41:57.454787 11682 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786098956060137-21165-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786098956060137-21165-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786098956060137-21165-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:41:57.490191 11682 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:41:57.495030 11682 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:41:57.495337 11682 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:41:57.515273 11682 rpc_server.cc:307] RPC server started. Bound to: 127.20.171.126:35415
I20260807 10:41:57.515313 11750 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.171.126:35415 every 8 connection(s)
I20260807 10:41:57.516773 11682 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
I20260807 10:41:57.520632 11751 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:41:57.523567 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 11682
I20260807 10:41:57.523833 21165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786098956060137-21165-0/minicluster-data/master-0/wal/instance
I20260807 10:41:57.524560 21165 external_mini_cluster.cc:1428] Setting key 6250967d2d5b2d296354d8be3feb67b0
I20260807 10:41:57.527439 11751 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.171.126" port: 35415 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 10:41:57 dist-test-slave-0b58 krb5kdc[11668](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099317, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.126@KRBTEST.COM for kudu/127.20.171.126@KRBTEST.COM
I20260807 10:41:57.549641 11753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:57.530538 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:35415 (local address 127.0.0.1:60662)
0807 10:41:57.531429 (+ 891us) negotiation.cc:107] Waiting for socket to connect
0807 10:41:57.531473 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0807 10:41:57.533521 (+ 2048us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:41:57.534357 (+ 836us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:41:57.534364 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:41:57.535063 (+ 699us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:41:57.535412 (+ 349us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:41:57.535429 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:41:57.537100 (+ 1671us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:41:57.537105 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:41:57.538169 (+ 1064us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:41:57.538182 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:41:57.539107 (+ 925us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:41:57.539114 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:41:57.539303 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:57.540007 (+ 704us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:41:57.540029 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:41:57.542249 (+ 2220us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:41:57.545481 (+ 3232us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:41:57.545495 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:41:57.545505 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:41:57.545891 (+ 386us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:41:57.546320 (+ 429us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:41:57.546324 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:41:57.546328 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:41:57.546482 (+ 154us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:41:57.547235 (+ 753us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:41:57.547243 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:41:57.547476 (+ 233us) client_negotiation.cc:769] Sending connection context
0807 10:41:57.547720 (+ 244us) client_negotiation.cc:240] Negotiation successful
0807 10:41:57.548320 (+ 600us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":615,"mutex_wait_us":137,"thread_start_us":404,"threads_started":1}
I20260807 10:41:57.549678 11754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:57.530538 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60662 (local address 127.20.171.126:35415)
0807 10:41:57.532290 (+ 1752us) server_negotiation.cc:206] Beginning negotiation
0807 10:41:57.532297 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:41:57.532350 (+ 53us) server_negotiation.cc:407] Connection header received
0807 10:41:57.533892 (+ 1542us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:41:57.533897 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:41:57.534120 (+ 223us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:41:57.534338 (+ 218us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:41:57.535627 (+ 1289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:57.536935 (+ 1308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:57.538315 (+ 1380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:57.538873 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:57.539071 (+ 198us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:57.542475 (+ 3404us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:41:57.542483 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:41:57.542494 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:41:57.542525 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:41:57.545355 (+ 2830us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:41:57.546017 (+ 662us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:41:57.546032 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:41:57.546035 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:41:57.546200 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:41:57.546587 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:41:57.546595 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:41:57.546598 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:41:57.547082 (+ 484us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:41:57.547295 (+ 213us) server_negotiation.cc:1035] Waiting for connection context
0807 10:41:57.547846 (+ 551us) server_negotiation.cc:299] Negotiation successful
0807 10:41:57.548156 (+ 310us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":1507,"thread_start_us":1279,"threads_started":1}
I20260807 10:41:57.552755 11751 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.171.125" port: 36019 } has no permanent_uuid. Determining permanent_uuid...
I20260807 10:41:57.553836 11753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:57.553444 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.125:36019 (local address 127.0.0.1:60444)
0807 10:41:57.553609 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0807 10:41:57.553725 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.125:36019: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
W20260807 10:41:57.554117 11701 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.171.125:36019: connect: Connection refused (error 111)
I20260807 10:41:57.555723 11753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:57.555361 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.125:36019 (local address 127.0.0.1:60446)
0807 10:41:57.555545 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0807 10:41:57.555607 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.125:36019: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260807 10:41:57.555917 11751 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.171.125:36019: Network error: Client connection negotiation failed: client connection to 127.20.171.125:36019: connect: Connection refused (error 111)
WARNING: no policy specified for kudu/127.20.171.125@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.171.125@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.171.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.125.keytab.
Entry for principal kudu/127.20.171.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.125.keytab.
I20260807 10:41:57.599843 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786098956060137-21165-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786098956060137-21165-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786098956060137-21165-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786098956060137-21165-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.171.125:36019
--webserver_interface=127.20.171.125
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.125.keytab
--principal=kudu/127.20.171.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.171.84:46267
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.171.126:35415,127.20.171.125:36019,127.20.171.124:40255
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786098956060137-21165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786098956060137-21165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786098956060137-21165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 10:41:57.605252 11751 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.171.125" port: 36019 } attempt: 1
I20260807 10:41:57.606432 11753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:57.605951 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.125:36019 (local address 127.0.0.1:60454)
0807 10:41:57.606162 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0807 10:41:57.606280 (+ 118us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.125:36019: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
I20260807 10:41:57.607374 11753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:57.607040 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.125:36019 (local address 127.0.0.1:60470)
0807 10:41:57.607182 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0807 10:41:57.607251 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.125:36019: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260807 10:41:57.607555 11751 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.171.125:36019: Network error: Client connection negotiation failed: client connection to 127.20.171.125:36019: connect: Connection refused (error 111)
I20260807 10:41:57.675839 11751 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.171.125" port: 36019 } attempt: 2
I20260807 10:41:57.677117 11753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:57.676558 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.125:36019 (local address 127.0.0.1:60476)
0807 10:41:57.676816 (+ 258us) negotiation.cc:107] Waiting for socket to connect
0807 10:41:57.676953 (+ 137us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.125:36019: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
I20260807 10:41:57.678123 11753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:57.677764 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.125:36019 (local address 127.0.0.1:60490)
0807 10:41:57.677913 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0807 10:41:57.678004 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.125:36019: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260807 10:41:57.678340 11751 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.171.125:36019: Network error: Client connection negotiation failed: client connection to 127.20.171.125:36019: connect: Connection refused (error 111)
I20260807 10:41:57.769614 11751 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.171.125" port: 36019 } attempt: 3
I20260807 10:41:57.770733 11753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:57.770300 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.125:36019 (local address 127.0.0.1:60502)
0807 10:41:57.770500 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0807 10:41:57.770600 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.125:36019: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
I20260807 10:41:57.771844 11753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:57.771521 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.125:36019 (local address 127.0.0.1:60514)
0807 10:41:57.771656 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0807 10:41:57.771720 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.125:36019: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260807 10:41:57.772121 11751 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.171.125:36019: Network error: Client connection negotiation failed: client connection to 127.20.171.125:36019: connect: Connection refused (error 111)
I20260807 10:41:57.915401 11751 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.171.125" port: 36019 } attempt: 4
I20260807 10:41:57.916797 11753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:57.916197 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.125:36019 (local address 127.0.0.1:60526)
0807 10:41:57.916572 (+ 375us) negotiation.cc:107] Waiting for socket to connect
0807 10:41:57.916658 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.125:36019: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":219}
I20260807 10:41:57.917873 11753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:57.917560 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.125:36019 (local address 127.0.0.1:60540)
0807 10:41:57.917689 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0807 10:41:57.917764 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.125:36019: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260807 10:41:57.918129 11751 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.171.125:36019: Network error: Client connection negotiation failed: client connection to 127.20.171.125:36019: connect: Connection refused (error 111)
W20260807 10:41:57.949995 11758 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260807 10:41:57.950346 11758 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:41:57.950475 11758 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:41:57.950610 11758 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:41:57.958160 11758 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 10:41:57.958281 11758 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:41:57.958392 11758 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:41:57.958488 11758 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 10:41:57.958576 11758 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 10:41:57.968724 11758 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.171.84:46267
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786098956060137-21165-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786098956060137-21165-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.20.171.126:35415,127.20.171.125:36019,127.20.171.124:40255
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.125.keytab
--principal=kudu/127.20.171.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.171.125:36019
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786098956060137-21165-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.20.171.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786098956060137-21165-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:41:57.970018 11758 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:41:57.971323 11758 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:41:57.983013 11767 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:41:57.983121 11764 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:41:57.983099 11765 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:41:57.984071 11758 server_base.cc:1034] running on GCE node
I20260807 10:41:57.984838 11758 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:41:57.986130 11758 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:41:57.987349 11758 hybrid_clock.cc:648] HybridClock initialized: now 1786099317987281 us; error 49 us; skew 500 ppm
I20260807 10:41:57.987658 11758 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:41:57 dist-test-slave-0b58 krb5kdc[11668](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099317, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:41:57.990841 11758 init.cc:377] Logged in from keytab as kudu/127.20.171.125@KRBTEST.COM (short username kudu)
I20260807 10:41:57.992372 11758 webserver.cc:460] Webserver started at http://127.20.171.125:46147/ using document root <none> and password file <none>
I20260807 10:41:57.993050 11758 fs_manager.cc:359] Metadata directory not provided
I20260807 10:41:57.993183 11758 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:41:57.993500 11758 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:41:57.996539 11758 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786098956060137-21165-0/minicluster-data/master-1/data/instance:
uuid: "f7b46ae7b0254f899628a24c913e8707"
format_stamp: "Formatted at 2026-08-07 10:41:57 on dist-test-slave-0b58"
server_key: "6530f0af4e157bd5d761bfc2d5ffa6cb"
server_key_iv: "7a82e8a471238c7141ab5bc503fcda45"
server_key_version: "encryptionkey@0"
I20260807 10:41:57.997355 11758 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786098956060137-21165-0/minicluster-data/master-1/wal/instance:
uuid: "f7b46ae7b0254f899628a24c913e8707"
format_stamp: "Formatted at 2026-08-07 10:41:57 on dist-test-slave-0b58"
server_key: "6530f0af4e157bd5d761bfc2d5ffa6cb"
server_key_iv: "7a82e8a471238c7141ab5bc503fcda45"
server_key_version: "encryptionkey@0"
I20260807 10:41:58.002553 11758 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260807 10:41:58.006037 11774 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:41:58.007309 11758 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260807 10:41:58.007493 11758 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786098956060137-21165-0/minicluster-data/master-1/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786098956060137-21165-0/minicluster-data/master-1/wal
uuid: "f7b46ae7b0254f899628a24c913e8707"
format_stamp: "Formatted at 2026-08-07 10:41:57 on dist-test-slave-0b58"
server_key: "6530f0af4e157bd5d761bfc2d5ffa6cb"
server_key_iv: "7a82e8a471238c7141ab5bc503fcda45"
server_key_version: "encryptionkey@0"
I20260807 10:41:58.007710 11758 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786098956060137-21165-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786098956060137-21165-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786098956060137-21165-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:41:58.033407 11758 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:41:58.037976 11758 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:41:58.038269 11758 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:41:58.057191 11758 rpc_server.cc:307] RPC server started. Bound to: 127.20.171.125:36019
I20260807 10:41:58.057219 11826 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.171.125:36019 every 8 connection(s)
I20260807 10:41:58.058684 11758 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786098956060137-21165-0/minicluster-data/master-1/data/info.pb
I20260807 10:41:58.062526 11827 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:41:58.065279 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 11758
I20260807 10:41:58.065481 21165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786098956060137-21165-0/minicluster-data/master-1/wal/instance
I20260807 10:41:58.065910 21165 external_mini_cluster.cc:1428] Setting key 4f1ada85643f51fffd4b95e8ffd58ce1
I20260807 10:41:58.069320 11827 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.171.126" port: 35415 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 10:41:58 dist-test-slave-0b58 krb5kdc[11668](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099317, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.125@KRBTEST.COM for kudu/127.20.171.126@KRBTEST.COM
I20260807 10:41:58.090679 11829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:58.071989 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60672 (local address 127.20.171.126:35415)
0807 10:41:58.072538 (+ 549us) server_negotiation.cc:206] Beginning negotiation
0807 10:41:58.072543 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:41:58.073551 (+ 1008us) server_negotiation.cc:407] Connection header received
0807 10:41:58.075460 (+ 1909us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:41:58.075466 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:41:58.075556 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:41:58.075679 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:41:58.077315 (+ 1636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:58.078046 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:58.079551 (+ 1505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:58.079995 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:58.080136 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:58.084576 (+ 4440us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:41:58.084581 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:41:58.084584 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:41:58.084630 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:41:58.087456 (+ 2826us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:41:58.088235 (+ 779us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:41:58.088241 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:41:58.088243 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:41:58.088417 (+ 174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:41:58.088875 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:41:58.088880 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:41:58.088884 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:41:58.089177 (+ 293us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:41:58.089357 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0807 10:41:58.090077 (+ 720us) server_negotiation.cc:299] Negotiation successful
0807 10:41:58.090301 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":434,"thread_start_us":312,"threads_started":1}
I20260807 10:41:58.091668 11830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:58.072598 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:35415 (local address 127.0.0.1:60672)
0807 10:41:58.073380 (+ 782us) negotiation.cc:107] Waiting for socket to connect
0807 10:41:58.073424 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0807 10:41:58.075188 (+ 1764us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:41:58.075927 (+ 739us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:41:58.075936 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:41:58.076522 (+ 586us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:41:58.077086 (+ 564us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:41:58.077103 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:41:58.078213 (+ 1110us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:41:58.078217 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:41:58.079401 (+ 1184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:41:58.079414 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:41:58.080232 (+ 818us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:41:58.080240 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:41:58.080496 (+ 256us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:58.081248 (+ 752us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:41:58.081286 (+ 38us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:41:58.084348 (+ 3062us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:41:58.087609 (+ 3261us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:41:58.087618 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:41:58.087634 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:41:58.088096 (+ 462us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:41:58.088553 (+ 457us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:41:58.088558 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:41:58.088562 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:41:58.088749 (+ 187us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:41:58.089327 (+ 578us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:41:58.089335 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:41:58.089696 (+ 361us) client_negotiation.cc:769] Sending connection context
0807 10:41:58.089971 (+ 275us) client_negotiation.cc:240] Negotiation successful
0807 10:41:58.090512 (+ 541us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":546,"thread_start_us":339,"threads_started":1}
I20260807 10:41:58.093699 11827 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.171.125" port: 36019 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.20.171.124@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.171.124@KRBTEST.COM" created.
Aug 07 10:41:58 dist-test-slave-0b58 krb5kdc[11668](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099317, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.125@KRBTEST.COM for kudu/127.20.171.125@KRBTEST.COM
I20260807 10:41:58.111485 11830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:58.094534 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.125:36019 (local address 127.0.0.1:60546)
0807 10:41:58.094745 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0807 10:41:58.094767 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0807 10:41:58.094897 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:41:58.095828 (+ 931us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:41:58.095831 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:41:58.096188 (+ 357us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:41:58.096392 (+ 204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:41:58.096401 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:41:58.098529 (+ 2128us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:41:58.098533 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:41:58.099370 (+ 837us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:41:58.099380 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:41:58.100613 (+ 1233us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:41:58.100617 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:41:58.100762 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:58.101334 (+ 572us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:41:58.101351 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:41:58.105281 (+ 3930us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:41:58.108458 (+ 3177us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:41:58.108466 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:41:58.108472 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:41:58.109005 (+ 533us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:41:58.109419 (+ 414us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:41:58.109426 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:41:58.109432 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:41:58.109589 (+ 157us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:41:58.110229 (+ 640us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:41:58.110238 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:41:58.110416 (+ 178us) client_negotiation.cc:769] Sending connection context
0807 10:41:58.110585 (+ 169us) client_negotiation.cc:240] Negotiation successful
0807 10:41:58.110887 (+ 302us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":65}
I20260807 10:41:58.111515 11832 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:58.094613 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60546 (local address 127.20.171.125:36019)
0807 10:41:58.095302 (+ 689us) server_negotiation.cc:206] Beginning negotiation
0807 10:41:58.095312 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 10:41:58.095348 (+ 36us) server_negotiation.cc:407] Connection header received
0807 10:41:58.095410 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:41:58.095421 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:41:58.095657 (+ 236us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:41:58.095824 (+ 167us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:41:58.096565 (+ 741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:58.098389 (+ 1824us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:58.099510 (+ 1121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:58.100477 (+ 967us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:58.100622 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:58.105493 (+ 4871us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:41:58.105504 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:41:58.105517 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:41:58.105549 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:41:58.108329 (+ 2780us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:41:58.109132 (+ 803us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:41:58.109138 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:41:58.109140 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:41:58.109293 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:41:58.109697 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:41:58.109700 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:41:58.109702 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:41:58.110031 (+ 329us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:41:58.110186 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0807 10:41:58.110738 (+ 552us) server_negotiation.cc:299] Negotiation successful
0807 10:41:58.111062 (+ 324us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":476,"thread_start_us":326,"threads_started":1}
I20260807 10:41:58.114041 11827 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.171.124" port: 40255 } has no permanent_uuid. Determining permanent_uuid...
I20260807 10:41:58.115134 11830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:58.114725 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.124:40255 (local address 127.0.0.1:43936)
0807 10:41:58.114873 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0807 10:41:58.115002 (+ 129us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.124:40255: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
W20260807 10:41:58.115402 11777 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.171.124:40255: connect: Connection refused (error 111)
I20260807 10:41:58.116942 11830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:58.116630 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.124:40255 (local address 127.0.0.1:43952)
0807 10:41:58.116782 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0807 10:41:58.116852 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.124:40255: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260807 10:41:58.117252 11827 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.171.124:40255: Network error: Client connection negotiation failed: client connection to 127.20.171.124:40255: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.171.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.124.keytab.
Entry for principal kudu/127.20.171.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.124.keytab.
I20260807 10:41:58.142630 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786098956060137-21165-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786098956060137-21165-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786098956060137-21165-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786098956060137-21165-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.171.124:40255
--webserver_interface=127.20.171.124
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.124.keytab
--principal=kudu/127.20.171.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.171.84:46267
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.171.126:35415,127.20.171.125:36019,127.20.171.124:40255
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786098956060137-21165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786098956060137-21165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786098956060137-21165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 10:41:58.166586 11827 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.171.124" port: 40255 } attempt: 1
I20260807 10:41:58.167865 11830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:58.167398 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.124:40255 (local address 127.0.0.1:43956)
0807 10:41:58.167595 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0807 10:41:58.167706 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.124:40255: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":75}
I20260807 10:41:58.169005 11830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:58.168684 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.124:40255 (local address 127.0.0.1:43960)
0807 10:41:58.168818 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0807 10:41:58.168906 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.124:40255: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260807 10:41:58.169299 11827 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.171.124:40255: Network error: Client connection negotiation failed: client connection to 127.20.171.124:40255: connect: Connection refused (error 111)
I20260807 10:41:58.217396 11751 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.171.125" port: 36019 } attempt: 5
Aug 07 10:41:58 dist-test-slave-0b58 krb5kdc[11668](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099317, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.126@KRBTEST.COM for kudu/127.20.171.125@KRBTEST.COM
I20260807 10:41:58.233659 11753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:58.218151 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.125:36019 (local address 127.0.0.1:60552)
0807 10:41:58.218383 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0807 10:41:58.218405 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0807 10:41:58.218549 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:41:58.218945 (+ 396us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:41:58.218950 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:41:58.219364 (+ 414us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:41:58.219550 (+ 186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:41:58.219559 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:41:58.220641 (+ 1082us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:41:58.220649 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:41:58.221537 (+ 888us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:41:58.221549 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:41:58.222287 (+ 738us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:41:58.222293 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:41:58.222564 (+ 271us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:58.223324 (+ 760us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:41:58.223348 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:41:58.226667 (+ 3319us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:41:58.230904 (+ 4237us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:41:58.230909 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:41:58.230914 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:41:58.231495 (+ 581us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:41:58.232022 (+ 527us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:41:58.232027 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:41:58.232031 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:41:58.232206 (+ 175us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:41:58.232890 (+ 684us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:41:58.232894 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:41:58.233028 (+ 134us) client_negotiation.cc:769] Sending connection context
0807 10:41:58.233158 (+ 130us) client_negotiation.cc:240] Negotiation successful
0807 10:41:58.233402 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":80}
I20260807 10:41:58.233915 11832 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:58.218246 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60552 (local address 127.20.171.125:36019)
0807 10:41:58.218456 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0807 10:41:58.218461 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:41:58.218483 (+ 22us) server_negotiation.cc:407] Connection header received
0807 10:41:58.218701 (+ 218us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:41:58.218705 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:41:58.218788 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:41:58.218898 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:41:58.219712 (+ 814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:58.220504 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:58.221698 (+ 1194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:58.222120 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:58.222261 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:58.226917 (+ 4656us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:41:58.226924 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:41:58.226928 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:41:58.226969 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:41:58.230732 (+ 3763us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:41:58.231645 (+ 913us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:41:58.231668 (+ 23us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:41:58.231673 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:41:58.231862 (+ 189us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:41:58.232358 (+ 496us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:41:58.232363 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:41:58.232366 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:41:58.232753 (+ 387us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:41:58.232931 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0807 10:41:58.233291 (+ 360us) server_negotiation.cc:299] Negotiation successful
0807 10:41:58.233540 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260807 10:41:58.234992 11751 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.171.124" port: 40255 } has no permanent_uuid. Determining permanent_uuid...
I20260807 10:41:58.236112 11753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:58.235746 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.124:40255 (local address 127.0.0.1:43974)
0807 10:41:58.235912 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0807 10:41:58.235986 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.124:40255: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
I20260807 10:41:58.237042 11753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:58.236721 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.124:40255 (local address 127.0.0.1:43980)
0807 10:41:58.236856 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0807 10:41:58.236932 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.124:40255: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260807 10:41:58.237268 11751 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.171.124:40255: Network error: Client connection negotiation failed: client connection to 127.20.171.124:40255: connect: Connection refused (error 111)
I20260807 10:41:58.237504 11827 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.171.124" port: 40255 } attempt: 2
I20260807 10:41:58.238353 11830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:58.237999 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.124:40255 (local address 127.0.0.1:43984)
0807 10:41:58.238153 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0807 10:41:58.238225 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.124:40255: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
I20260807 10:41:58.239239 11830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:58.238933 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.124:40255 (local address 127.0.0.1:43994)
0807 10:41:58.239081 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0807 10:41:58.239144 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.124:40255: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260807 10:41:58.239470 11827 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.171.124:40255: Network error: Client connection negotiation failed: client connection to 127.20.171.124:40255: connect: Connection refused (error 111)
I20260807 10:41:58.288479 11751 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.171.124" port: 40255 } attempt: 1
I20260807 10:41:58.289790 11753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:58.289177 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.124:40255 (local address 127.0.0.1:44004)
0807 10:41:58.289425 (+ 248us) negotiation.cc:107] Waiting for socket to connect
0807 10:41:58.289543 (+ 118us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.124:40255: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":83}
I20260807 10:41:58.290957 11753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:58.290559 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.124:40255 (local address 127.0.0.1:44016)
0807 10:41:58.290725 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0807 10:41:58.290817 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.124:40255: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260807 10:41:58.291178 11751 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.171.124:40255: Network error: Client connection negotiation failed: client connection to 127.20.171.124:40255: connect: Connection refused (error 111)
I20260807 10:41:58.330670 11827 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.171.124" port: 40255 } attempt: 3
I20260807 10:41:58.331980 11830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:58.331320 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.124:40255 (local address 127.0.0.1:44030)
0807 10:41:58.331578 (+ 258us) negotiation.cc:107] Waiting for socket to connect
0807 10:41:58.331725 (+ 147us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.124:40255: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":78}
I20260807 10:41:58.333276 11830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:58.332718 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.124:40255 (local address 127.0.0.1:44042)
0807 10:41:58.332994 (+ 276us) negotiation.cc:107] Waiting for socket to connect
0807 10:41:58.333111 (+ 117us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.124:40255: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":140}
W20260807 10:41:58.333582 11827 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.171.124:40255: Network error: Client connection negotiation failed: client connection to 127.20.171.124:40255: connect: Connection refused (error 111)
I20260807 10:41:58.359417 11751 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.171.124" port: 40255 } attempt: 2
I20260807 10:41:58.360687 11753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:58.360074 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.124:40255 (local address 127.0.0.1:44050)
0807 10:41:58.360342 (+ 268us) negotiation.cc:107] Waiting for socket to connect
0807 10:41:58.360460 (+ 118us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.124:40255: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":75}
I20260807 10:41:58.361825 11753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:58.361446 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.124:40255 (local address 127.0.0.1:44066)
0807 10:41:58.361604 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0807 10:41:58.361696 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.124:40255: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260807 10:41:58.362033 11751 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.171.124:40255: Network error: Client connection negotiation failed: client connection to 127.20.171.124:40255: connect: Connection refused (error 111)
I20260807 10:41:58.468288 11751 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.171.124" port: 40255 } attempt: 3
I20260807 10:41:58.469564 11753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:58.468982 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.124:40255 (local address 127.0.0.1:44068)
0807 10:41:58.469231 (+ 249us) negotiation.cc:107] Waiting for socket to connect
0807 10:41:58.469353 (+ 122us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.124:40255: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":76}
I20260807 10:41:58.470705 11753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:58.470257 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.124:40255 (local address 127.0.0.1:44074)
0807 10:41:58.470457 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0807 10:41:58.470564 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.124:40255: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260807 10:41:58.470933 11751 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.171.124:40255: Network error: Client connection negotiation failed: client connection to 127.20.171.124:40255: connect: Connection refused (error 111)
I20260807 10:41:58.476831 11827 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.171.124" port: 40255 } attempt: 4
I20260807 10:41:58.477949 11830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:58.477445 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.124:40255 (local address 127.0.0.1:44076)
0807 10:41:58.477678 (+ 233us) negotiation.cc:107] Waiting for socket to connect
0807 10:41:58.477778 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.124:40255: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
I20260807 10:41:58.478974 11830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:58.478576 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.124:40255 (local address 127.0.0.1:44080)
0807 10:41:58.478745 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0807 10:41:58.478830 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.124:40255: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260807 10:41:58.479214 11827 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.171.124:40255: Network error: Client connection negotiation failed: client connection to 127.20.171.124:40255: connect: Connection refused (error 111)
W20260807 10:41:58.499747 11835 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260807 10:41:58.500046 11835 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:41:58.500110 11835 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:41:58.500187 11835 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:41:58.507848 11835 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 10:41:58.507933 11835 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:41:58.507990 11835 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:41:58.508042 11835 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 10:41:58.508096 11835 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 10:41:58.520143 11835 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.171.84:46267
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786098956060137-21165-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786098956060137-21165-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.20.171.126:35415,127.20.171.125:36019,127.20.171.124:40255
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.124.keytab
--principal=kudu/127.20.171.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.171.124:40255
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786098956060137-21165-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.20.171.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786098956060137-21165-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:41:58.521696 11835 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:41:58.523360 11835 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:41:58.535645 11840 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:41:58.535609 11843 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:41:58.535800 11841 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:41:58.536624 11835 server_base.cc:1034] running on GCE node
I20260807 10:41:58.537312 11835 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:41:58.538586 11835 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:41:58.539821 11835 hybrid_clock.cc:648] HybridClock initialized: now 1786099318539754 us; error 31 us; skew 500 ppm
I20260807 10:41:58.540182 11835 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:41:58 dist-test-slave-0b58 krb5kdc[11668](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099318, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:41:58.543521 11835 init.cc:377] Logged in from keytab as kudu/127.20.171.124@KRBTEST.COM (short username kudu)
I20260807 10:41:58.545048 11835 webserver.cc:460] Webserver started at http://127.20.171.124:34427/ using document root <none> and password file <none>
I20260807 10:41:58.545746 11835 fs_manager.cc:359] Metadata directory not provided
I20260807 10:41:58.545864 11835 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:41:58.546202 11835 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:41:58.549211 11835 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786098956060137-21165-0/minicluster-data/master-2/data/instance:
uuid: "e5923704feef4ec287ac98f894afa5bb"
format_stamp: "Formatted at 2026-08-07 10:41:58 on dist-test-slave-0b58"
server_key: "dc01f63a046164c99b2445f9abb5c43c"
server_key_iv: "e994d9b7e4c64b3dc7d6d6ddcc086ae2"
server_key_version: "encryptionkey@0"
I20260807 10:41:58.550011 11835 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786098956060137-21165-0/minicluster-data/master-2/wal/instance:
uuid: "e5923704feef4ec287ac98f894afa5bb"
format_stamp: "Formatted at 2026-08-07 10:41:58 on dist-test-slave-0b58"
server_key: "dc01f63a046164c99b2445f9abb5c43c"
server_key_iv: "e994d9b7e4c64b3dc7d6d6ddcc086ae2"
server_key_version: "encryptionkey@0"
I20260807 10:41:58.555351 11835 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260807 10:41:58.558964 11850 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:41:58.560438 11835 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 10:41:58.560621 11835 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786098956060137-21165-0/minicluster-data/master-2/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786098956060137-21165-0/minicluster-data/master-2/wal
uuid: "e5923704feef4ec287ac98f894afa5bb"
format_stamp: "Formatted at 2026-08-07 10:41:58 on dist-test-slave-0b58"
server_key: "dc01f63a046164c99b2445f9abb5c43c"
server_key_iv: "e994d9b7e4c64b3dc7d6d6ddcc086ae2"
server_key_version: "encryptionkey@0"
I20260807 10:41:58.560883 11835 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786098956060137-21165-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786098956060137-21165-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786098956060137-21165-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:41:58.589286 11835 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:41:58.593608 11835 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:41:58.593886 11835 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:41:58.612502 11835 rpc_server.cc:307] RPC server started. Bound to: 127.20.171.124:40255
I20260807 10:41:58.612522 11902 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.171.124:40255 every 8 connection(s)
I20260807 10:41:58.613778 11835 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786098956060137-21165-0/minicluster-data/master-2/data/info.pb
I20260807 10:41:58.617443 11903 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:41:58.618609 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 11835
I20260807 10:41:58.618810 21165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786098956060137-21165-0/minicluster-data/master-2/wal/instance
I20260807 10:41:58.619253 21165 external_mini_cluster.cc:1428] Setting key f62bdc102e4b4ee3b10e6fd3819fee16
I20260807 10:41:58.626632 11903 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.171.126" port: 35415 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 10:41:58 dist-test-slave-0b58 krb5kdc[11668](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099316, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.171.124@KRBTEST.COM
Aug 07 10:41:58 dist-test-slave-0b58 krb5kdc[11668](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099318, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.124@KRBTEST.COM for kudu/127.20.171.126@KRBTEST.COM
I20260807 10:41:58.641471 11906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:58.621067 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44082 (local address 127.20.171.124:40255)
0807 10:41:58.621895 (+ 828us) server_negotiation.cc:206] Beginning negotiation
0807 10:41:58.621907 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 10:41:58.621951 (+ 44us) server_negotiation.cc:407] Connection header received
0807 10:41:58.623517 (+ 1566us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:41:58.623538 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:41:58.623901 (+ 363us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:41:58.624214 (+ 313us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:41:58.626047 (+ 1833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:58.627345 (+ 1298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:58.629164 (+ 1819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:58.630076 (+ 912us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:58.630278 (+ 202us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:58.634416 (+ 4138us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:41:58.634424 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:41:58.634434 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:41:58.634468 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:41:58.637566 (+ 3098us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:41:58.638240 (+ 674us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:41:58.638246 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:41:58.638252 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:41:58.638400 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:41:58.638795 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:41:58.638799 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:41:58.638801 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:41:58.639266 (+ 465us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:41:58.639585 (+ 319us) server_negotiation.cc:1035] Waiting for connection context
0807 10:41:58.640033 (+ 448us) server_negotiation.cc:299] Negotiation successful
0807 10:41:58.640454 (+ 421us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":630,"thread_start_us":380,"threads_started":1}
I20260807 10:41:58.643440 11907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:58.629294 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60684 (local address 127.20.171.126:35415)
0807 10:41:58.629808 (+ 514us) server_negotiation.cc:206] Beginning negotiation
0807 10:41:58.629814 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:41:58.630506 (+ 692us) server_negotiation.cc:407] Connection header received
0807 10:41:58.630588 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:41:58.630592 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:41:58.630652 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:41:58.630767 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:41:58.631812 (+ 1045us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:58.632577 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:58.633911 (+ 1334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:58.634320 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:58.634451 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:58.638006 (+ 3555us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:41:58.638011 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:41:58.638014 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:41:58.638054 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:41:58.640791 (+ 2737us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:41:58.641462 (+ 671us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:41:58.641470 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:41:58.641475 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:41:58.641647 (+ 172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:41:58.642038 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:41:58.642043 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:41:58.642047 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:41:58.642310 (+ 263us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:41:58.642466 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0807 10:41:58.642990 (+ 524us) server_negotiation.cc:299] Negotiation successful
0807 10:41:58.643153 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":385,"thread_start_us":236,"threads_started":1}
I20260807 10:41:58.643632 11908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:58.629328 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:35415 (local address 127.0.0.1:60684)
0807 10:41:58.630219 (+ 891us) negotiation.cc:107] Waiting for socket to connect
0807 10:41:58.630258 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0807 10:41:58.630410 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:41:58.630832 (+ 422us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:41:58.630839 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:41:58.631421 (+ 582us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:41:58.631661 (+ 240us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:41:58.631669 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:41:58.632718 (+ 1049us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:41:58.632730 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:41:58.633752 (+ 1022us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:41:58.633764 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:41:58.634506 (+ 742us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:41:58.634512 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:41:58.634705 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:58.635453 (+ 748us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:41:58.635476 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:41:58.637818 (+ 2342us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:41:58.640920 (+ 3102us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:41:58.640930 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:41:58.640937 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:41:58.641338 (+ 401us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:41:58.641784 (+ 446us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:41:58.641788 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:41:58.641790 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:41:58.641913 (+ 123us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:41:58.642441 (+ 528us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:41:58.642448 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:41:58.642676 (+ 228us) client_negotiation.cc:769] Sending connection context
0807 10:41:58.642903 (+ 227us) client_negotiation.cc:240] Negotiation successful
0807 10:41:58.643209 (+ 306us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":668,"thread_start_us":535,"threads_started":1}
I20260807 10:41:58.645181 11903 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.171.125" port: 36019 } has no permanent_uuid. Determining permanent_uuid...
I20260807 10:41:58.648141 11751 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.171.124" port: 40255 } attempt: 4
Aug 07 10:41:58 dist-test-slave-0b58 krb5kdc[11668](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099318, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.124@KRBTEST.COM for kudu/127.20.171.125@KRBTEST.COM
Aug 07 10:41:58 dist-test-slave-0b58 krb5kdc[11668](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099316, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.171.126@KRBTEST.COM
Aug 07 10:41:58 dist-test-slave-0b58 krb5kdc[11668](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099317, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.126@KRBTEST.COM for kudu/127.20.171.124@KRBTEST.COM
I20260807 10:41:58.661844 11908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:58.645793 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.125:36019 (local address 127.0.0.1:60554)
0807 10:41:58.646267 (+ 474us) negotiation.cc:107] Waiting for socket to connect
0807 10:41:58.646285 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 10:41:58.646392 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:41:58.646748 (+ 356us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:41:58.646754 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:41:58.647191 (+ 437us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:41:58.647358 (+ 167us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:41:58.647368 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:41:58.648779 (+ 1411us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:41:58.648787 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:41:58.650000 (+ 1213us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:41:58.650012 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:41:58.651143 (+ 1131us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:41:58.651148 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:41:58.651327 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:58.651949 (+ 622us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:41:58.651971 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:41:58.654577 (+ 2606us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:41:58.658930 (+ 4353us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:41:58.658935 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:41:58.658939 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:41:58.659530 (+ 591us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:41:58.659971 (+ 441us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:41:58.659976 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:41:58.659980 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:41:58.660174 (+ 194us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:41:58.660813 (+ 639us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:41:58.660818 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:41:58.661002 (+ 184us) client_negotiation.cc:769] Sending connection context
0807 10:41:58.661177 (+ 175us) client_negotiation.cc:240] Negotiation successful
0807 10:41:58.661478 (+ 301us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":357}
I20260807 10:41:58.662009 11832 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:58.646067 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60554 (local address 127.20.171.125:36019)
0807 10:41:58.646257 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0807 10:41:58.646262 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:41:58.646340 (+ 78us) server_negotiation.cc:407] Connection header received
0807 10:41:58.646555 (+ 215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:41:58.646560 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:41:58.646624 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:41:58.646698 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:41:58.647491 (+ 793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:58.648587 (+ 1096us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:58.650142 (+ 1555us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:58.650803 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:58.650935 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:58.654767 (+ 3832us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:41:58.654773 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:41:58.654778 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:41:58.654825 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:41:58.658692 (+ 3867us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:41:58.659643 (+ 951us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:41:58.659650 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:41:58.659654 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:41:58.659822 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:41:58.660324 (+ 502us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:41:58.660332 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:41:58.660336 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:41:58.660671 (+ 335us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:41:58.660845 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0807 10:41:58.661270 (+ 425us) server_negotiation.cc:299] Negotiation successful
0807 10:41:58.661598 (+ 328us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260807 10:41:58.662954 11907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:58.644582 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60690 (local address 127.20.171.126:35415)
0807 10:41:58.644724 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0807 10:41:58.644728 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 10:41:58.644904 (+ 176us) server_negotiation.cc:407] Connection header received
0807 10:41:58.645078 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:41:58.645082 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:41:58.645168 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:41:58.645271 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:41:58.646503 (+ 1232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:58.647497 (+ 994us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:58.649615 (+ 2118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:58.650295 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:58.650417 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:58.655882 (+ 5465us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:41:58.655889 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:41:58.655895 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:41:58.655941 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:41:58.659137 (+ 3196us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:41:58.659924 (+ 787us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:41:58.659930 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:41:58.659933 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:41:58.660055 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:41:58.660531 (+ 476us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:41:58.660539 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:41:58.660546 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:41:58.660927 (+ 381us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:41:58.661207 (+ 280us) server_negotiation.cc:1035] Waiting for connection context
0807 10:41:58.662339 (+ 1132us) server_negotiation.cc:299] Negotiation successful
0807 10:41:58.662563 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260807 10:41:58.663755 11903 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.171.124" port: 40255 } has no permanent_uuid. Determining permanent_uuid...
I20260807 10:41:58.665585 11753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:58.648704 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.124:40255 (local address 127.0.0.1:44088)
0807 10:41:58.648868 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0807 10:41:58.648884 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 10:41:58.648981 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:41:58.649351 (+ 370us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:41:58.649355 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:41:58.649844 (+ 489us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:41:58.650055 (+ 211us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:41:58.650067 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:41:58.651704 (+ 1637us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:41:58.651712 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:41:58.653338 (+ 1626us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:41:58.653356 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:41:58.654466 (+ 1110us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:41:58.654476 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:41:58.654682 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:58.655332 (+ 650us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:41:58.655355 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:41:58.658116 (+ 2761us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:41:58.662329 (+ 4213us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:41:58.662337 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:41:58.662343 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:41:58.662863 (+ 520us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:41:58.663293 (+ 430us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:41:58.663308 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:41:58.663311 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:41:58.663481 (+ 170us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:41:58.664301 (+ 820us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:41:58.664306 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:41:58.664475 (+ 169us) client_negotiation.cc:769] Sending connection context
0807 10:41:58.664619 (+ 144us) client_negotiation.cc:240] Negotiation successful
0807 10:41:58.664881 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":53}
I20260807 10:41:58.667245 11906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:58.648928 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44088 (local address 127.20.171.124:40255)
0807 10:41:58.649097 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0807 10:41:58.649102 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:41:58.649120 (+ 18us) server_negotiation.cc:407] Connection header received
0807 10:41:58.649166 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:41:58.649169 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:41:58.649217 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:41:58.649333 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:41:58.650224 (+ 891us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:58.651537 (+ 1313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:58.653556 (+ 2019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:58.654287 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:58.654447 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:58.658344 (+ 3897us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:41:58.658354 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:41:58.658362 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:41:58.658452 (+ 90us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:41:58.662147 (+ 3695us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:41:58.662995 (+ 848us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:41:58.663003 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:41:58.663006 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:41:58.663154 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:41:58.663627 (+ 473us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:41:58.663634 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:41:58.663640 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:41:58.664135 (+ 495us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:41:58.664325 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0807 10:41:58.666595 (+ 2270us) server_negotiation.cc:299] Negotiation successful
0807 10:41:58.666846 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58,"spinlock_wait_cycles":21248}
I20260807 10:41:58.673355 11751 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fbc4f691c95c4b0bafe6254f69ea12e7: Bootstrap starting.
Aug 07 10:41:58 dist-test-slave-0b58 krb5kdc[11668](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099318, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.124@KRBTEST.COM for kudu/127.20.171.124@KRBTEST.COM
Aug 07 10:41:58 dist-test-slave-0b58 krb5kdc[11668](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099316, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.171.125@KRBTEST.COM
I20260807 10:41:58.677670 11751 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fbc4f691c95c4b0bafe6254f69ea12e7: Neither blocks nor log segments found. Creating new log.
I20260807 10:41:58.679070 11751 log.cc:824] T 00000000000000000000000000000000 P fbc4f691c95c4b0bafe6254f69ea12e7: Log is configured to *not* fsync() on all Append() calls
I20260807 10:41:58.680961 11908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:58.664537 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.124:40255 (local address 127.0.0.1:44104)
0807 10:41:58.666059 (+ 1522us) negotiation.cc:107] Waiting for socket to connect
0807 10:41:58.666081 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0807 10:41:58.666208 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:41:58.667085 (+ 877us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:41:58.667089 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:41:58.667584 (+ 495us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:41:58.667779 (+ 195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:41:58.667797 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:41:58.669615 (+ 1818us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:41:58.669620 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:41:58.671024 (+ 1404us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:41:58.671039 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:41:58.671704 (+ 665us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:41:58.671710 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:41:58.671901 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:58.672492 (+ 591us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:41:58.672509 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:41:58.674404 (+ 1895us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:41:58.678216 (+ 3812us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:41:58.678222 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:41:58.678226 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:41:58.678610 (+ 384us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:41:58.678974 (+ 364us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:41:58.678981 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:41:58.678984 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:41:58.679116 (+ 132us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:41:58.679842 (+ 726us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:41:58.679845 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:41:58.680014 (+ 169us) client_negotiation.cc:769] Sending connection context
0807 10:41:58.680207 (+ 193us) client_negotiation.cc:240] Negotiation successful
0807 10:41:58.680568 (+ 361us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1376}
I20260807 10:41:58.681408 11909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:58.664819 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44104 (local address 127.20.171.124:40255)
0807 10:41:58.666799 (+ 1980us) server_negotiation.cc:206] Beginning negotiation
0807 10:41:58.666804 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:41:58.666824 (+ 20us) server_negotiation.cc:407] Connection header received
0807 10:41:58.666868 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:41:58.666872 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:41:58.666935 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:41:58.667919 (+ 984us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:41:58.668192 (+ 273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:58.669470 (+ 1278us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:58.671168 (+ 1698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:58.671545 (+ 377us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:58.671666 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:58.674605 (+ 2939us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:41:58.674610 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:41:58.674614 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:41:58.674640 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:41:58.678099 (+ 3459us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:41:58.678726 (+ 627us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:41:58.678735 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:41:58.678738 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:41:58.678863 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:41:58.679288 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:41:58.679296 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:41:58.679299 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:41:58.679602 (+ 303us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:41:58.679787 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0807 10:41:58.680365 (+ 578us) server_negotiation.cc:299] Negotiation successful
0807 10:41:58.680732 (+ 367us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":129,"server-negotiator.queue_time_us":1854,"thread_start_us":1667,"threads_started":1}
I20260807 10:41:58.682875 11751 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fbc4f691c95c4b0bafe6254f69ea12e7: No bootstrap required, opened a new log
I20260807 10:41:58.683115 11832 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:58.665161 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60556 (local address 127.20.171.125:36019)
0807 10:41:58.665320 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0807 10:41:58.665325 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:41:58.665340 (+ 15us) server_negotiation.cc:407] Connection header received
0807 10:41:58.665387 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:41:58.665390 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:41:58.665439 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:41:58.665540 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:41:58.666880 (+ 1340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:58.667818 (+ 938us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:58.669656 (+ 1838us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:58.670299 (+ 643us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:58.670427 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:58.676073 (+ 5646us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:41:58.676080 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:41:58.676086 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:41:58.676134 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:41:58.679929 (+ 3795us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:41:58.680802 (+ 873us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:41:58.680817 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:41:58.680821 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:41:58.681016 (+ 195us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:41:58.681511 (+ 495us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:41:58.681519 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:41:58.681524 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:41:58.681908 (+ 384us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:41:58.682194 (+ 286us) server_negotiation.cc:1035] Waiting for connection context
0807 10:41:58.682510 (+ 316us) server_negotiation.cc:299] Negotiation successful
0807 10:41:58.682773 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260807 10:41:58.685930 11903 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e5923704feef4ec287ac98f894afa5bb: Bootstrap starting.
I20260807 10:41:58.688795 11903 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e5923704feef4ec287ac98f894afa5bb: Neither blocks nor log segments found. Creating new log.
I20260807 10:41:58.690101 11903 log.cc:824] T 00000000000000000000000000000000 P e5923704feef4ec287ac98f894afa5bb: Log is configured to *not* fsync() on all Append() calls
I20260807 10:41:58.690797 11751 raft_consensus.cc:348] T 00000000000000000000000000000000 P fbc4f691c95c4b0bafe6254f69ea12e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbc4f691c95c4b0bafe6254f69ea12e7" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 35415 } } peers { permanent_uuid: "f7b46ae7b0254f899628a24c913e8707" member_type: VOTER last_known_addr { host: "127.20.171.125" port: 36019 } } peers { permanent_uuid: "e5923704feef4ec287ac98f894afa5bb" member_type: VOTER last_known_addr { host: "127.20.171.124" port: 40255 } }
I20260807 10:41:58.691220 11751 raft_consensus.cc:729] T 00000000000000000000000000000000 P fbc4f691c95c4b0bafe6254f69ea12e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fbc4f691c95c4b0bafe6254f69ea12e7, State: Initialized, Role: FOLLOWER
I20260807 10:41:58.691751 11751 consensus_queue.cc:260] T 00000000000000000000000000000000 P fbc4f691c95c4b0bafe6254f69ea12e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbc4f691c95c4b0bafe6254f69ea12e7" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 35415 } } peers { permanent_uuid: "f7b46ae7b0254f899628a24c913e8707" member_type: VOTER last_known_addr { host: "127.20.171.125" port: 36019 } } peers { permanent_uuid: "e5923704feef4ec287ac98f894afa5bb" member_type: VOTER last_known_addr { host: "127.20.171.124" port: 40255 } }
I20260807 10:41:58.693213 11903 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e5923704feef4ec287ac98f894afa5bb: No bootstrap required, opened a new log
I20260807 10:41:58.692823 11912 sys_catalog.cc:455] T 00000000000000000000000000000000 P fbc4f691c95c4b0bafe6254f69ea12e7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbc4f691c95c4b0bafe6254f69ea12e7" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 35415 } } peers { permanent_uuid: "f7b46ae7b0254f899628a24c913e8707" member_type: VOTER last_known_addr { host: "127.20.171.125" port: 36019 } } peers { permanent_uuid: "e5923704feef4ec287ac98f894afa5bb" member_type: VOTER last_known_addr { host: "127.20.171.124" port: 40255 } } }
I20260807 10:41:58.693658 11912 sys_catalog.cc:458] T 00000000000000000000000000000000 P fbc4f691c95c4b0bafe6254f69ea12e7 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 10:41:58.694365 11751 sys_catalog.cc:564] T 00000000000000000000000000000000 P fbc4f691c95c4b0bafe6254f69ea12e7 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 10:41:58.694518 21165 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 10:41:58.698304 11725 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "fbc4f691c95c4b0bafe6254f69ea12e7"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60690
I20260807 10:41:58.698904 11725 raft_consensus.cc:482] T 00000000000000000000000000000000 P fbc4f691c95c4b0bafe6254f69ea12e7 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 10:41:58.699147 11725 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fbc4f691c95c4b0bafe6254f69ea12e7 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:41:58.702032 11903 raft_consensus.cc:348] T 00000000000000000000000000000000 P e5923704feef4ec287ac98f894afa5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbc4f691c95c4b0bafe6254f69ea12e7" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 35415 } } peers { permanent_uuid: "f7b46ae7b0254f899628a24c913e8707" member_type: VOTER last_known_addr { host: "127.20.171.125" port: 36019 } } peers { permanent_uuid: "e5923704feef4ec287ac98f894afa5bb" member_type: VOTER last_known_addr { host: "127.20.171.124" port: 40255 } }
I20260807 10:41:58.702378 11903 raft_consensus.cc:729] T 00000000000000000000000000000000 P e5923704feef4ec287ac98f894afa5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5923704feef4ec287ac98f894afa5bb, State: Initialized, Role: FOLLOWER
I20260807 10:41:58.702930 11903 consensus_queue.cc:260] T 00000000000000000000000000000000 P e5923704feef4ec287ac98f894afa5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbc4f691c95c4b0bafe6254f69ea12e7" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 35415 } } peers { permanent_uuid: "f7b46ae7b0254f899628a24c913e8707" member_type: VOTER last_known_addr { host: "127.20.171.125" port: 36019 } } peers { permanent_uuid: "e5923704feef4ec287ac98f894afa5bb" member_type: VOTER last_known_addr { host: "127.20.171.124" port: 40255 } }
I20260807 10:41:58.703554 11725 raft_consensus.cc:504] T 00000000000000000000000000000000 P fbc4f691c95c4b0bafe6254f69ea12e7 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbc4f691c95c4b0bafe6254f69ea12e7" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 35415 } } peers { permanent_uuid: "f7b46ae7b0254f899628a24c913e8707" member_type: VOTER last_known_addr { host: "127.20.171.125" port: 36019 } } peers { permanent_uuid: "e5923704feef4ec287ac98f894afa5bb" member_type: VOTER last_known_addr { host: "127.20.171.124" port: 40255 } }
I20260807 10:41:58.703944 11919 sys_catalog.cc:455] T 00000000000000000000000000000000 P e5923704feef4ec287ac98f894afa5bb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbc4f691c95c4b0bafe6254f69ea12e7" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 35415 } } peers { permanent_uuid: "f7b46ae7b0254f899628a24c913e8707" member_type: VOTER last_known_addr { host: "127.20.171.125" port: 36019 } } peers { permanent_uuid: "e5923704feef4ec287ac98f894afa5bb" member_type: VOTER last_known_addr { host: "127.20.171.124" port: 40255 } } }
I20260807 10:41:58.704478 11919 sys_catalog.cc:458] T 00000000000000000000000000000000 P e5923704feef4ec287ac98f894afa5bb [sys.catalog]: This master's current role is: FOLLOWER
I20260807 10:41:58.705334 11903 sys_catalog.cc:564] T 00000000000000000000000000000000 P e5923704feef4ec287ac98f894afa5bb [sys.catalog]: configured and running, proceeding with master startup.
I20260807 10:41:58.706547 11725 leader_election.cc:288] T 00000000000000000000000000000000 P fbc4f691c95c4b0bafe6254f69ea12e7 [CANDIDATE]: Term 1 election: Requested vote from peers f7b46ae7b0254f899628a24c913e8707 (127.20.171.125:36019), e5923704feef4ec287ac98f894afa5bb (127.20.171.124:40255)
I20260807 10:41:58.706893 11878 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "fbc4f691c95c4b0bafe6254f69ea12e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "e5923704feef4ec287ac98f894afa5bb"
I20260807 10:41:58.707436 11878 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e5923704feef4ec287ac98f894afa5bb [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:41:58.711853 11878 raft_consensus.cc:2454] T 00000000000000000000000000000000 P e5923704feef4ec287ac98f894afa5bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbc4f691c95c4b0bafe6254f69ea12e7 in term 1.
I20260807 10:41:58.712556 11701 leader_election.cc:302] T 00000000000000000000000000000000 P fbc4f691c95c4b0bafe6254f69ea12e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5923704feef4ec287ac98f894afa5bb, fbc4f691c95c4b0bafe6254f69ea12e7; no voters:
I20260807 10:41:58.713140 11912 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fbc4f691c95c4b0bafe6254f69ea12e7 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:41:58.715365 11912 raft_consensus.cc:686] T 00000000000000000000000000000000 P fbc4f691c95c4b0bafe6254f69ea12e7 [term 1 LEADER]: Becoming Leader. State: Replica: fbc4f691c95c4b0bafe6254f69ea12e7, State: Running, Role: LEADER
I20260807 10:41:58.716012 11912 consensus_queue.cc:237] T 00000000000000000000000000000000 P fbc4f691c95c4b0bafe6254f69ea12e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbc4f691c95c4b0bafe6254f69ea12e7" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 35415 } } peers { permanent_uuid: "f7b46ae7b0254f899628a24c913e8707" member_type: VOTER last_known_addr { host: "127.20.171.125" port: 36019 } } peers { permanent_uuid: "e5923704feef4ec287ac98f894afa5bb" member_type: VOTER last_known_addr { host: "127.20.171.124" port: 40255 } }
I20260807 10:41:58.722654 11929 sys_catalog.cc:455] T 00000000000000000000000000000000 P fbc4f691c95c4b0bafe6254f69ea12e7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fbc4f691c95c4b0bafe6254f69ea12e7. Latest consensus state: current_term: 1 leader_uuid: "fbc4f691c95c4b0bafe6254f69ea12e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbc4f691c95c4b0bafe6254f69ea12e7" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 35415 } } peers { permanent_uuid: "f7b46ae7b0254f899628a24c913e8707" member_type: VOTER last_known_addr { host: "127.20.171.125" port: 36019 } } peers { permanent_uuid: "e5923704feef4ec287ac98f894afa5bb" member_type: VOTER last_known_addr { host: "127.20.171.124" port: 40255 } } }
I20260807 10:41:58.723157 11929 sys_catalog.cc:458] T 00000000000000000000000000000000 P fbc4f691c95c4b0bafe6254f69ea12e7 [sys.catalog]: This master's current role is: LEADER
W20260807 10:41:58.738524 11938 catalog_manager.cc:1558] T 00000000000000000000000000000000 P fbc4f691c95c4b0bafe6254f69ea12e7: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 10:41:58.738675 11938 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 10:41:58.739753 11939 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 10:41:58.742187 11939 catalog_manager.cc:1484] Initializing Kudu cluster ID...
W20260807 10:41:58.748337 11704 tablet.cc:2369] T 00000000000000000000000000000000 P fbc4f691c95c4b0bafe6254f69ea12e7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 10:41:58.755674 11907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:58.719872 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60706 (local address 127.20.171.126:35415)
0807 10:41:58.720058 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0807 10:41:58.720063 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:41:58.721786 (+ 1723us) server_negotiation.cc:407] Connection header received
0807 10:41:58.722020 (+ 234us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:41:58.722029 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:41:58.722142 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:41:58.722274 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:41:58.732356 (+ 10082us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:58.733777 (+ 1421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:58.737732 (+ 3955us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:58.738424 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:58.738537 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:58.742698 (+ 4161us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:41:58.742704 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:41:58.742709 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:41:58.742786 (+ 77us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:41:58.748351 (+ 5565us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:41:58.751071 (+ 2720us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:41:58.751083 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:41:58.751086 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:41:58.751250 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:41:58.753638 (+ 2388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:41:58.753643 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:41:58.753647 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:41:58.754109 (+ 462us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:41:58.754406 (+ 297us) server_negotiation.cc:1035] Waiting for connection context
0807 10:41:58.754981 (+ 575us) server_negotiation.cc:299] Negotiation successful
0807 10:41:58.755257 (+ 276us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260807 10:41:58.756996 11832 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:58.719434 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60570 (local address 127.20.171.125:36019)
0807 10:41:58.719635 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0807 10:41:58.719644 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 10:41:58.725345 (+ 5701us) server_negotiation.cc:407] Connection header received
0807 10:41:58.728226 (+ 2881us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:41:58.728235 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:41:58.728357 (+ 122us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:41:58.728442 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:41:58.731218 (+ 2776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:58.732663 (+ 1445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:58.734588 (+ 1925us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:58.735315 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:58.735509 (+ 194us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:58.749752 (+ 14243us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:41:58.749760 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:41:58.749765 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:41:58.749814 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:41:58.753640 (+ 3826us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:41:58.754509 (+ 869us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:41:58.754515 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:41:58.754518 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:41:58.754682 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:41:58.755155 (+ 473us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:41:58.755163 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:41:58.755168 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:41:58.755549 (+ 381us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:41:58.755779 (+ 230us) server_negotiation.cc:1035] Waiting for connection context
0807 10:41:58.756394 (+ 615us) server_negotiation.cc:299] Negotiation successful
0807 10:41:58.756635 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260807 10:41:58.764636 11878 raft_consensus.cc:1261] T 00000000000000000000000000000000 P e5923704feef4ec287ac98f894afa5bb [term 1 FOLLOWER]: Refusing update from remote peer fbc4f691c95c4b0bafe6254f69ea12e7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 10:41:58.726891 11682 master_runner.cc:186] Error getting master registration for 127.20.171.125:36019: OK, instance_id { permanent_uuid: "f7b46ae7b0254f899628a24c913e8707" instance_seqno: 1786099318051842 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260807 10:41:58.766693 11929 consensus_queue.cc:1035] T 00000000000000000000000000000000 P fbc4f691c95c4b0bafe6254f69ea12e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5923704feef4ec287ac98f894afa5bb" member_type: VOTER last_known_addr { host: "127.20.171.124" port: 40255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 10:41:58.767243 11682 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260807 10:41:58.767971 11909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:58.725637 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44118 (local address 127.20.171.124:40255)
0807 10:41:58.725837 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0807 10:41:58.725843 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:41:58.739302 (+ 13459us) server_negotiation.cc:407] Connection header received
0807 10:41:58.739501 (+ 199us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:41:58.739508 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:41:58.739588 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:41:58.739687 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:41:58.746704 (+ 7017us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:58.747902 (+ 1198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:58.751775 (+ 3873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:58.752547 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:58.752654 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:58.760607 (+ 7953us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:41:58.760615 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:41:58.760620 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:41:58.760666 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:41:58.764472 (+ 3806us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:41:58.765383 (+ 911us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:41:58.765389 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:41:58.765394 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:41:58.765555 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:41:58.766056 (+ 501us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:41:58.766061 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:41:58.766064 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:41:58.766481 (+ 417us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:41:58.766755 (+ 274us) server_negotiation.cc:1035] Waiting for connection context
0807 10:41:58.767326 (+ 571us) server_negotiation.cc:299] Negotiation successful
0807 10:41:58.767589 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260807 10:41:58.778539 11827 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.171.124" port: 40255 } attempt: 5
I20260807 10:41:58.786863 11919 sys_catalog.cc:455] T 00000000000000000000000000000000 P e5923704feef4ec287ac98f894afa5bb [sys.catalog]: SysCatalogTable state changed. Reason: New leader fbc4f691c95c4b0bafe6254f69ea12e7. Latest consensus state: current_term: 1 leader_uuid: "fbc4f691c95c4b0bafe6254f69ea12e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbc4f691c95c4b0bafe6254f69ea12e7" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 35415 } } peers { permanent_uuid: "f7b46ae7b0254f899628a24c913e8707" member_type: VOTER last_known_addr { host: "127.20.171.125" port: 36019 } } peers { permanent_uuid: "e5923704feef4ec287ac98f894afa5bb" member_type: VOTER last_known_addr { host: "127.20.171.124" port: 40255 } } }
I20260807 10:41:58.787184 11919 sys_catalog.cc:458] T 00000000000000000000000000000000 P e5923704feef4ec287ac98f894afa5bb [sys.catalog]: This master's current role is: FOLLOWER
I20260807 10:41:58.788604 11951 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
Aug 07 10:41:58 dist-test-slave-0b58 krb5kdc[11668](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099317, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.125@KRBTEST.COM for kudu/127.20.171.124@KRBTEST.COM
I20260807 10:41:58.791383 11949 mvcc.cc:205] Tried to move back new op lower bound from 7315862809644298240 to 7315862809466679296. Current Snapshot: MvccSnapshot[applied={T|T < 7315862809644298240}]
I20260807 10:41:58.791977 11929 sys_catalog.cc:455] T 00000000000000000000000000000000 P fbc4f691c95c4b0bafe6254f69ea12e7 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "fbc4f691c95c4b0bafe6254f69ea12e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbc4f691c95c4b0bafe6254f69ea12e7" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 35415 } } peers { permanent_uuid: "f7b46ae7b0254f899628a24c913e8707" member_type: VOTER last_known_addr { host: "127.20.171.125" port: 36019 } } peers { permanent_uuid: "e5923704feef4ec287ac98f894afa5bb" member_type: VOTER last_known_addr { host: "127.20.171.124" port: 40255 } } }
I20260807 10:41:58.792351 11929 sys_catalog.cc:458] T 00000000000000000000000000000000 P fbc4f691c95c4b0bafe6254f69ea12e7 [sys.catalog]: This master's current role is: LEADER
I20260807 10:41:58.805444 11939 catalog_manager.cc:1347] Generated new cluster ID: f68b2cee52804bfbbf1c625c438f28e1
I20260807 10:41:58.805553 11939 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 10:41:58.806195 11919 sys_catalog.cc:455] T 00000000000000000000000000000000 P e5923704feef4ec287ac98f894afa5bb [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "fbc4f691c95c4b0bafe6254f69ea12e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbc4f691c95c4b0bafe6254f69ea12e7" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 35415 } } peers { permanent_uuid: "f7b46ae7b0254f899628a24c913e8707" member_type: VOTER last_known_addr { host: "127.20.171.125" port: 36019 } } peers { permanent_uuid: "e5923704feef4ec287ac98f894afa5bb" member_type: VOTER last_known_addr { host: "127.20.171.124" port: 40255 } } }
I20260807 10:41:58.806474 11919 sys_catalog.cc:458] T 00000000000000000000000000000000 P e5923704feef4ec287ac98f894afa5bb [sys.catalog]: This master's current role is: FOLLOWER
I20260807 10:41:58.810070 11830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:58.779132 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.124:40255 (local address 127.0.0.1:44122)
0807 10:41:58.779393 (+ 261us) negotiation.cc:107] Waiting for socket to connect
0807 10:41:58.779417 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0807 10:41:58.779532 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:41:58.780586 (+ 1054us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:41:58.780590 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:41:58.781029 (+ 439us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:41:58.781184 (+ 155us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:41:58.781194 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:41:58.782775 (+ 1581us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:41:58.782782 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:41:58.784173 (+ 1391us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:41:58.784190 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:41:58.785361 (+ 1171us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:41:58.785368 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:41:58.785615 (+ 247us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:58.789320 (+ 3705us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:41:58.789344 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:41:58.793577 (+ 4233us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:41:58.807042 (+ 13465us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:41:58.807048 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:41:58.807053 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:41:58.807611 (+ 558us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:41:58.808056 (+ 445us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:41:58.808061 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:41:58.808065 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:41:58.808228 (+ 163us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:41:58.809087 (+ 859us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:41:58.809092 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:41:58.809291 (+ 199us) client_negotiation.cc:769] Sending connection context
0807 10:41:58.809427 (+ 136us) client_negotiation.cc:240] Negotiation successful
0807 10:41:58.809710 (+ 283us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137}
I20260807 10:41:58.811131 11909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:58.780076 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44122 (local address 127.20.171.124:40255)
0807 10:41:58.780291 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0807 10:41:58.780297 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:41:58.780317 (+ 20us) server_negotiation.cc:407] Connection header received
0807 10:41:58.780370 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:41:58.780376 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:41:58.780448 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:41:58.780553 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:41:58.781351 (+ 798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:58.782634 (+ 1283us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:58.784526 (+ 1892us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:58.785174 (+ 648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:58.785324 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:58.793888 (+ 8564us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:41:58.793897 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:41:58.793905 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:41:58.793959 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:41:58.806825 (+ 12866us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:41:58.807743 (+ 918us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:41:58.807750 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:41:58.807754 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:41:58.807909 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:41:58.808385 (+ 476us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:41:58.808391 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:41:58.808394 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:41:58.808841 (+ 447us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:41:58.809023 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0807 10:41:58.810502 (+ 1479us) server_negotiation.cc:299] Negotiation successful
0807 10:41:58.810790 (+ 288us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260807 10:41:58.797616 11835 master_runner.cc:186] Error getting master registration for 127.20.171.125:36019: OK, instance_id { permanent_uuid: "f7b46ae7b0254f899628a24c913e8707" instance_seqno: 1786099318051842 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260807 10:41:58.814299 11835 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260807 10:41:58.816865 11827 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f7b46ae7b0254f899628a24c913e8707: Bootstrap starting.
I20260807 10:41:58.820317 11939 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 10:41:58.821105 11827 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f7b46ae7b0254f899628a24c913e8707: Neither blocks nor log segments found. Creating new log.
I20260807 10:41:58.822187 11939 catalog_manager.cc:1504] Loading token signing keys...
I20260807 10:41:58.822489 11827 log.cc:824] T 00000000000000000000000000000000 P f7b46ae7b0254f899628a24c913e8707: Log is configured to *not* fsync() on all Append() calls
I20260807 10:41:58.826421 11827 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f7b46ae7b0254f899628a24c913e8707: No bootstrap required, opened a new log
I20260807 10:41:58.836206 11939 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fbc4f691c95c4b0bafe6254f69ea12e7: Generated new TSK 0
I20260807 10:41:58.837308 11939 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 10:41:58.837549 11827 raft_consensus.cc:348] T 00000000000000000000000000000000 P f7b46ae7b0254f899628a24c913e8707 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbc4f691c95c4b0bafe6254f69ea12e7" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 35415 } } peers { permanent_uuid: "f7b46ae7b0254f899628a24c913e8707" member_type: VOTER last_known_addr { host: "127.20.171.125" port: 36019 } } peers { permanent_uuid: "e5923704feef4ec287ac98f894afa5bb" member_type: VOTER last_known_addr { host: "127.20.171.124" port: 40255 } }
I20260807 10:41:58.837998 11827 raft_consensus.cc:729] T 00000000000000000000000000000000 P f7b46ae7b0254f899628a24c913e8707 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7b46ae7b0254f899628a24c913e8707, State: Initialized, Role: FOLLOWER
I20260807 10:41:58.838522 11827 consensus_queue.cc:260] T 00000000000000000000000000000000 P f7b46ae7b0254f899628a24c913e8707 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbc4f691c95c4b0bafe6254f69ea12e7" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 35415 } } peers { permanent_uuid: "f7b46ae7b0254f899628a24c913e8707" member_type: VOTER last_known_addr { host: "127.20.171.125" port: 36019 } } peers { permanent_uuid: "e5923704feef4ec287ac98f894afa5bb" member_type: VOTER last_known_addr { host: "127.20.171.124" port: 40255 } }
I20260807 10:41:58.839610 11955 sys_catalog.cc:455] T 00000000000000000000000000000000 P f7b46ae7b0254f899628a24c913e8707 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbc4f691c95c4b0bafe6254f69ea12e7" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 35415 } } peers { permanent_uuid: "f7b46ae7b0254f899628a24c913e8707" member_type: VOTER last_known_addr { host: "127.20.171.125" port: 36019 } } peers { permanent_uuid: "e5923704feef4ec287ac98f894afa5bb" member_type: VOTER last_known_addr { host: "127.20.171.124" port: 40255 } } }
I20260807 10:41:58.840020 11955 sys_catalog.cc:458] T 00000000000000000000000000000000 P f7b46ae7b0254f899628a24c913e8707 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 10:41:58.840903 11827 sys_catalog.cc:564] T 00000000000000000000000000000000 P f7b46ae7b0254f899628a24c913e8707 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 10:41:58.840957 11801 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "fbc4f691c95c4b0bafe6254f69ea12e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "f7b46ae7b0254f899628a24c913e8707"
I20260807 10:41:58.841312 11800 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f7b46ae7b0254f899628a24c913e8707 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:41:58.844244 11800 raft_consensus.cc:1261] T 00000000000000000000000000000000 P f7b46ae7b0254f899628a24c913e8707 [term 1 FOLLOWER]: Refusing update from remote peer fbc4f691c95c4b0bafe6254f69ea12e7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 10:41:58.847350 11912 consensus_queue.cc:1035] T 00000000000000000000000000000000 P fbc4f691c95c4b0bafe6254f69ea12e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7b46ae7b0254f899628a24c913e8707" member_type: VOTER last_known_addr { host: "127.20.171.125" port: 36019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 10:41:58.850309 11801 raft_consensus.cc:2454] T 00000000000000000000000000000000 P f7b46ae7b0254f899628a24c913e8707 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbc4f691c95c4b0bafe6254f69ea12e7 in term 1.
I20260807 10:41:58.889482 11965 sys_catalog.cc:455] T 00000000000000000000000000000000 P f7b46ae7b0254f899628a24c913e8707 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "fbc4f691c95c4b0bafe6254f69ea12e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbc4f691c95c4b0bafe6254f69ea12e7" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 35415 } } peers { permanent_uuid: "f7b46ae7b0254f899628a24c913e8707" member_type: VOTER last_known_addr { host: "127.20.171.125" port: 36019 } } peers { permanent_uuid: "e5923704feef4ec287ac98f894afa5bb" member_type: VOTER last_known_addr { host: "127.20.171.124" port: 40255 } } }
I20260807 10:41:58.890165 11965 sys_catalog.cc:458] T 00000000000000000000000000000000 P f7b46ae7b0254f899628a24c913e8707 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 10:41:58.890614 11955 sys_catalog.cc:455] T 00000000000000000000000000000000 P f7b46ae7b0254f899628a24c913e8707 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fbc4f691c95c4b0bafe6254f69ea12e7. Latest consensus state: current_term: 1 leader_uuid: "fbc4f691c95c4b0bafe6254f69ea12e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbc4f691c95c4b0bafe6254f69ea12e7" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 35415 } } peers { permanent_uuid: "f7b46ae7b0254f899628a24c913e8707" member_type: VOTER last_known_addr { host: "127.20.171.125" port: 36019 } } peers { permanent_uuid: "e5923704feef4ec287ac98f894afa5bb" member_type: VOTER last_known_addr { host: "127.20.171.124" port: 40255 } } }
I20260807 10:41:58.890980 11955 sys_catalog.cc:458] T 00000000000000000000000000000000 P f7b46ae7b0254f899628a24c913e8707 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 10:41:58.912572 11973 catalog_manager.cc:1259] Loaded cluster ID: f68b2cee52804bfbbf1c625c438f28e1
I20260807 10:41:58.912699 11973 catalog_manager.cc:1552] T 00000000000000000000000000000000 P f7b46ae7b0254f899628a24c913e8707: loading cluster ID for follower catalog manager: success
I20260807 10:41:58.915323 11973 catalog_manager.cc:1574] T 00000000000000000000000000000000 P f7b46ae7b0254f899628a24c913e8707: acquiring CA information for follower catalog manager: success
I20260807 10:41:58.917771 11973 catalog_manager.cc:1602] T 00000000000000000000000000000000 P f7b46ae7b0254f899628a24c913e8707: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260807 10:41:58.952664 11832 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:41:58.937683 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60586 (local address 127.20.171.125:36019)
0807 10:41:58.937872 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0807 10:41:58.937877 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:41:58.948811 (+ 10934us) server_negotiation.cc:407] Connection header received
0807 10:41:58.950443 (+ 1632us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:41:58.950454 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:41:58.950599 (+ 145us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:41:58.950693 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:41:58.952328 (+ 1635us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60586: BlockingRecv error: recv got EOF from 127.0.0.1:60586 (error 108)
Metrics: {"server-negotiator.queue_time_us":71}
W20260807 10:41:58.955286 11907 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:41:58.937555 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60722 (local address 127.20.171.126:35415)
0807 10:41:58.937762 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0807 10:41:58.937768 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:41:58.952936 (+ 15168us) server_negotiation.cc:407] Connection header received
0807 10:41:58.953454 (+ 518us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:41:58.953464 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:41:58.953581 (+ 117us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:41:58.953670 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:41:58.955007 (+ 1337us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60722: BlockingRecv error: recv got EOF from 127.0.0.1:60722 (error 108)
Metrics: {"server-negotiator.queue_time_us":75}
W20260807 10:41:58.956795 11909 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:41:58.949504 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44124 (local address 127.20.171.124:40255)
0807 10:41:58.949726 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0807 10:41:58.949732 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:41:58.954650 (+ 4918us) server_negotiation.cc:407] Connection header received
0807 10:41:58.955376 (+ 726us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:41:58.955383 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:41:58.955497 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:41:58.955575 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:41:58.956563 (+ 988us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44124: BlockingRecv error: recv got EOF from 127.0.0.1:44124 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
I20260807 10:41:58.969040 11832 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:58.962338 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60590 (local address 127.20.171.125:36019)
0807 10:41:58.962515 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0807 10:41:58.962525 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 10:41:58.963086 (+ 561us) server_negotiation.cc:407] Connection header received
0807 10:41:58.963322 (+ 236us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:41:58.963330 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:41:58.963480 (+ 150us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:41:58.963647 (+ 167us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 10:41:58.964067 (+ 420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:58.965070 (+ 1003us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:58.966702 (+ 1632us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:58.967136 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:58.967276 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:58.967771 (+ 495us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 10:41:58.968348 (+ 577us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 10:41:58.968507 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0807 10:41:58.968566 (+ 59us) server_negotiation.cc:299] Negotiation successful
0807 10:41:58.968646 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
W20260807 10:41:58.978430 11909 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:41:58.976634 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44128 (local address 127.20.171.124:40255)
0807 10:41:58.976834 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0807 10:41:58.976842 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 10:41:58.976927 (+ 85us) server_negotiation.cc:407] Connection header received
0807 10:41:58.977251 (+ 324us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:41:58.977255 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:41:58.977351 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:41:58.977461 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:41:58.978196 (+ 735us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44128: BlockingRecv error: recv got EOF from 127.0.0.1:44128 (error 108)
Metrics: {"server-negotiator.queue_time_us":71}
I20260807 10:41:58.989698 11832 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:58.983488 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60606 (local address 127.20.171.125:36019)
0807 10:41:58.983723 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0807 10:41:58.983731 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 10:41:58.984251 (+ 520us) server_negotiation.cc:407] Connection header received
0807 10:41:58.984543 (+ 292us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:41:58.984549 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:41:58.984665 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:41:58.984721 (+ 56us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 10:41:58.985366 (+ 645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:58.986172 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:58.987505 (+ 1333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:58.988002 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:58.988151 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:58.988607 (+ 456us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 10:41:58.989007 (+ 400us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 10:41:58.989139 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0807 10:41:58.989298 (+ 159us) server_negotiation.cc:299] Negotiation successful
0807 10:41:58.989378 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
W20260807 10:41:59.004456 11909 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:41:58.998539 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44138 (local address 127.20.171.124:40255)
0807 10:41:58.998792 (+ 253us) server_negotiation.cc:206] Beginning negotiation
0807 10:41:58.998801 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 10:41:59.002905 (+ 4104us) server_negotiation.cc:407] Connection header received
0807 10:41:59.003118 (+ 213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:41:59.003143 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:41:59.003237 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:41:59.003347 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:41:59.004151 (+ 804us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44138: BlockingRecv error: recv got EOF from 127.0.0.1:44138 (error 108)
Metrics: {"server-negotiator.queue_time_us":90}
I20260807 10:41:59.015338 11832 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:59.009344 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60610 (local address 127.20.171.125:36019)
0807 10:41:59.009580 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0807 10:41:59.009588 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 10:41:59.010110 (+ 522us) server_negotiation.cc:407] Connection header received
0807 10:41:59.010326 (+ 216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:41:59.010331 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:41:59.010399 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:41:59.010506 (+ 107us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 10:41:59.010991 (+ 485us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:59.011969 (+ 978us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:59.013467 (+ 1498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:59.013975 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:59.014116 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:59.014521 (+ 405us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 10:41:59.014653 (+ 132us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 10:41:59.014753 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0807 10:41:59.014904 (+ 151us) server_negotiation.cc:299] Negotiation successful
0807 10:41:59.014993 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
W20260807 10:41:59.023680 11909 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:41:59.021917 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44152 (local address 127.20.171.124:40255)
0807 10:41:59.022106 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0807 10:41:59.022112 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:41:59.022131 (+ 19us) server_negotiation.cc:407] Connection header received
0807 10:41:59.022345 (+ 214us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:41:59.022422 (+ 77us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:41:59.022533 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:41:59.022607 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:41:59.023476 (+ 869us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44152: BlockingRecv error: recv got EOF from 127.0.0.1:44152 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
I20260807 10:41:59.042135 11832 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:59.035196 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60624 (local address 127.20.171.125:36019)
0807 10:41:59.035497 (+ 301us) server_negotiation.cc:206] Beginning negotiation
0807 10:41:59.035510 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 10:41:59.036060 (+ 550us) server_negotiation.cc:407] Connection header received
0807 10:41:59.036291 (+ 231us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:41:59.036296 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:41:59.036374 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:41:59.036474 (+ 100us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 10:41:59.036907 (+ 433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:59.037722 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:59.039029 (+ 1307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:59.039491 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:59.039640 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:59.040055 (+ 415us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 10:41:59.040153 (+ 98us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 10:41:59.040330 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0807 10:41:59.040537 (+ 207us) server_negotiation.cc:299] Negotiation successful
0807 10:41:59.040637 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":148}
W20260807 10:41:59.054335 11909 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:41:59.048069 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44154 (local address 127.20.171.124:40255)
0807 10:41:59.048453 (+ 384us) server_negotiation.cc:206] Beginning negotiation
0807 10:41:59.048462 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 10:41:59.052915 (+ 4453us) server_negotiation.cc:407] Connection header received
0807 10:41:59.053128 (+ 213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:41:59.053134 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:41:59.053214 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:41:59.053327 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:41:59.054118 (+ 791us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44154: BlockingRecv error: recv got EOF from 127.0.0.1:44154 (error 108)
Metrics: {"server-negotiator.queue_time_us":206}
I20260807 10:41:59.102829 11832 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:59.096900 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60638 (local address 127.20.171.125:36019)
0807 10:41:59.097099 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0807 10:41:59.097105 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:41:59.097827 (+ 722us) server_negotiation.cc:407] Connection header received
0807 10:41:59.098057 (+ 230us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:41:59.098062 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:41:59.098146 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:41:59.098263 (+ 117us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 10:41:59.098713 (+ 450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:59.099491 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:59.100932 (+ 1441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:59.101417 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:59.101562 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:59.101963 (+ 401us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 10:41:59.102079 (+ 116us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 10:41:59.102193 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0807 10:41:59.102365 (+ 172us) server_negotiation.cc:299] Negotiation successful
0807 10:41:59.102448 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
W20260807 10:41:59.114327 11909 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:41:59.109094 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44170 (local address 127.20.171.124:40255)
0807 10:41:59.109348 (+ 254us) server_negotiation.cc:206] Beginning negotiation
0807 10:41:59.109363 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 10:41:59.112893 (+ 3530us) server_negotiation.cc:407] Connection header received
0807 10:41:59.113101 (+ 208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:41:59.113108 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:41:59.113198 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:41:59.113319 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:41:59.114086 (+ 767us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44170: BlockingRecv error: recv got EOF from 127.0.0.1:44170 (error 108)
Metrics: {"server-negotiator.queue_time_us":74}
I20260807 10:41:59.140178 11832 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:59.134376 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60640 (local address 127.20.171.125:36019)
0807 10:41:59.134618 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0807 10:41:59.134627 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 10:41:59.135224 (+ 597us) server_negotiation.cc:407] Connection header received
0807 10:41:59.135480 (+ 256us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:41:59.135484 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:41:59.135562 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:41:59.135662 (+ 100us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 10:41:59.136135 (+ 473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:59.137005 (+ 870us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:59.138356 (+ 1351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:59.138812 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:59.138950 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:59.139402 (+ 452us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 10:41:59.139542 (+ 140us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 10:41:59.139643 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0807 10:41:59.139794 (+ 151us) server_negotiation.cc:299] Negotiation successful
0807 10:41:59.139874 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
W20260807 10:41:59.148178 11909 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:41:59.146543 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44176 (local address 127.20.171.124:40255)
0807 10:41:59.146718 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0807 10:41:59.146725 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:41:59.146745 (+ 20us) server_negotiation.cc:407] Connection header received
0807 10:41:59.146991 (+ 246us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:41:59.146997 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:41:59.147085 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:41:59.147197 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:41:59.147972 (+ 775us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44176: BlockingRecv error: recv got EOF from 127.0.0.1:44176 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
I20260807 10:41:59.196973 11832 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:59.184329 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60648 (local address 127.20.171.125:36019)
0807 10:41:59.184567 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0807 10:41:59.184575 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 10:41:59.191825 (+ 7250us) server_negotiation.cc:407] Connection header received
0807 10:41:59.191920 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:41:59.191924 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:41:59.192019 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:41:59.192126 (+ 107us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 10:41:59.192628 (+ 502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:59.193376 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:59.194914 (+ 1538us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:59.195467 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:59.195615 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:59.196105 (+ 490us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 10:41:59.196212 (+ 107us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 10:41:59.196375 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0807 10:41:59.196535 (+ 160us) server_negotiation.cc:299] Negotiation successful
0807 10:41:59.196625 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
W20260807 10:41:59.206194 11909 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:41:59.203826 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44180 (local address 127.20.171.124:40255)
0807 10:41:59.204083 (+ 257us) server_negotiation.cc:206] Beginning negotiation
0807 10:41:59.204091 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 10:41:59.204679 (+ 588us) server_negotiation.cc:407] Connection header received
0807 10:41:59.204903 (+ 224us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:41:59.204908 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:41:59.205044 (+ 136us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:41:59.205174 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:41:59.205914 (+ 740us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44180: BlockingRecv error: recv got EOF from 127.0.0.1:44180 (error 108)
Metrics: {"server-negotiator.queue_time_us":92}
I20260807 10:41:59.285730 11832 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:59.278288 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60650 (local address 127.20.171.125:36019)
0807 10:41:59.278505 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0807 10:41:59.278512 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:41:59.279132 (+ 620us) server_negotiation.cc:407] Connection header received
0807 10:41:59.279365 (+ 233us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:41:59.279376 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:41:59.279488 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:41:59.279599 (+ 111us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 10:41:59.280130 (+ 531us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:59.281382 (+ 1252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:59.283324 (+ 1942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:59.284127 (+ 803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:59.284285 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:59.284850 (+ 565us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 10:41:59.285017 (+ 167us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 10:41:59.285116 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0807 10:41:59.285305 (+ 189us) server_negotiation.cc:299] Negotiation successful
0807 10:41:59.285396 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260807 10:41:59.289474 11912 sys_catalog.cc:455] T 00000000000000000000000000000000 P fbc4f691c95c4b0bafe6254f69ea12e7 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "fbc4f691c95c4b0bafe6254f69ea12e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbc4f691c95c4b0bafe6254f69ea12e7" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 35415 } } peers { permanent_uuid: "f7b46ae7b0254f899628a24c913e8707" member_type: VOTER last_known_addr { host: "127.20.171.125" port: 36019 } } peers { permanent_uuid: "e5923704feef4ec287ac98f894afa5bb" member_type: VOTER last_known_addr { host: "127.20.171.124" port: 40255 } } }
I20260807 10:41:59.289811 11912 sys_catalog.cc:458] T 00000000000000000000000000000000 P fbc4f691c95c4b0bafe6254f69ea12e7 [sys.catalog]: This master's current role is: LEADER
W20260807 10:41:59.298334 11909 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:41:59.294748 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44196 (local address 127.20.171.124:40255)
0807 10:41:59.294993 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0807 10:41:59.295000 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:41:59.296765 (+ 1765us) server_negotiation.cc:407] Connection header received
0807 10:41:59.296943 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:41:59.296952 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:41:59.297053 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:41:59.297167 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:41:59.298081 (+ 914us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44196: BlockingRecv error: recv got EOF from 127.0.0.1:44196 (error 108)
Metrics: {"server-negotiator.queue_time_us":92}
I20260807 10:41:59.437093 11832 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:59.432054 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60656 (local address 127.20.171.125:36019)
0807 10:41:59.432337 (+ 283us) server_negotiation.cc:206] Beginning negotiation
0807 10:41:59.432343 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:41:59.432608 (+ 265us) server_negotiation.cc:407] Connection header received
0807 10:41:59.432772 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:41:59.432776 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:41:59.432846 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:41:59.432930 (+ 84us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 10:41:59.433368 (+ 438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:59.434076 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:59.435457 (+ 1381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:59.435886 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:59.435983 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:59.436385 (+ 402us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 10:41:59.436497 (+ 112us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 10:41:59.436566 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0807 10:41:59.436704 (+ 138us) server_negotiation.cc:299] Negotiation successful
0807 10:41:59.436768 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
W20260807 10:41:59.444547 11909 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:41:59.442753 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44198 (local address 127.20.171.124:40255)
0807 10:41:59.442977 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0807 10:41:59.442984 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:41:59.443233 (+ 249us) server_negotiation.cc:407] Connection header received
0807 10:41:59.443444 (+ 211us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:41:59.443449 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:41:59.443519 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:41:59.443625 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:41:59.444383 (+ 758us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44198: BlockingRecv error: recv got EOF from 127.0.0.1:44198 (error 108)
Metrics: {"server-negotiator.queue_time_us":71}
I20260807 10:41:59.709964 11832 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:41:59.704727 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60670 (local address 127.20.171.125:36019)
0807 10:41:59.704971 (+ 244us) server_negotiation.cc:206] Beginning negotiation
0807 10:41:59.704977 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:41:59.705172 (+ 195us) server_negotiation.cc:407] Connection header received
0807 10:41:59.705466 (+ 294us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:41:59.705470 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:41:59.705539 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:41:59.705641 (+ 102us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 10:41:59.706105 (+ 464us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:59.706939 (+ 834us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:59.708283 (+ 1344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:41:59.708698 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:41:59.708842 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:41:59.709246 (+ 404us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 10:41:59.709347 (+ 101us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 10:41:59.709458 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0807 10:41:59.709613 (+ 155us) server_negotiation.cc:299] Negotiation successful
0807 10:41:59.709696 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
W20260807 10:41:59.717528 11909 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:41:59.715578 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44212 (local address 127.20.171.124:40255)
0807 10:41:59.715799 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0807 10:41:59.715805 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:41:59.716015 (+ 210us) server_negotiation.cc:407] Connection header received
0807 10:41:59.716213 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:41:59.716220 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:41:59.716385 (+ 165us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:41:59.716493 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:41:59.717293 (+ 800us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44212: BlockingRecv error: recv got EOF from 127.0.0.1:44212 (error 108)
Metrics: {"server-negotiator.queue_time_us":74}
I20260807 10:41:59.794704 11951 catalog_manager.cc:1259] Loaded cluster ID: f68b2cee52804bfbbf1c625c438f28e1
I20260807 10:41:59.794836 11951 catalog_manager.cc:1552] T 00000000000000000000000000000000 P e5923704feef4ec287ac98f894afa5bb: loading cluster ID for follower catalog manager: success
I20260807 10:41:59.797577 11951 catalog_manager.cc:1574] T 00000000000000000000000000000000 P e5923704feef4ec287ac98f894afa5bb: acquiring CA information for follower catalog manager: success
I20260807 10:41:59.799758 11951 catalog_manager.cc:1602] T 00000000000000000000000000000000 P e5923704feef4ec287ac98f894afa5bb: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260807 10:42:00.237741 12091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:00.232808 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60678 (local address 127.20.171.125:36019)
0807 10:42:00.233317 (+ 509us) server_negotiation.cc:206] Beginning negotiation
0807 10:42:00.233322 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:42:00.233340 (+ 18us) server_negotiation.cc:407] Connection header received
0807 10:42:00.233543 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:42:00.233547 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:42:00.233617 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:42:00.233700 (+ 83us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 10:42:00.234080 (+ 380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:00.234886 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:00.236139 (+ 1253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:00.236611 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:00.236708 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:00.237084 (+ 376us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 10:42:00.237178 (+ 94us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 10:42:00.237244 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0807 10:42:00.237368 (+ 124us) server_negotiation.cc:299] Negotiation successful
0807 10:42:00.237429 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":399,"thread_start_us":273,"threads_started":1}
I20260807 10:42:00.248587 12097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:00.243218 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44222 (local address 127.20.171.124:40255)
0807 10:42:00.243739 (+ 521us) server_negotiation.cc:206] Beginning negotiation
0807 10:42:00.243743 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 10:42:00.243761 (+ 18us) server_negotiation.cc:407] Connection header received
0807 10:42:00.243968 (+ 207us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:42:00.243972 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:42:00.244144 (+ 172us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:42:00.244247 (+ 103us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 10:42:00.244626 (+ 379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:00.245313 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:00.246531 (+ 1218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:00.246909 (+ 378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:00.246999 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:00.247435 (+ 436us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 10:42:00.247979 (+ 544us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 10:42:00.248089 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0807 10:42:00.248170 (+ 81us) server_negotiation.cc:299] Negotiation successful
0807 10:42:00.248232 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":382,"thread_start_us":251,"threads_started":1}
I20260807 10:42:00.262259 12091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:00.254631 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60692 (local address 127.20.171.125:36019)
0807 10:42:00.256624 (+ 1993us) server_negotiation.cc:206] Beginning negotiation
0807 10:42:00.256631 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:42:00.256652 (+ 21us) server_negotiation.cc:407] Connection header received
0807 10:42:00.256719 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:42:00.256725 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:42:00.256803 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:42:00.256916 (+ 113us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 10:42:00.257665 (+ 749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:00.258721 (+ 1056us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:00.260496 (+ 1775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:00.260917 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:00.261054 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:00.261528 (+ 474us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 10:42:00.261678 (+ 150us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 10:42:00.261778 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0807 10:42:00.261915 (+ 137us) server_negotiation.cc:299] Negotiation successful
0807 10:42:00.261998 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1857}
I20260807 10:42:00.262894 12097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:00.255449 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44228 (local address 127.20.171.124:40255)
0807 10:42:00.255699 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0807 10:42:00.255708 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 10:42:00.256293 (+ 585us) server_negotiation.cc:407] Connection header received
0807 10:42:00.256489 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:42:00.256495 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:42:00.256577 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:42:00.256669 (+ 92us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 10:42:00.257432 (+ 763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:00.258649 (+ 1217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:00.260956 (+ 2307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:00.261454 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:00.261574 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:00.262079 (+ 505us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 10:42:00.262202 (+ 123us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 10:42:00.262264 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0807 10:42:00.262510 (+ 246us) server_negotiation.cc:299] Negotiation successful
0807 10:42:00.262605 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260807 10:42:00.265163 12104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:00.254322 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60736 (local address 127.20.171.126:35415)
0807 10:42:00.257397 (+ 3075us) server_negotiation.cc:206] Beginning negotiation
0807 10:42:00.257404 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:42:00.257424 (+ 20us) server_negotiation.cc:407] Connection header received
0807 10:42:00.257546 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:42:00.257554 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:42:00.257795 (+ 241us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:42:00.257987 (+ 192us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 10:42:00.258684 (+ 697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:00.260409 (+ 1725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:00.262667 (+ 2258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:00.263314 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:00.263456 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:00.264000 (+ 544us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 10:42:00.264551 (+ 551us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 10:42:00.264663 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0807 10:42:00.264812 (+ 149us) server_negotiation.cc:299] Negotiation successful
0807 10:42:00.264885 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2912,"thread_start_us":2814,"threads_started":1}
I20260807 10:42:00.270458 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 11682
I20260807 10:42:00.271632 11746 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:42:00.384115 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 11682
W20260807 10:42:00.408798 11854 connection.cc:535] server connection from 127.0.0.1:44088 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260807 10:42:00.409261 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 11758
I20260807 10:42:00.410392 11821 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:42:00.521304 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 11758
I20260807 10:42:00.546628 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 11835
I20260807 10:42:00.547787 11898 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:42:00.657523 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 11835
2026-08-07T10:42:00Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (5138 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786098956060137-21165-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 10:42:00 dist-test-slave-0b58 krb5kdc[12111](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 10:42:00 dist-test-slave-0b58 krb5kdc[12111](info): set up 2 sockets
Aug 07 10:42:00 dist-test-slave-0b58 krb5kdc[12111](info): commencing operation
krb5kdc: starting...
W20260807 10:42:02.054764 21165 mini_kdc.cc:121] Time spent starting KDC: real 1.352s user 0.000s sys 0.054s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786098956060137-21165-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786098956060137-21165-0/krb5kdc/test-user.keytab.
Aug 07 10:42:02 dist-test-slave-0b58 krb5kdc[12111](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099322, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T10:42:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T10:42:02Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.171.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.171.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.171.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.126.keytab.
Entry for principal kudu/127.20.171.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.126.keytab.
I20260807 10:42:02.419987 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786098956060137-21165-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786098956060137-21165-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786098956060137-21165-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.171.126:37579
--webserver_interface=127.20.171.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.126.keytab
--principal=kudu/127.20.171.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.171.84:34321
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.171.126:37579,127.20.171.125:35143,127.20.171.124:33825
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786098956060137-21165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786098956060137-21165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786098956060137-21165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:42:02.771492 12124 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260807 10:42:02.771867 12124 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:42:02.771996 12124 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:42:02.772130 12124 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:42:02.779578 12124 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 10:42:02.779685 12124 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:42:02.779799 12124 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:42:02.779906 12124 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 10:42:02.779999 12124 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 10:42:02.790042 12124 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.171.84:34321
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786098956060137-21165-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786098956060137-21165-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.171.126:37579,127.20.171.125:35143,127.20.171.124:33825
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.126.keytab
--principal=kudu/127.20.171.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.171.126:37579
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.171.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786098956060137-21165-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:42:02.791438 12124 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:42:02.792845 12124 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:42:02.805346 12129 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:42:02.805428 12132 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:42:02.805387 12130 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:42:02.806461 12124 server_base.cc:1034] running on GCE node
I20260807 10:42:02.807338 12124 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:42:02.808881 12124 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:42:02.810117 12124 hybrid_clock.cc:648] HybridClock initialized: now 1786099322810036 us; error 51 us; skew 500 ppm
I20260807 10:42:02.810496 12124 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:42:02 dist-test-slave-0b58 krb5kdc[12111](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099322, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:42:02.813792 12124 init.cc:377] Logged in from keytab as kudu/127.20.171.126@KRBTEST.COM (short username kudu)
I20260807 10:42:02.815331 12124 webserver.cc:460] Webserver started at http://127.20.171.126:37651/ using document root <none> and password file <none>
I20260807 10:42:02.816010 12124 fs_manager.cc:359] Metadata directory not provided
I20260807 10:42:02.816098 12124 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:42:02.816448 12124 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:42:02.819379 12124 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786098956060137-21165-0/minicluster-data/master-0/data/instance:
uuid: "b4029a4210b741a08e96bb18e4d494c5"
format_stamp: "Formatted at 2026-08-07 10:42:02 on dist-test-slave-0b58"
server_key: "9445eba12e051bb1ecc2b21e3926b61e"
server_key_iv: "c3b14effe6874812d75745e79ec3d05e"
server_key_version: "encryptionkey@0"
I20260807 10:42:02.820142 12124 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786098956060137-21165-0/minicluster-data/master-0/wal/instance:
uuid: "b4029a4210b741a08e96bb18e4d494c5"
format_stamp: "Formatted at 2026-08-07 10:42:02 on dist-test-slave-0b58"
server_key: "9445eba12e051bb1ecc2b21e3926b61e"
server_key_iv: "c3b14effe6874812d75745e79ec3d05e"
server_key_version: "encryptionkey@0"
I20260807 10:42:02.825349 12124 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260807 10:42:02.828871 12139 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:42:02.830287 12124 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260807 10:42:02.830437 12124 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786098956060137-21165-0/minicluster-data/master-0/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786098956060137-21165-0/minicluster-data/master-0/wal
uuid: "b4029a4210b741a08e96bb18e4d494c5"
format_stamp: "Formatted at 2026-08-07 10:42:02 on dist-test-slave-0b58"
server_key: "9445eba12e051bb1ecc2b21e3926b61e"
server_key_iv: "c3b14effe6874812d75745e79ec3d05e"
server_key_version: "encryptionkey@0"
I20260807 10:42:02.830622 12124 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786098956060137-21165-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786098956060137-21165-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786098956060137-21165-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:42:02.855654 12124 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:42:02.860164 12124 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:42:02.860456 12124 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:42:02.879452 12124 rpc_server.cc:307] RPC server started. Bound to: 127.20.171.126:37579
I20260807 10:42:02.879465 12192 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.171.126:37579 every 8 connection(s)
I20260807 10:42:02.880884 12124 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786098956060137-21165-0/minicluster-data/master-0/data/info.pb
I20260807 10:42:02.884713 12193 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:42:02.885035 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 12124
I20260807 10:42:02.885213 21165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786098956060137-21165-0/minicluster-data/master-0/wal/instance
I20260807 10:42:02.885679 21165 external_mini_cluster.cc:1428] Setting key be6fc18b042f319bc6e89834130c9c34
I20260807 10:42:02.891376 12193 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.171.126" port: 37579 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 10:42:02 dist-test-slave-0b58 krb5kdc[12111](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099322, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.126@KRBTEST.COM for kudu/127.20.171.126@KRBTEST.COM
I20260807 10:42:02.922242 12196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:02.894755 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42462 (local address 127.20.171.126:37579)
0807 10:42:02.901759 (+ 7004us) server_negotiation.cc:206] Beginning negotiation
0807 10:42:02.901768 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 10:42:02.901824 (+ 56us) server_negotiation.cc:407] Connection header received
0807 10:42:02.903448 (+ 1624us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:42:02.903456 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:42:02.903738 (+ 282us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:42:02.903971 (+ 233us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:42:02.905880 (+ 1909us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:02.907963 (+ 2083us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:02.909548 (+ 1585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:02.910577 (+ 1029us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:02.910782 (+ 205us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:02.914665 (+ 3883us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:42:02.914673 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:42:02.914687 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:42:02.914721 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:42:02.917737 (+ 3016us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:42:02.918668 (+ 931us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:42:02.918674 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:42:02.918677 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:42:02.918840 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:42:02.919303 (+ 463us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:42:02.919307 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:42:02.919310 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:42:02.919831 (+ 521us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:42:02.919990 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0807 10:42:02.920755 (+ 765us) server_negotiation.cc:299] Negotiation successful
0807 10:42:02.921049 (+ 294us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":6776,"thread_start_us":8542,"threads_started":1}
I20260807 10:42:02.922287 12195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:02.894755 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:37579 (local address 127.0.0.1:42462)
0807 10:42:02.900908 (+ 6153us) negotiation.cc:107] Waiting for socket to connect
0807 10:42:02.900960 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0807 10:42:02.903068 (+ 2108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:42:02.904157 (+ 1089us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:42:02.904165 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:42:02.905087 (+ 922us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:42:02.905640 (+ 553us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:42:02.905661 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:42:02.908163 (+ 2502us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:42:02.908168 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:42:02.909391 (+ 1223us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:42:02.909404 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:42:02.910822 (+ 1418us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:42:02.910827 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:42:02.910961 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:02.911717 (+ 756us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:42:02.911740 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:42:02.914408 (+ 2668us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:42:02.917887 (+ 3479us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:42:02.917902 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:42:02.917918 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:42:02.918527 (+ 609us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:42:02.918960 (+ 433us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:42:02.918968 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:42:02.918974 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:42:02.919191 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:42:02.919981 (+ 790us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:42:02.919992 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:42:02.920306 (+ 314us) client_negotiation.cc:769] Sending connection context
0807 10:42:02.920610 (+ 304us) client_negotiation.cc:240] Negotiation successful
0807 10:42:02.921227 (+ 617us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5849,"mutex_wait_us":48,"thread_start_us":5627,"threads_started":1}
I20260807 10:42:02.925249 12193 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.171.125" port: 35143 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.20.171.125@KRBTEST.COM; defaulting to no policy
I20260807 10:42:02.926507 12195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:02.926036 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.125:35143 (local address 127.0.0.1:60470)
0807 10:42:02.926261 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0807 10:42:02.926396 (+ 135us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.125:35143: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
W20260807 10:42:02.926781 12143 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.171.125:35143: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.171.125@KRBTEST.COM" created.
I20260807 10:42:02.928469 12195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:02.928022 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.125:35143 (local address 127.0.0.1:60472)
0807 10:42:02.928152 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0807 10:42:02.928225 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.125:35143: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260807 10:42:02.928685 12193 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.171.125:35143: Network error: Client connection negotiation failed: client connection to 127.20.171.125:35143: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.171.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.125.keytab.
Entry for principal kudu/127.20.171.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.125.keytab.
I20260807 10:42:02.969466 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786098956060137-21165-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786098956060137-21165-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786098956060137-21165-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786098956060137-21165-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.171.125:35143
--webserver_interface=127.20.171.125
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.125.keytab
--principal=kudu/127.20.171.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.171.84:34321
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.171.126:37579,127.20.171.125:35143,127.20.171.124:33825
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786098956060137-21165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786098956060137-21165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786098956060137-21165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 10:42:02.978121 12193 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.171.125" port: 35143 } attempt: 1
I20260807 10:42:02.979420 12195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:02.978920 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.125:35143 (local address 127.0.0.1:60482)
0807 10:42:02.979127 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0807 10:42:02.979273 (+ 146us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.125:35143: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
I20260807 10:42:02.980598 12195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:02.980178 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.125:35143 (local address 127.0.0.1:60498)
0807 10:42:02.980367 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0807 10:42:02.980452 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.125:35143: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260807 10:42:02.980892 12193 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.171.125:35143: Network error: Client connection negotiation failed: client connection to 127.20.171.125:35143: connect: Connection refused (error 111)
I20260807 10:42:03.049204 12193 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.171.125" port: 35143 } attempt: 2
I20260807 10:42:03.050607 12195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:03.049909 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.125:35143 (local address 127.0.0.1:60508)
0807 10:42:03.050245 (+ 336us) negotiation.cc:107] Waiting for socket to connect
0807 10:42:03.050397 (+ 152us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.125:35143: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":92}
I20260807 10:42:03.051693 12195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:03.051280 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.125:35143 (local address 127.0.0.1:60516)
0807 10:42:03.051453 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0807 10:42:03.051537 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.125:35143: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260807 10:42:03.051923 12193 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.171.125:35143: Network error: Client connection negotiation failed: client connection to 127.20.171.125:35143: connect: Connection refused (error 111)
I20260807 10:42:03.143224 12193 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.171.125" port: 35143 } attempt: 3
I20260807 10:42:03.144620 12195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:03.143989 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.125:35143 (local address 127.0.0.1:60530)
0807 10:42:03.144283 (+ 294us) negotiation.cc:107] Waiting for socket to connect
0807 10:42:03.144420 (+ 137us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.125:35143: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":87}
I20260807 10:42:03.145864 12195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:03.145358 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.125:35143 (local address 127.0.0.1:60534)
0807 10:42:03.145542 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0807 10:42:03.145647 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.125:35143: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260807 10:42:03.146134 12193 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.171.125:35143: Network error: Client connection negotiation failed: client connection to 127.20.171.125:35143: connect: Connection refused (error 111)
I20260807 10:42:03.289443 12193 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.171.125" port: 35143 } attempt: 4
I20260807 10:42:03.290840 12195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:03.290144 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.125:35143 (local address 127.0.0.1:60550)
0807 10:42:03.290519 (+ 375us) negotiation.cc:107] Waiting for socket to connect
0807 10:42:03.290642 (+ 123us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.125:35143: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":176}
I20260807 10:42:03.291961 12195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:03.291540 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.125:35143 (local address 127.0.0.1:60554)
0807 10:42:03.291706 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0807 10:42:03.291816 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.125:35143: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260807 10:42:03.292168 12193 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.171.125:35143: Network error: Client connection negotiation failed: client connection to 127.20.171.125:35143: connect: Connection refused (error 111)
W20260807 10:42:03.321122 12200 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260807 10:42:03.321445 12200 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:42:03.321520 12200 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:42:03.321602 12200 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:42:03.328832 12200 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 10:42:03.328925 12200 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:42:03.328985 12200 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:42:03.329037 12200 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 10:42:03.329094 12200 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 10:42:03.339193 12200 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.171.84:34321
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786098956060137-21165-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786098956060137-21165-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.20.171.126:37579,127.20.171.125:35143,127.20.171.124:33825
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.125.keytab
--principal=kudu/127.20.171.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.171.125:35143
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786098956060137-21165-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.20.171.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786098956060137-21165-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:42:03.340483 12200 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:42:03.341734 12200 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:42:03.353533 12205 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:42:03.353489 12206 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:42:03.353569 12208 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:42:03.354651 12200 server_base.cc:1034] running on GCE node
I20260807 10:42:03.355382 12200 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:42:03.356738 12200 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:42:03.357965 12200 hybrid_clock.cc:648] HybridClock initialized: now 1786099323357904 us; error 23 us; skew 500 ppm
I20260807 10:42:03.358248 12200 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:42:03 dist-test-slave-0b58 krb5kdc[12111](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099323, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:42:03.361303 12200 init.cc:377] Logged in from keytab as kudu/127.20.171.125@KRBTEST.COM (short username kudu)
I20260807 10:42:03.362777 12200 webserver.cc:460] Webserver started at http://127.20.171.125:39559/ using document root <none> and password file <none>
I20260807 10:42:03.363484 12200 fs_manager.cc:359] Metadata directory not provided
I20260807 10:42:03.363598 12200 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:42:03.363950 12200 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:42:03.366896 12200 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786098956060137-21165-0/minicluster-data/master-1/data/instance:
uuid: "c16a8caf679149d6bedfcbe43e4b68f4"
format_stamp: "Formatted at 2026-08-07 10:42:03 on dist-test-slave-0b58"
server_key: "aec945034419dddf3fa3c78fec365ced"
server_key_iv: "fbde36bbc0e8e24167442db7c09231d6"
server_key_version: "encryptionkey@0"
I20260807 10:42:03.367672 12200 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786098956060137-21165-0/minicluster-data/master-1/wal/instance:
uuid: "c16a8caf679149d6bedfcbe43e4b68f4"
format_stamp: "Formatted at 2026-08-07 10:42:03 on dist-test-slave-0b58"
server_key: "aec945034419dddf3fa3c78fec365ced"
server_key_iv: "fbde36bbc0e8e24167442db7c09231d6"
server_key_version: "encryptionkey@0"
I20260807 10:42:03.372747 12200 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260807 10:42:03.375929 12216 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:42:03.377278 12200 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 10:42:03.377470 12200 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786098956060137-21165-0/minicluster-data/master-1/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786098956060137-21165-0/minicluster-data/master-1/wal
uuid: "c16a8caf679149d6bedfcbe43e4b68f4"
format_stamp: "Formatted at 2026-08-07 10:42:03 on dist-test-slave-0b58"
server_key: "aec945034419dddf3fa3c78fec365ced"
server_key_iv: "fbde36bbc0e8e24167442db7c09231d6"
server_key_version: "encryptionkey@0"
I20260807 10:42:03.377688 12200 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786098956060137-21165-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786098956060137-21165-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786098956060137-21165-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:42:03.397789 12200 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:42:03.401656 12200 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:42:03.401933 12200 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:42:03.420800 12200 rpc_server.cc:307] RPC server started. Bound to: 127.20.171.125:35143
I20260807 10:42:03.420831 12270 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.171.125:35143 every 8 connection(s)
I20260807 10:42:03.422122 12200 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786098956060137-21165-0/minicluster-data/master-1/data/info.pb
I20260807 10:42:03.425616 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 12200
I20260807 10:42:03.425823 21165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786098956060137-21165-0/minicluster-data/master-1/wal/instance
I20260807 10:42:03.425846 12272 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:42:03.426437 21165 external_mini_cluster.cc:1428] Setting key 84e36f296e33f7f51589eda5c61c76c7
I20260807 10:42:03.435678 12272 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.171.126" port: 37579 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 10:42:03 dist-test-slave-0b58 krb5kdc[12111](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099323, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.125@KRBTEST.COM for kudu/127.20.171.126@KRBTEST.COM
I20260807 10:42:03.460762 12274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:03.438886 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42472 (local address 127.20.171.126:37579)
0807 10:42:03.439399 (+ 513us) server_negotiation.cc:206] Beginning negotiation
0807 10:42:03.439405 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:42:03.440395 (+ 990us) server_negotiation.cc:407] Connection header received
0807 10:42:03.443284 (+ 2889us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:42:03.443291 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:42:03.443389 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:42:03.443519 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:42:03.445029 (+ 1510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:03.446264 (+ 1235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:03.447717 (+ 1453us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:03.448532 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:03.448706 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:03.452402 (+ 3696us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:42:03.452413 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:42:03.452420 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:42:03.452491 (+ 71us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:42:03.456350 (+ 3859us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:42:03.457102 (+ 752us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:42:03.457111 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:42:03.457117 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:42:03.457273 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:42:03.457679 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:42:03.457687 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:42:03.457693 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:42:03.458085 (+ 392us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:42:03.458255 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0807 10:42:03.460129 (+ 1874us) server_negotiation.cc:299] Negotiation successful
0807 10:42:03.460408 (+ 279us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":381,"thread_start_us":244,"threads_started":1}
I20260807 10:42:03.461036 12275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:03.439386 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:37579 (local address 127.0.0.1:42472)
0807 10:42:03.440187 (+ 801us) negotiation.cc:107] Waiting for socket to connect
0807 10:42:03.440236 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0807 10:42:03.442952 (+ 2716us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:42:03.443710 (+ 758us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:42:03.443718 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:42:03.444221 (+ 503us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:42:03.444815 (+ 594us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:42:03.444833 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:42:03.446415 (+ 1582us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:42:03.446419 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:42:03.447563 (+ 1144us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:42:03.447575 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:42:03.448772 (+ 1197us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:42:03.448777 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:42:03.448978 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:03.449677 (+ 699us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:42:03.449699 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:42:03.452128 (+ 2429us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:42:03.456494 (+ 4366us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:42:03.456501 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:42:03.456513 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:42:03.456970 (+ 457us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:42:03.457391 (+ 421us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:42:03.457395 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:42:03.457397 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:42:03.457565 (+ 168us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:42:03.458212 (+ 647us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:42:03.458218 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:42:03.458661 (+ 443us) client_negotiation.cc:769] Sending connection context
0807 10:42:03.458981 (+ 320us) client_negotiation.cc:240] Negotiation successful
0807 10:42:03.459522 (+ 541us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":510,"thread_start_us":292,"threads_started":1}
I20260807 10:42:03.462877 12272 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.171.125" port: 35143 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.20.171.124@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.171.124@KRBTEST.COM" created.
Aug 07 10:42:03 dist-test-slave-0b58 krb5kdc[12111](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099323, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.125@KRBTEST.COM for kudu/127.20.171.125@KRBTEST.COM
I20260807 10:42:03.479146 12275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:03.463802 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.125:35143 (local address 127.0.0.1:60558)
0807 10:42:03.464104 (+ 302us) negotiation.cc:107] Waiting for socket to connect
0807 10:42:03.464132 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0807 10:42:03.464240 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:42:03.465070 (+ 830us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:42:03.465075 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:42:03.465567 (+ 492us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:42:03.465792 (+ 225us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:42:03.465807 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:42:03.467239 (+ 1432us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:42:03.467244 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:42:03.468291 (+ 1047us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:42:03.468309 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:42:03.469532 (+ 1223us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:42:03.469536 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:42:03.469711 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:03.470329 (+ 618us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:42:03.470346 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:42:03.472530 (+ 2184us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:42:03.476802 (+ 4272us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:42:03.476806 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:42:03.476808 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:42:03.477152 (+ 344us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:42:03.477574 (+ 422us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:42:03.477577 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:42:03.477579 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:42:03.477715 (+ 136us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:42:03.478442 (+ 727us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:42:03.478446 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:42:03.478571 (+ 125us) client_negotiation.cc:769] Sending connection context
0807 10:42:03.478669 (+ 98us) client_negotiation.cc:240] Negotiation successful
0807 10:42:03.478878 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":179,"mutex_wait_us":35}
I20260807 10:42:03.479653 12277 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:03.463901 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60558 (local address 127.20.171.125:35143)
0807 10:42:03.464660 (+ 759us) server_negotiation.cc:206] Beginning negotiation
0807 10:42:03.464665 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:42:03.464689 (+ 24us) server_negotiation.cc:407] Connection header received
0807 10:42:03.464730 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:42:03.464735 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:42:03.464897 (+ 162us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:42:03.465009 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:42:03.465958 (+ 949us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:03.467114 (+ 1156us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:03.468446 (+ 1332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:03.469365 (+ 919us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:03.469505 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:03.472748 (+ 3243us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:42:03.472764 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:42:03.472784 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:42:03.472826 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:42:03.476663 (+ 3837us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:42:03.477292 (+ 629us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:42:03.477303 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:42:03.477317 (+ 14us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:42:03.477469 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:42:03.477832 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:42:03.477839 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:42:03.477844 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:42:03.478323 (+ 479us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:42:03.478538 (+ 215us) server_negotiation.cc:1035] Waiting for connection context
0807 10:42:03.478864 (+ 326us) server_negotiation.cc:299] Negotiation successful
0807 10:42:03.479153 (+ 289us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":596,"thread_start_us":453,"threads_started":1}
I20260807 10:42:03.482112 12272 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.171.124" port: 33825 } has no permanent_uuid. Determining permanent_uuid...
I20260807 10:42:03.483174 12275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:03.482748 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.124:33825 (local address 127.0.0.1:35008)
0807 10:42:03.482943 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0807 10:42:03.483038 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.124:33825: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260807 10:42:03.483438 12220 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.171.124:33825: connect: Connection refused (error 111)
I20260807 10:42:03.485018 12275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:03.484699 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.124:33825 (local address 127.0.0.1:35010)
0807 10:42:03.484846 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0807 10:42:03.484925 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.124:33825: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260807 10:42:03.485371 12272 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.171.124:33825: Network error: Client connection negotiation failed: client connection to 127.20.171.124:33825: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.171.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.124.keytab.
Entry for principal kudu/127.20.171.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.124.keytab.
I20260807 10:42:03.509784 21165 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
/tmp/dist-test-taskXRtsKb/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786098956060137-21165-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786098956060137-21165-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786098956060137-21165-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786098956060137-21165-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.171.124:33825
--webserver_interface=127.20.171.124
--webserver_port=0
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.124.keytab
--principal=kudu/127.20.171.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.171.84:34321
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.171.126:37579,127.20.171.125:35143,127.20.171.124:33825
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786098956060137-21165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786098956060137-21165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786098956060137-21165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 10:42:03.534667 12272 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.171.124" port: 33825 } attempt: 1
I20260807 10:42:03.535936 12275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:03.535460 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.124:33825 (local address 127.0.0.1:35024)
0807 10:42:03.535653 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0807 10:42:03.535762 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.124:33825: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
I20260807 10:42:03.537071 12275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:03.536743 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.124:33825 (local address 127.0.0.1:35030)
0807 10:42:03.536883 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0807 10:42:03.536962 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.124:33825: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260807 10:42:03.537336 12272 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.171.124:33825: Network error: Client connection negotiation failed: client connection to 127.20.171.124:33825: connect: Connection refused (error 111)
I20260807 10:42:03.591470 12193 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.171.125" port: 35143 } attempt: 5
Aug 07 10:42:03 dist-test-slave-0b58 krb5kdc[12111](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099322, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.126@KRBTEST.COM for kudu/127.20.171.125@KRBTEST.COM
I20260807 10:42:03.605544 12272 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.171.124" port: 33825 } attempt: 2
I20260807 10:42:03.606468 12277 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:03.592391 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60564 (local address 127.20.171.125:35143)
0807 10:42:03.592570 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0807 10:42:03.592574 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 10:42:03.592594 (+ 20us) server_negotiation.cc:407] Connection header received
0807 10:42:03.592811 (+ 217us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:42:03.592816 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:42:03.592878 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:42:03.592961 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:42:03.593985 (+ 1024us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:03.594676 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:03.596389 (+ 1713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:03.596851 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:03.596952 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:03.601050 (+ 4098us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:42:03.601054 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:42:03.601058 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:42:03.601087 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:42:03.603774 (+ 2687us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:42:03.604575 (+ 801us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:42:03.604578 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:42:03.604581 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:42:03.604696 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:42:03.605110 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:42:03.605113 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:42:03.605115 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:42:03.605389 (+ 274us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:42:03.605556 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0807 10:42:03.605952 (+ 396us) server_negotiation.cc:299] Negotiation successful
0807 10:42:03.606116 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260807 10:42:03.606525 12275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:03.606101 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.124:33825 (local address 127.0.0.1:35034)
0807 10:42:03.606308 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0807 10:42:03.606395 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.124:33825: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":86}
I20260807 10:42:03.607131 12195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:03.592229 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.125:35143 (local address 127.0.0.1:60564)
0807 10:42:03.592500 (+ 271us) negotiation.cc:107] Waiting for socket to connect
0807 10:42:03.592523 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0807 10:42:03.592656 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:42:03.593042 (+ 386us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:42:03.593047 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:42:03.593585 (+ 538us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:42:03.593826 (+ 241us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:42:03.593840 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:42:03.594818 (+ 978us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:42:03.594823 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:42:03.596169 (+ 1346us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:42:03.596186 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:42:03.597042 (+ 856us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:42:03.597049 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:42:03.597357 (+ 308us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:03.598018 (+ 661us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:42:03.598042 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:42:03.600845 (+ 2803us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:42:03.603931 (+ 3086us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:42:03.603937 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:42:03.603941 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:42:03.604459 (+ 518us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:42:03.604805 (+ 346us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:42:03.604810 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:42:03.604813 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:42:03.605003 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:42:03.605511 (+ 508us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:42:03.605516 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:42:03.605680 (+ 164us) client_negotiation.cc:769] Sending connection context
0807 10:42:03.605825 (+ 145us) client_negotiation.cc:240] Negotiation successful
0807 10:42:03.606574 (+ 749us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118}
I20260807 10:42:03.607689 12275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:03.607246 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.124:33825 (local address 127.0.0.1:35040)
0807 10:42:03.607452 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0807 10:42:03.607525 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.124:33825: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111}
W20260807 10:42:03.608017 12272 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.171.124:33825: Network error: Client connection negotiation failed: client connection to 127.20.171.124:33825: connect: Connection refused (error 111)
I20260807 10:42:03.608180 12193 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.171.124" port: 33825 } has no permanent_uuid. Determining permanent_uuid...
I20260807 10:42:03.609174 12195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:03.608844 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.124:33825 (local address 127.0.0.1:35050)
0807 10:42:03.608992 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0807 10:42:03.609060 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.124:33825: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
I20260807 10:42:03.610093 12195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:03.609756 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.124:33825 (local address 127.0.0.1:35064)
0807 10:42:03.609926 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0807 10:42:03.609998 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.124:33825: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
W20260807 10:42:03.610322 12193 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.171.124:33825: Network error: Client connection negotiation failed: client connection to 127.20.171.124:33825: connect: Connection refused (error 111)
I20260807 10:42:03.661530 12193 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.171.124" port: 33825 } attempt: 1
I20260807 10:42:03.662746 12195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:03.662306 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.124:33825 (local address 127.0.0.1:35072)
0807 10:42:03.662500 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0807 10:42:03.662589 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.124:33825: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":73}
I20260807 10:42:03.663764 12195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:03.663410 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.124:33825 (local address 127.0.0.1:35080)
0807 10:42:03.663575 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0807 10:42:03.663644 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.124:33825: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260807 10:42:03.664006 12193 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.171.124:33825: Network error: Client connection negotiation failed: client connection to 127.20.171.124:33825: connect: Connection refused (error 111)
I20260807 10:42:03.699249 12272 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.171.124" port: 33825 } attempt: 3
I20260807 10:42:03.700543 12275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:03.699909 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.124:33825 (local address 127.0.0.1:35096)
0807 10:42:03.700169 (+ 260us) negotiation.cc:107] Waiting for socket to connect
0807 10:42:03.700331 (+ 162us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.124:33825: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":86}
I20260807 10:42:03.701833 12275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:03.701232 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.124:33825 (local address 127.0.0.1:35102)
0807 10:42:03.701523 (+ 291us) negotiation.cc:107] Waiting for socket to connect
0807 10:42:03.701643 (+ 120us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.124:33825: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":158}
W20260807 10:42:03.702163 12272 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.171.124:33825: Network error: Client connection negotiation failed: client connection to 127.20.171.124:33825: connect: Connection refused (error 111)
I20260807 10:42:03.732213 12193 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.171.124" port: 33825 } attempt: 2
I20260807 10:42:03.733500 12195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:03.732993 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.124:33825 (local address 127.0.0.1:35104)
0807 10:42:03.733228 (+ 235us) negotiation.cc:107] Waiting for socket to connect
0807 10:42:03.733325 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.124:33825: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
I20260807 10:42:03.734550 12195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:03.734213 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.124:33825 (local address 127.0.0.1:35112)
0807 10:42:03.734367 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0807 10:42:03.734449 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.124:33825: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260807 10:42:03.734772 12193 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.171.124:33825: Network error: Client connection negotiation failed: client connection to 127.20.171.124:33825: connect: Connection refused (error 111)
I20260807 10:42:03.841050 12193 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.171.124" port: 33825 } attempt: 3
I20260807 10:42:03.842159 12195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:03.841679 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.124:33825 (local address 127.0.0.1:35120)
0807 10:42:03.841889 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0807 10:42:03.841983 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.124:33825: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
I20260807 10:42:03.843349 12195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:03.842929 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.124:33825 (local address 127.0.0.1:35134)
0807 10:42:03.843118 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0807 10:42:03.843219 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.124:33825: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
W20260807 10:42:03.843603 12193 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.171.124:33825: Network error: Client connection negotiation failed: client connection to 127.20.171.124:33825: connect: Connection refused (error 111)
I20260807 10:42:03.845373 12272 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.171.124" port: 33825 } attempt: 4
I20260807 10:42:03.846416 12275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:03.845879 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.124:33825 (local address 127.0.0.1:35140)
0807 10:42:03.846114 (+ 235us) negotiation.cc:107] Waiting for socket to connect
0807 10:42:03.846243 (+ 129us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.124:33825: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
I20260807 10:42:03.847425 12275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:03.847038 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.124:33825 (local address 127.0.0.1:35152)
0807 10:42:03.847199 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0807 10:42:03.847287 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.171.124:33825: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260807 10:42:03.847667 12272 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.171.124:33825: Network error: Client connection negotiation failed: client connection to 127.20.171.124:33825: connect: Connection refused (error 111)
W20260807 10:42:03.867810 12280 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260807 10:42:03.868141 12280 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:42:03.868223 12280 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:42:03.868371 12280 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:42:03.875909 12280 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 10:42:03.875999 12280 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:42:03.876057 12280 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:42:03.876108 12280 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 10:42:03.876170 12280 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 10:42:03.886502 12280 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.171.84:34321
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786098956060137-21165-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786098956060137-21165-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.20.171.126:37579,127.20.171.125:35143,127.20.171.124:33825
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786098956060137-21165-0/krb5kdc/kudu_127.20.171.124.keytab
--principal=kudu/127.20.171.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.171.124:33825
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786098956060137-21165-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.20.171.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786098956060137-21165-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:42:03.887626 12280 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:42:03.888943 12280 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:42:03.900645 12285 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:42:03.900609 12288 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:42:03.900686 12286 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:42:03.901777 12280 server_base.cc:1034] running on GCE node
I20260807 10:42:03.902511 12280 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:42:03.903789 12280 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:42:03.905017 12280 hybrid_clock.cc:648] HybridClock initialized: now 1786099323904910 us; error 79 us; skew 500 ppm
I20260807 10:42:03.905359 12280 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:42:03 dist-test-slave-0b58 krb5kdc[12111](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099323, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:42:03.908636 12280 init.cc:377] Logged in from keytab as kudu/127.20.171.124@KRBTEST.COM (short username kudu)
I20260807 10:42:03.910107 12280 webserver.cc:460] Webserver started at http://127.20.171.124:46577/ using document root <none> and password file <none>
I20260807 10:42:03.910821 12280 fs_manager.cc:359] Metadata directory not provided
I20260807 10:42:03.910938 12280 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:42:03.911288 12280 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:42:03.914345 12280 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786098956060137-21165-0/minicluster-data/master-2/data/instance:
uuid: "3f0a39e26c09467ea14d28e85a651bf4"
format_stamp: "Formatted at 2026-08-07 10:42:03 on dist-test-slave-0b58"
server_key: "f5f516e1b4f5b6a713be86af3a1f88a5"
server_key_iv: "d7ca01f85eaf94063e0643bed6f0a853"
server_key_version: "encryptionkey@0"
I20260807 10:42:03.915148 12280 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786098956060137-21165-0/minicluster-data/master-2/wal/instance:
uuid: "3f0a39e26c09467ea14d28e85a651bf4"
format_stamp: "Formatted at 2026-08-07 10:42:03 on dist-test-slave-0b58"
server_key: "f5f516e1b4f5b6a713be86af3a1f88a5"
server_key_iv: "d7ca01f85eaf94063e0643bed6f0a853"
server_key_version: "encryptionkey@0"
I20260807 10:42:03.920109 12280 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.004s
I20260807 10:42:03.923672 12296 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:42:03.925076 12280 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 10:42:03.925236 12280 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786098956060137-21165-0/minicluster-data/master-2/data,/tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786098956060137-21165-0/minicluster-data/master-2/wal
uuid: "3f0a39e26c09467ea14d28e85a651bf4"
format_stamp: "Formatted at 2026-08-07 10:42:03 on dist-test-slave-0b58"
server_key: "f5f516e1b4f5b6a713be86af3a1f88a5"
server_key_iv: "d7ca01f85eaf94063e0643bed6f0a853"
server_key_version: "encryptionkey@0"
I20260807 10:42:03.925468 12280 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786098956060137-21165-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786098956060137-21165-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786098956060137-21165-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:42:03.987267 12280 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:42:03.991331 12280 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:42:03.991639 12280 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:42:04.010568 12280 rpc_server.cc:307] RPC server started. Bound to: 127.20.171.124:33825
I20260807 10:42:04.010589 12348 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.171.124:33825 every 8 connection(s)
I20260807 10:42:04.012004 12280 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786098956060137-21165-0/minicluster-data/master-2/data/info.pb
I20260807 10:42:04.015727 12349 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:42:04.015975 21165 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu as pid 12280
I20260807 10:42:04.016165 21165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskXRtsKb/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786098956060137-21165-0/minicluster-data/master-2/wal/instance
I20260807 10:42:04.016672 21165 external_mini_cluster.cc:1428] Setting key dfdf3ccb9edf9c8d3994ac851035a28f
I20260807 10:42:04.020848 12193 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.171.124" port: 33825 } attempt: 4
I20260807 10:42:04.025362 12349 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.171.126" port: 37579 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 10:42:04 dist-test-slave-0b58 krb5kdc[12111](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099322, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.126@KRBTEST.COM for kudu/127.20.171.124@KRBTEST.COM
Aug 07 10:42:04 dist-test-slave-0b58 krb5kdc[12111](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099322, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.171.124@KRBTEST.COM
Aug 07 10:42:04 dist-test-slave-0b58 krb5kdc[12111](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099323, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.124@KRBTEST.COM for kudu/127.20.171.126@KRBTEST.COM
I20260807 10:42:04.042411 12195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:04.021548 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.124:33825 (local address 127.0.0.1:35160)
0807 10:42:04.021769 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0807 10:42:04.021792 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0807 10:42:04.021918 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:42:04.023372 (+ 1454us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:42:04.023378 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:42:04.023895 (+ 517us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:42:04.024121 (+ 226us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:42:04.024133 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:42:04.026696 (+ 2563us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:42:04.026700 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:42:04.028188 (+ 1488us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:42:04.028205 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:42:04.029804 (+ 1599us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:42:04.029818 (+ 14us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:42:04.030020 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:04.030774 (+ 754us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:42:04.030799 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:42:04.033999 (+ 3200us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:42:04.039182 (+ 5183us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:42:04.039191 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:42:04.039195 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:42:04.039743 (+ 548us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:42:04.040380 (+ 637us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:42:04.040385 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:42:04.040388 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:42:04.040555 (+ 167us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:42:04.041423 (+ 868us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:42:04.041428 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:42:04.041617 (+ 189us) client_negotiation.cc:769] Sending connection context
0807 10:42:04.041782 (+ 165us) client_negotiation.cc:240] Negotiation successful
0807 10:42:04.042094 (+ 312us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":67}
I20260807 10:42:04.044863 12354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:04.021714 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35160 (local address 127.20.171.124:33825)
0807 10:42:04.022514 (+ 800us) server_negotiation.cc:206] Beginning negotiation
0807 10:42:04.022519 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:42:04.022546 (+ 27us) server_negotiation.cc:407] Connection header received
0807 10:42:04.022595 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:42:04.022599 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:42:04.022958 (+ 359us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:42:04.023401 (+ 443us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:42:04.024677 (+ 1276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:04.026447 (+ 1770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:04.028447 (+ 2000us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:04.029588 (+ 1141us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:04.030339 (+ 751us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:04.034283 (+ 3944us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:42:04.034297 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:42:04.034310 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:42:04.034389 (+ 79us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:42:04.039013 (+ 4624us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:42:04.039937 (+ 924us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:42:04.039945 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:42:04.039953 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:42:04.040194 (+ 241us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:42:04.040707 (+ 513us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:42:04.040712 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:42:04.040715 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:42:04.041275 (+ 560us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:42:04.041468 (+ 193us) server_negotiation.cc:1035] Waiting for connection context
0807 10:42:04.042892 (+ 1424us) server_negotiation.cc:299] Negotiation successful
0807 10:42:04.043335 (+ 443us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1541,"server-negotiator.queue_time_us":645,"spinlock_wait_cycles":896,"thread_start_us":425,"threads_started":1}
I20260807 10:42:04.044888 12353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:04.018468 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35156 (local address 127.20.171.124:33825)
0807 10:42:04.019316 (+ 848us) server_negotiation.cc:206] Beginning negotiation
0807 10:42:04.019327 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 10:42:04.019366 (+ 39us) server_negotiation.cc:407] Connection header received
0807 10:42:04.022367 (+ 3001us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:42:04.022397 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:42:04.022958 (+ 561us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:42:04.023401 (+ 443us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:42:04.025412 (+ 2011us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:04.026701 (+ 1289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:04.028528 (+ 1827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:04.029588 (+ 1060us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:04.029782 (+ 194us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:04.035655 (+ 5873us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:42:04.035661 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:42:04.035666 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:42:04.035705 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:42:04.039824 (+ 4119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:42:04.040671 (+ 847us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:42:04.040676 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:42:04.040680 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:42:04.040839 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:42:04.041317 (+ 478us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:42:04.041322 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:42:04.041325 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:42:04.041668 (+ 343us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:42:04.041950 (+ 282us) server_negotiation.cc:1035] Waiting for connection context
0807 10:42:04.043288 (+ 1338us) server_negotiation.cc:299] Negotiation successful
0807 10:42:04.043460 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":42,"server-negotiator.queue_time_us":646,"spinlock_wait_cycles":31744,"thread_start_us":411,"threads_started":1}
I20260807 10:42:04.047112 12356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:04.028323 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.126:37579 (local address 127.0.0.1:42486)
0807 10:42:04.031031 (+ 2708us) negotiation.cc:107] Waiting for socket to connect
0807 10:42:04.031085 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0807 10:42:04.031231 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:42:04.032163 (+ 932us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:42:04.032173 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:42:04.032896 (+ 723us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:42:04.033137 (+ 241us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:42:04.033146 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:42:04.034401 (+ 1255us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:42:04.034408 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:42:04.036342 (+ 1934us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:42:04.036361 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:42:04.037287 (+ 926us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:42:04.037295 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:42:04.037500 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:04.038178 (+ 678us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:42:04.038195 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:42:04.040752 (+ 2557us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:42:04.044227 (+ 3475us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:42:04.044238 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:42:04.044245 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:42:04.044675 (+ 430us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:42:04.045100 (+ 425us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:42:04.045107 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:42:04.045113 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:42:04.045264 (+ 151us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:42:04.045956 (+ 692us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:42:04.045961 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:42:04.046100 (+ 139us) client_negotiation.cc:769] Sending connection context
0807 10:42:04.046344 (+ 244us) client_negotiation.cc:240] Negotiation successful
0807 10:42:04.046668 (+ 324us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2453,"thread_start_us":2301,"threads_started":1}
I20260807 10:42:04.047134 12355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:04.028208 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42486 (local address 127.20.171.126:37579)
0807 10:42:04.031853 (+ 3645us) server_negotiation.cc:206] Beginning negotiation
0807 10:42:04.031857 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 10:42:04.031872 (+ 15us) server_negotiation.cc:407] Connection header received
0807 10:42:04.031909 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:42:04.031912 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:42:04.031967 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:42:04.032093 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:42:04.033339 (+ 1246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:04.034183 (+ 844us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:04.036523 (+ 2340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:04.037062 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:04.037205 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:04.040963 (+ 3758us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:42:04.040969 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:42:04.040973 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:42:04.041009 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:42:04.044086 (+ 3077us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:42:04.044801 (+ 715us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:42:04.044806 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:42:04.044812 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:42:04.044929 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:42:04.045409 (+ 480us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:42:04.045414 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:42:04.045417 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:42:04.045833 (+ 416us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:42:04.045984 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0807 10:42:04.046463 (+ 479us) server_negotiation.cc:299] Negotiation successful
0807 10:42:04.046701 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3529,"thread_start_us":3362,"threads_started":1}
I20260807 10:42:04.048612 12349 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.171.125" port: 35143 } has no permanent_uuid. Determining permanent_uuid...
I20260807 10:42:04.052057 12193 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b4029a4210b741a08e96bb18e4d494c5: Bootstrap starting.
I20260807 10:42:04.056020 12193 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b4029a4210b741a08e96bb18e4d494c5: Neither blocks nor log segments found. Creating new log.
I20260807 10:42:04.057425 12193 log.cc:824] T 00000000000000000000000000000000 P b4029a4210b741a08e96bb18e4d494c5: Log is configured to *not* fsync() on all Append() calls
Aug 07 10:42:04 dist-test-slave-0b58 krb5kdc[12111](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099322, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.171.126@KRBTEST.COM
Aug 07 10:42:04 dist-test-slave-0b58 krb5kdc[12111](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099323, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.124@KRBTEST.COM for kudu/127.20.171.125@KRBTEST.COM
I20260807 10:42:04.066499 12356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:04.049384 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.125:35143 (local address 127.0.0.1:60576)
0807 10:42:04.049567 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0807 10:42:04.049585 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 10:42:04.049919 (+ 334us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:42:04.052761 (+ 2842us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:42:04.052766 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:42:04.053295 (+ 529us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:42:04.053441 (+ 146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:42:04.053449 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:42:04.054624 (+ 1175us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:42:04.054629 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:42:04.055968 (+ 1339us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:42:04.055984 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:42:04.057121 (+ 1137us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:42:04.057129 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:42:04.057306 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:04.058023 (+ 717us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:42:04.058055 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:42:04.060765 (+ 2710us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:42:04.063770 (+ 3005us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:42:04.063776 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:42:04.063780 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:42:04.064154 (+ 374us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:42:04.064707 (+ 553us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:42:04.064714 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:42:04.064718 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:42:04.064904 (+ 186us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:42:04.065491 (+ 587us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:42:04.065496 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:42:04.065659 (+ 163us) client_negotiation.cc:769] Sending connection context
0807 10:42:04.065831 (+ 172us) client_negotiation.cc:240] Negotiation successful
0807 10:42:04.066099 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":60}
I20260807 10:42:04.066614 12277 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:04.049763 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60576 (local address 127.20.171.125:35143)
0807 10:42:04.052431 (+ 2668us) server_negotiation.cc:206] Beginning negotiation
0807 10:42:04.052438 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:42:04.052459 (+ 21us) server_negotiation.cc:407] Connection header received
0807 10:42:04.052518 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:42:04.052525 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:42:04.052605 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:42:04.052712 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:42:04.053593 (+ 881us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:04.054446 (+ 853us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:04.056154 (+ 1708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:04.056911 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:04.057062 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:04.060953 (+ 3891us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:42:04.060958 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:42:04.060961 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:42:04.060993 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:42:04.063633 (+ 2640us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:42:04.064382 (+ 749us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:42:04.064388 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:42:04.064391 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:42:04.064575 (+ 184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:42:04.065013 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:42:04.065020 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:42:04.065023 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:42:04.065361 (+ 338us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:42:04.065504 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0807 10:42:04.065951 (+ 447us) server_negotiation.cc:299] Negotiation successful
0807 10:42:04.066220 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2512}
I20260807 10:42:04.067312 12355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:04.049203 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42492 (local address 127.20.171.126:37579)
0807 10:42:04.049456 (+ 253us) server_negotiation.cc:206] Beginning negotiation
0807 10:42:04.049461 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:42:04.049478 (+ 17us) server_negotiation.cc:407] Connection header received
0807 10:42:04.049527 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:42:04.049531 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:42:04.049622 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:42:04.049733 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:42:04.050873 (+ 1140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:04.051678 (+ 805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:04.053297 (+ 1619us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:04.054004 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:04.054144 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:04.059101 (+ 4957us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:42:04.059105 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:42:04.059109 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:42:04.059136 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:42:04.063268 (+ 4132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:42:04.064338 (+ 1070us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:42:04.064345 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:42:04.064348 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:42:04.064524 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:42:04.064951 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:42:04.064956 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:42:04.064960 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:42:04.065353 (+ 393us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:42:04.065652 (+ 299us) server_negotiation.cc:1035] Waiting for connection context
0807 10:42:04.066766 (+ 1114us) server_negotiation.cc:299] Negotiation successful
0807 10:42:04.067008 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":131}
I20260807 10:42:04.067607 12349 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.171.124" port: 33825 } has no permanent_uuid. Determining permanent_uuid...
I20260807 10:42:04.067912 12193 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b4029a4210b741a08e96bb18e4d494c5: No bootstrap required, opened a new log
Aug 07 10:42:04 dist-test-slave-0b58 krb5kdc[12111](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099323, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.124@KRBTEST.COM for kudu/127.20.171.124@KRBTEST.COM
Aug 07 10:42:04 dist-test-slave-0b58 krb5kdc[12111](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099322, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.171.125@KRBTEST.COM
I20260807 10:42:04.079090 12193 raft_consensus.cc:348] T 00000000000000000000000000000000 P b4029a4210b741a08e96bb18e4d494c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4029a4210b741a08e96bb18e4d494c5" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 37579 } } peers { permanent_uuid: "c16a8caf679149d6bedfcbe43e4b68f4" member_type: VOTER last_known_addr { host: "127.20.171.125" port: 35143 } } peers { permanent_uuid: "3f0a39e26c09467ea14d28e85a651bf4" member_type: VOTER last_known_addr { host: "127.20.171.124" port: 33825 } }
I20260807 10:42:04.079450 12193 raft_consensus.cc:729] T 00000000000000000000000000000000 P b4029a4210b741a08e96bb18e4d494c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4029a4210b741a08e96bb18e4d494c5, State: Initialized, Role: FOLLOWER
I20260807 10:42:04.079926 12193 consensus_queue.cc:260] T 00000000000000000000000000000000 P b4029a4210b741a08e96bb18e4d494c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4029a4210b741a08e96bb18e4d494c5" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 37579 } } peers { permanent_uuid: "c16a8caf679149d6bedfcbe43e4b68f4" member_type: VOTER last_known_addr { host: "127.20.171.125" port: 35143 } } peers { permanent_uuid: "3f0a39e26c09467ea14d28e85a651bf4" member_type: VOTER last_known_addr { host: "127.20.171.124" port: 33825 } }
I20260807 10:42:04.080902 12358 sys_catalog.cc:455] T 00000000000000000000000000000000 P b4029a4210b741a08e96bb18e4d494c5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4029a4210b741a08e96bb18e4d494c5" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 37579 } } peers { permanent_uuid: "c16a8caf679149d6bedfcbe43e4b68f4" member_type: VOTER last_known_addr { host: "127.20.171.125" port: 35143 } } peers { permanent_uuid: "3f0a39e26c09467ea14d28e85a651bf4" member_type: VOTER last_known_addr { host: "127.20.171.124" port: 33825 } } }
I20260807 10:42:04.081487 12358 sys_catalog.cc:458] T 00000000000000000000000000000000 P b4029a4210b741a08e96bb18e4d494c5 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 10:42:04.082191 12193 sys_catalog.cc:564] T 00000000000000000000000000000000 P b4029a4210b741a08e96bb18e4d494c5 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 10:42:04.083045 12353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:04.068646 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35174 (local address 127.20.171.124:33825)
0807 10:42:04.068797 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0807 10:42:04.068802 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:42:04.068830 (+ 28us) server_negotiation.cc:407] Connection header received
0807 10:42:04.069174 (+ 344us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:42:04.069179 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:42:04.069258 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:42:04.069330 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:42:04.070391 (+ 1061us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:04.071478 (+ 1087us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:04.072909 (+ 1431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:04.073326 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:04.073470 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:04.076626 (+ 3156us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:42:04.076630 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:42:04.076633 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:42:04.076660 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:42:04.079720 (+ 3060us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:42:04.080541 (+ 821us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:42:04.080547 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:42:04.080551 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:42:04.080689 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:42:04.081133 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:42:04.081140 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:42:04.081144 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:42:04.081654 (+ 510us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:42:04.081790 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0807 10:42:04.082362 (+ 572us) server_negotiation.cc:299] Negotiation successful
0807 10:42:04.082639 (+ 277us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":21,"server-negotiator.queue_time_us":53}
I20260807 10:42:04.083982 12356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:04.068346 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.124:33825 (local address 127.0.0.1:35174)
0807 10:42:04.068483 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0807 10:42:04.068503 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0807 10:42:04.068595 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:42:04.069528 (+ 933us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:42:04.069532 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:42:04.070000 (+ 468us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:42:04.070205 (+ 205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:42:04.070220 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:42:04.071672 (+ 1452us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:42:04.071677 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:42:04.072768 (+ 1091us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:42:04.072780 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:42:04.073476 (+ 696us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:42:04.073481 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:42:04.073761 (+ 280us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:04.074258 (+ 497us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:42:04.074273 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:42:04.076448 (+ 2175us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:42:04.079888 (+ 3440us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:42:04.079893 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:42:04.079897 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:42:04.080419 (+ 522us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:42:04.080827 (+ 408us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:42:04.080833 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:42:04.080836 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:42:04.081010 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:42:04.081866 (+ 856us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:42:04.081872 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:42:04.082060 (+ 188us) client_negotiation.cc:769] Sending connection context
0807 10:42:04.083276 (+ 1216us) client_negotiation.cc:240] Negotiation successful
0807 10:42:04.083579 (+ 303us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33,"mutex_wait_us":24}
I20260807 10:42:04.090197 12349 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3f0a39e26c09467ea14d28e85a651bf4: Bootstrap starting.
I20260807 10:42:04.091290 12277 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:04.068963 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60584 (local address 127.20.171.125:35143)
0807 10:42:04.069114 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0807 10:42:04.069119 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:42:04.069140 (+ 21us) server_negotiation.cc:407] Connection header received
0807 10:42:04.069295 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:42:04.069300 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:42:04.069371 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:42:04.069473 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:42:04.070891 (+ 1418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:04.071690 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:04.073590 (+ 1900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:04.074533 (+ 943us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:04.074660 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:04.080282 (+ 5622us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:42:04.080289 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:42:04.080295 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:42:04.080344 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:42:04.083974 (+ 3630us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:42:04.084848 (+ 874us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:42:04.084856 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:42:04.084862 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:42:04.088430 (+ 3568us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:42:04.088947 (+ 517us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:42:04.088952 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:42:04.088955 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:42:04.089319 (+ 364us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:42:04.090568 (+ 1249us) server_negotiation.cc:1035] Waiting for connection context
0807 10:42:04.090692 (+ 124us) server_negotiation.cc:299] Negotiation successful
0807 10:42:04.090934 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260807 10:42:04.094916 12349 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3f0a39e26c09467ea14d28e85a651bf4: Neither blocks nor log segments found. Creating new log.
I20260807 10:42:04.096490 12349 log.cc:824] T 00000000000000000000000000000000 P 3f0a39e26c09467ea14d28e85a651bf4: Log is configured to *not* fsync() on all Append() calls
I20260807 10:42:04.096684 21165 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 10:42:04.099026 12168 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "b4029a4210b741a08e96bb18e4d494c5"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42492
I20260807 10:42:04.099367 12168 raft_consensus.cc:482] T 00000000000000000000000000000000 P b4029a4210b741a08e96bb18e4d494c5 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 10:42:04.099565 12168 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b4029a4210b741a08e96bb18e4d494c5 [term 0 FOLLOWER]: Advancing to term 1
W20260807 10:42:04.101339 12369 catalog_manager.cc:1558] T 00000000000000000000000000000000 P b4029a4210b741a08e96bb18e4d494c5: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 10:42:04.101480 12369 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 10:42:04.101613 12349 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3f0a39e26c09467ea14d28e85a651bf4: No bootstrap required, opened a new log
I20260807 10:42:04.103410 12168 raft_consensus.cc:504] T 00000000000000000000000000000000 P b4029a4210b741a08e96bb18e4d494c5 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4029a4210b741a08e96bb18e4d494c5" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 37579 } } peers { permanent_uuid: "c16a8caf679149d6bedfcbe43e4b68f4" member_type: VOTER last_known_addr { host: "127.20.171.125" port: 35143 } } peers { permanent_uuid: "3f0a39e26c09467ea14d28e85a651bf4" member_type: VOTER last_known_addr { host: "127.20.171.124" port: 33825 } }
I20260807 10:42:04.105641 12168 leader_election.cc:288] T 00000000000000000000000000000000 P b4029a4210b741a08e96bb18e4d494c5 [CANDIDATE]: Term 1 election: Requested vote from peers c16a8caf679149d6bedfcbe43e4b68f4 (127.20.171.125:35143), 3f0a39e26c09467ea14d28e85a651bf4 (127.20.171.124:33825)
I20260807 10:42:04.092393 12124 master_runner.cc:186] Error getting master registration for 127.20.171.125:35143: OK, instance_id { permanent_uuid: "c16a8caf679149d6bedfcbe43e4b68f4" instance_seqno: 1786099323415409 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260807 10:42:04.107174 12124 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260807 10:42:04.113317 12145 tablet.cc:2369] T 00000000000000000000000000000000 P b4029a4210b741a08e96bb18e4d494c5: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 10:42:04.115000 12349 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3f0a39e26c09467ea14d28e85a651bf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4029a4210b741a08e96bb18e4d494c5" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 37579 } } peers { permanent_uuid: "c16a8caf679149d6bedfcbe43e4b68f4" member_type: VOTER last_known_addr { host: "127.20.171.125" port: 35143 } } peers { permanent_uuid: "3f0a39e26c09467ea14d28e85a651bf4" member_type: VOTER last_known_addr { host: "127.20.171.124" port: 33825 } }
I20260807 10:42:04.115531 12349 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3f0a39e26c09467ea14d28e85a651bf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f0a39e26c09467ea14d28e85a651bf4, State: Initialized, Role: FOLLOWER
I20260807 10:42:04.116082 12349 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3f0a39e26c09467ea14d28e85a651bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4029a4210b741a08e96bb18e4d494c5" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 37579 } } peers { permanent_uuid: "c16a8caf679149d6bedfcbe43e4b68f4" member_type: VOTER last_known_addr { host: "127.20.171.125" port: 35143 } } peers { permanent_uuid: "3f0a39e26c09467ea14d28e85a651bf4" member_type: VOTER last_known_addr { host: "127.20.171.124" port: 33825 } }
I20260807 10:42:04.117527 12374 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3f0a39e26c09467ea14d28e85a651bf4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4029a4210b741a08e96bb18e4d494c5" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 37579 } } peers { permanent_uuid: "c16a8caf679149d6bedfcbe43e4b68f4" member_type: VOTER last_known_addr { host: "127.20.171.125" port: 35143 } } peers { permanent_uuid: "3f0a39e26c09467ea14d28e85a651bf4" member_type: VOTER last_known_addr { host: "127.20.171.124" port: 33825 } } }
I20260807 10:42:04.118402 12374 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3f0a39e26c09467ea14d28e85a651bf4 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 10:42:04.118700 12349 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3f0a39e26c09467ea14d28e85a651bf4 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 10:42:04.118755 12324 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b4029a4210b741a08e96bb18e4d494c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "3f0a39e26c09467ea14d28e85a651bf4"
I20260807 10:42:04.119169 12324 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3f0a39e26c09467ea14d28e85a651bf4 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:42:04.123657 12324 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 3f0a39e26c09467ea14d28e85a651bf4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b4029a4210b741a08e96bb18e4d494c5 in term 1.
I20260807 10:42:04.124462 12143 leader_election.cc:302] T 00000000000000000000000000000000 P b4029a4210b741a08e96bb18e4d494c5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f0a39e26c09467ea14d28e85a651bf4, b4029a4210b741a08e96bb18e4d494c5; no voters:
I20260807 10:42:04.124922 12358 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b4029a4210b741a08e96bb18e4d494c5 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:42:04.139422 12358 raft_consensus.cc:686] T 00000000000000000000000000000000 P b4029a4210b741a08e96bb18e4d494c5 [term 1 LEADER]: Becoming Leader. State: Replica: b4029a4210b741a08e96bb18e4d494c5, State: Running, Role: LEADER
I20260807 10:42:04.140170 12358 consensus_queue.cc:237] T 00000000000000000000000000000000 P b4029a4210b741a08e96bb18e4d494c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4029a4210b741a08e96bb18e4d494c5" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 37579 } } peers { permanent_uuid: "c16a8caf679149d6bedfcbe43e4b68f4" member_type: VOTER last_known_addr { host: "127.20.171.125" port: 35143 } } peers { permanent_uuid: "3f0a39e26c09467ea14d28e85a651bf4" member_type: VOTER last_known_addr { host: "127.20.171.124" port: 33825 } }
I20260807 10:42:04.146879 12272 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.171.124" port: 33825 } attempt: 5
Aug 07 10:42:04 dist-test-slave-0b58 krb5kdc[12111](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099323, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.171.125@KRBTEST.COM for kudu/127.20.171.124@KRBTEST.COM
I20260807 10:42:04.157642 12378 sys_catalog.cc:455] T 00000000000000000000000000000000 P b4029a4210b741a08e96bb18e4d494c5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b4029a4210b741a08e96bb18e4d494c5. Latest consensus state: current_term: 1 leader_uuid: "b4029a4210b741a08e96bb18e4d494c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4029a4210b741a08e96bb18e4d494c5" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 37579 } } peers { permanent_uuid: "c16a8caf679149d6bedfcbe43e4b68f4" member_type: VOTER last_known_addr { host: "127.20.171.125" port: 35143 } } peers { permanent_uuid: "3f0a39e26c09467ea14d28e85a651bf4" member_type: VOTER last_known_addr { host: "127.20.171.124" port: 33825 } } }
I20260807 10:42:04.158106 12378 sys_catalog.cc:458] T 00000000000000000000000000000000 P b4029a4210b741a08e96bb18e4d494c5 [sys.catalog]: This master's current role is: LEADER
I20260807 10:42:04.165033 12353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:04.147634 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35188 (local address 127.20.171.124:33825)
0807 10:42:04.147868 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0807 10:42:04.147877 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 10:42:04.147902 (+ 25us) server_negotiation.cc:407] Connection header received
0807 10:42:04.148077 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:42:04.148082 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:42:04.148184 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:42:04.148401 (+ 217us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:42:04.149723 (+ 1322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:04.150669 (+ 946us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:04.152610 (+ 1941us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:04.153299 (+ 689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:04.153420 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:04.157787 (+ 4367us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:42:04.157795 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:42:04.157802 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:42:04.157847 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:42:04.161576 (+ 3729us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:42:04.162458 (+ 882us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:42:04.162464 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:42:04.162468 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:42:04.162616 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:42:04.163133 (+ 517us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:42:04.163138 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:42:04.163141 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:42:04.163536 (+ 395us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:42:04.163693 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0807 10:42:04.164417 (+ 724us) server_negotiation.cc:299] Negotiation successful
0807 10:42:04.164639 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260807 10:42:04.165848 12275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:04.147525 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.171.124:33825 (local address 127.0.0.1:35188)
0807 10:42:04.147823 (+ 298us) negotiation.cc:107] Waiting for socket to connect
0807 10:42:04.147843 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0807 10:42:04.147951 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:42:04.148598 (+ 647us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:42:04.148606 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:42:04.149278 (+ 672us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:42:04.149543 (+ 265us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:42:04.149556 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:42:04.150822 (+ 1266us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:42:04.150830 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:42:04.152422 (+ 1592us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:42:04.152440 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:42:04.153644 (+ 1204us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:42:04.153650 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:42:04.153896 (+ 246us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:04.154620 (+ 724us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:42:04.154646 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:42:04.157544 (+ 2898us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:42:04.161781 (+ 4237us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:42:04.161787 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:42:04.161791 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:42:04.162311 (+ 520us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:42:04.162769 (+ 458us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:42:04.162774 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:42:04.162778 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:42:04.162994 (+ 216us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:42:04.163762 (+ 768us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:42:04.163768 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:42:04.163933 (+ 165us) client_negotiation.cc:769] Sending connection context
0807 10:42:04.164110 (+ 177us) client_negotiation.cc:240] Negotiation successful
0807 10:42:04.165443 (+ 1333us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":178,"mutex_wait_us":59}
I20260807 10:42:04.171963 12272 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c16a8caf679149d6bedfcbe43e4b68f4: Bootstrap starting.
I20260807 10:42:04.176373 12272 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c16a8caf679149d6bedfcbe43e4b68f4: Neither blocks nor log segments found. Creating new log.
I20260807 10:42:04.177765 12272 log.cc:824] T 00000000000000000000000000000000 P c16a8caf679149d6bedfcbe43e4b68f4: Log is configured to *not* fsync() on all Append() calls
I20260807 10:42:04.187620 12272 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c16a8caf679149d6bedfcbe43e4b68f4: No bootstrap required, opened a new log
I20260807 10:42:04.192354 12355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:04.131183 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42508 (local address 127.20.171.126:37579)
0807 10:42:04.131366 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0807 10:42:04.131372 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:42:04.143840 (+ 12468us) server_negotiation.cc:407] Connection header received
0807 10:42:04.144593 (+ 753us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:42:04.144601 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:42:04.144709 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:42:04.144814 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:42:04.151858 (+ 7044us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:04.153015 (+ 1157us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:04.168653 (+ 15638us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:04.169452 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:04.169605 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:04.173832 (+ 4227us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:42:04.173841 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:42:04.173846 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:42:04.173891 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:42:04.177984 (+ 4093us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:42:04.180699 (+ 2715us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:42:04.180706 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:42:04.180709 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:42:04.180858 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:42:04.182306 (+ 1448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:42:04.182313 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:42:04.182320 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:42:04.182887 (+ 567us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:42:04.183285 (+ 398us) server_negotiation.cc:1035] Waiting for connection context
0807 10:42:04.186396 (+ 3111us) server_negotiation.cc:299] Negotiation successful
0807 10:42:04.186697 (+ 301us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260807 10:42:04.194044 12387 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 10:42:04.196223 12387 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 10:42:04.199175 12277 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:04.130584 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60590 (local address 127.20.171.125:35143)
0807 10:42:04.130781 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0807 10:42:04.130787 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:42:04.148815 (+ 18028us) server_negotiation.cc:407] Connection header received
0807 10:42:04.149060 (+ 245us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:42:04.149067 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:42:04.149150 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:42:04.149237 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:42:04.152912 (+ 3675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:04.153982 (+ 1070us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:04.163103 (+ 9121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:04.163999 (+ 896us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:04.164122 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:04.180357 (+ 16235us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:42:04.180367 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:42:04.180374 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:42:04.180429 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:42:04.184510 (+ 4081us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:42:04.187227 (+ 2717us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:42:04.187232 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:42:04.187237 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:42:04.187414 (+ 177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:42:04.189281 (+ 1867us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:42:04.189290 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:42:04.189296 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:42:04.189810 (+ 514us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:42:04.190185 (+ 375us) server_negotiation.cc:1035] Waiting for connection context
0807 10:42:04.198344 (+ 8159us) server_negotiation.cc:299] Negotiation successful
0807 10:42:04.198705 (+ 361us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":4,"server-negotiator.queue_time_us":67}
I20260807 10:42:04.198784 12272 raft_consensus.cc:348] T 00000000000000000000000000000000 P c16a8caf679149d6bedfcbe43e4b68f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4029a4210b741a08e96bb18e4d494c5" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 37579 } } peers { permanent_uuid: "c16a8caf679149d6bedfcbe43e4b68f4" member_type: VOTER last_known_addr { host: "127.20.171.125" port: 35143 } } peers { permanent_uuid: "3f0a39e26c09467ea14d28e85a651bf4" member_type: VOTER last_known_addr { host: "127.20.171.124" port: 33825 } }
I20260807 10:42:04.199771 12272 raft_consensus.cc:729] T 00000000000000000000000000000000 P c16a8caf679149d6bedfcbe43e4b68f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c16a8caf679149d6bedfcbe43e4b68f4, State: Initialized, Role: FOLLOWER
I20260807 10:42:04.200361 12272 consensus_queue.cc:260] T 00000000000000000000000000000000 P c16a8caf679149d6bedfcbe43e4b68f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4029a4210b741a08e96bb18e4d494c5" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 37579 } } peers { permanent_uuid: "c16a8caf679149d6bedfcbe43e4b68f4" member_type: VOTER last_known_addr { host: "127.20.171.125" port: 35143 } } peers { permanent_uuid: "3f0a39e26c09467ea14d28e85a651bf4" member_type: VOTER last_known_addr { host: "127.20.171.124" port: 33825 } }
I20260807 10:42:04.210281 12354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:04.149402 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35192 (local address 127.20.171.124:33825)
0807 10:42:04.149624 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0807 10:42:04.149632 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 10:42:04.150863 (+ 1231us) server_negotiation.cc:407] Connection header received
0807 10:42:04.151288 (+ 425us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:42:04.151296 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:42:04.151385 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:42:04.151462 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:42:04.159467 (+ 8005us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:04.160959 (+ 1492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:04.173303 (+ 12344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:04.174078 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:04.174190 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:04.192231 (+ 18041us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:42:04.192242 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:42:04.192249 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:42:04.192322 (+ 73us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:42:04.197819 (+ 5497us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:42:04.204165 (+ 6346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:42:04.204176 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:42:04.204182 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:42:04.204594 (+ 412us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:42:04.205639 (+ 1045us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:42:04.205647 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:42:04.205653 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:42:04.206666 (+ 1013us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:42:04.207302 (+ 636us) server_negotiation.cc:1035] Waiting for connection context
0807 10:42:04.208662 (+ 1360us) server_negotiation.cc:299] Negotiation successful
0807 10:42:04.209295 (+ 633us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260807 10:42:04.226002 12272 sys_catalog.cc:564] T 00000000000000000000000000000000 P c16a8caf679149d6bedfcbe43e4b68f4 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 10:42:04.227193 12244 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b4029a4210b741a08e96bb18e4d494c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "c16a8caf679149d6bedfcbe43e4b68f4"
I20260807 10:42:04.227767 12244 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c16a8caf679149d6bedfcbe43e4b68f4 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:42:04.231911 12244 raft_consensus.cc:2454] T 00000000000000000000000000000000 P c16a8caf679149d6bedfcbe43e4b68f4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b4029a4210b741a08e96bb18e4d494c5 in term 1.
I20260807 10:42:04.235291 12396 sys_catalog.cc:455] T 00000000000000000000000000000000 P c16a8caf679149d6bedfcbe43e4b68f4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4029a4210b741a08e96bb18e4d494c5" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 37579 } } peers { permanent_uuid: "c16a8caf679149d6bedfcbe43e4b68f4" member_type: VOTER last_known_addr { host: "127.20.171.125" port: 35143 } } peers { permanent_uuid: "3f0a39e26c09467ea14d28e85a651bf4" member_type: VOTER last_known_addr { host: "127.20.171.124" port: 33825 } } }
I20260807 10:42:04.235956 12396 sys_catalog.cc:458] T 00000000000000000000000000000000 P c16a8caf679149d6bedfcbe43e4b68f4 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 10:42:04.239084 12324 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 3f0a39e26c09467ea14d28e85a651bf4 [term 1 FOLLOWER]: Refusing update from remote peer b4029a4210b741a08e96bb18e4d494c5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 10:42:04.239280 12244 raft_consensus.cc:1261] T 00000000000000000000000000000000 P c16a8caf679149d6bedfcbe43e4b68f4 [term 1 FOLLOWER]: Refusing update from remote peer b4029a4210b741a08e96bb18e4d494c5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 10:42:04.240332 12358 consensus_queue.cc:1035] T 00000000000000000000000000000000 P b4029a4210b741a08e96bb18e4d494c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c16a8caf679149d6bedfcbe43e4b68f4" member_type: VOTER last_known_addr { host: "127.20.171.125" port: 35143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 10:42:04.240695 12378 consensus_queue.cc:1035] T 00000000000000000000000000000000 P b4029a4210b741a08e96bb18e4d494c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f0a39e26c09467ea14d28e85a651bf4" member_type: VOTER last_known_addr { host: "127.20.171.124" port: 33825 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260807 10:42:04.243836 12302 tablet.cc:2369] T 00000000000000000000000000000000 P 3f0a39e26c09467ea14d28e85a651bf4: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 10:42:04.257790 12410 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260807 10:42:04.257892 12374 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3f0a39e26c09467ea14d28e85a651bf4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b4029a4210b741a08e96bb18e4d494c5. Latest consensus state: current_term: 1 leader_uuid: "b4029a4210b741a08e96bb18e4d494c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4029a4210b741a08e96bb18e4d494c5" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 37579 } } peers { permanent_uuid: "c16a8caf679149d6bedfcbe43e4b68f4" member_type: VOTER last_known_addr { host: "127.20.171.125" port: 35143 } } peers { permanent_uuid: "3f0a39e26c09467ea14d28e85a651bf4" member_type: VOTER last_known_addr { host: "127.20.171.124" port: 33825 } } }
I20260807 10:42:04.258184 12374 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3f0a39e26c09467ea14d28e85a651bf4 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 10:42:04.263389 12358 sys_catalog.cc:455] T 00000000000000000000000000000000 P b4029a4210b741a08e96bb18e4d494c5 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b4029a4210b741a08e96bb18e4d494c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4029a4210b741a08e96bb18e4d494c5" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 37579 } } peers { permanent_uuid: "c16a8caf679149d6bedfcbe43e4b68f4" member_type: VOTER last_known_addr { host: "127.20.171.125" port: 35143 } } peers { permanent_uuid: "3f0a39e26c09467ea14d28e85a651bf4" member_type: VOTER last_known_addr { host: "127.20.171.124" port: 33825 } } }
I20260807 10:42:04.263754 12358 sys_catalog.cc:458] T 00000000000000000000000000000000 P b4029a4210b741a08e96bb18e4d494c5 [sys.catalog]: This master's current role is: LEADER
I20260807 10:42:04.265514 12396 sys_catalog.cc:455] T 00000000000000000000000000000000 P c16a8caf679149d6bedfcbe43e4b68f4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b4029a4210b741a08e96bb18e4d494c5. Latest consensus state: current_term: 1 leader_uuid: "b4029a4210b741a08e96bb18e4d494c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4029a4210b741a08e96bb18e4d494c5" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 37579 } } peers { permanent_uuid: "c16a8caf679149d6bedfcbe43e4b68f4" member_type: VOTER last_known_addr { host: "127.20.171.125" port: 35143 } } peers { permanent_uuid: "3f0a39e26c09467ea14d28e85a651bf4" member_type: VOTER last_known_addr { host: "127.20.171.124" port: 33825 } } }
I20260807 10:42:04.265815 12396 sys_catalog.cc:458] T 00000000000000000000000000000000 P c16a8caf679149d6bedfcbe43e4b68f4 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 10:42:04.266073 12378 sys_catalog.cc:455] T 00000000000000000000000000000000 P b4029a4210b741a08e96bb18e4d494c5 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b4029a4210b741a08e96bb18e4d494c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4029a4210b741a08e96bb18e4d494c5" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 37579 } } peers { permanent_uuid: "c16a8caf679149d6bedfcbe43e4b68f4" member_type: VOTER last_known_addr { host: "127.20.171.125" port: 35143 } } peers { permanent_uuid: "3f0a39e26c09467ea14d28e85a651bf4" member_type: VOTER last_known_addr { host: "127.20.171.124" port: 33825 } } }
I20260807 10:42:04.266356 12378 sys_catalog.cc:458] T 00000000000000000000000000000000 P b4029a4210b741a08e96bb18e4d494c5 [sys.catalog]: This master's current role is: LEADER
I20260807 10:42:04.266647 12395 mvcc.cc:205] Tried to move back new op lower bound from 7315862832064425984 to 7315862831685402624. Current Snapshot: MvccSnapshot[applied={T|T < 7315862832064425984}]
I20260807 10:42:04.266753 12374 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3f0a39e26c09467ea14d28e85a651bf4 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b4029a4210b741a08e96bb18e4d494c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4029a4210b741a08e96bb18e4d494c5" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 37579 } } peers { permanent_uuid: "c16a8caf679149d6bedfcbe43e4b68f4" member_type: VOTER last_known_addr { host: "127.20.171.125" port: 35143 } } peers { permanent_uuid: "3f0a39e26c09467ea14d28e85a651bf4" member_type: VOTER last_known_addr { host: "127.20.171.124" port: 33825 } } }
I20260807 10:42:04.266961 12374 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3f0a39e26c09467ea14d28e85a651bf4 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 10:42:04.269513 12387 catalog_manager.cc:1347] Generated new cluster ID: 04824251b4224618b2f57a742c6ef434
I20260807 10:42:04.269615 12387 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 10:42:04.271911 12280 master_runner.cc:186] Error getting master registration for 127.20.171.125:35143: OK, instance_id { permanent_uuid: "c16a8caf679149d6bedfcbe43e4b68f4" instance_seqno: 1786099323415409 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260807 10:42:04.286854 12280 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260807 10:42:04.287644 12396 sys_catalog.cc:455] T 00000000000000000000000000000000 P c16a8caf679149d6bedfcbe43e4b68f4 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b4029a4210b741a08e96bb18e4d494c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4029a4210b741a08e96bb18e4d494c5" member_type: VOTER last_known_addr { host: "127.20.171.126" port: 37579 } } peers { permanent_uuid: "c16a8caf679149d6bedfcbe43e4b68f4" member_type: VOTER last_known_addr { host: "127.20.171.125" port: 35143 } } peers { permanent_uuid: "3f0a39e26c09467ea14d28e85a651bf4" member_type: VOTER last_known_addr { host: "127.20.171.124" port: 33825 } } }
I20260807 10:42:04.287917 12396 sys_catalog.cc:458] T 00000000000000000000000000000000 P c16a8caf679149d6bedfcbe43e4b68f4 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 10:42:04.309233 12387 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 10:42:04.310801 12387 catalog_manager.cc:1504] Loading token signing keys...
I20260807 10:42:04.315058 12418 catalog_manager.cc:1259] Loaded cluster ID: 04824251b4224618b2f57a742c6ef434
I20260807 10:42:04.315192 12418 catalog_manager.cc:1552] T 00000000000000000000000000000000 P c16a8caf679149d6bedfcbe43e4b68f4: loading cluster ID for follower catalog manager: success
I20260807 10:42:04.321918 12418 catalog_manager.cc:1574] T 00000000000000000000000000000000 P c16a8caf679149d6bedfcbe43e4b68f4: acquiring CA information for follower catalog manager: success
W20260807 10:42:04.323222 12418 catalog_manager.cc:873] Not found: no TSK found in the system table: failed to prepare follower catalog manager, will retry
I20260807 10:42:04.328576 12387 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b4029a4210b741a08e96bb18e4d494c5: Generated new TSK 0
I20260807 10:42:04.329610 12387 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260807 10:42:04.464370 12355 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:42:04.454667 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42522 (local address 127.20.171.126:37579)
0807 10:42:04.454883 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0807 10:42:04.454889 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:42:04.461360 (+ 6471us) server_negotiation.cc:407] Connection header received
0807 10:42:04.462689 (+ 1329us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:42:04.462696 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:42:04.462786 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:42:04.462862 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:42:04.464094 (+ 1232us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42522: BlockingRecv error: recv got EOF from 127.0.0.1:42522 (error 108)
Metrics: {"server-negotiator.queue_time_us":75}
W20260807 10:42:04.467463 12277 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:42:04.454296 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60604 (local address 127.20.171.125:35143)
0807 10:42:04.454501 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0807 10:42:04.454510 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 10:42:04.465819 (+ 11309us) server_negotiation.cc:407] Connection header received
0807 10:42:04.465990 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:42:04.465999 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:42:04.466102 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:42:04.466241 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:42:04.467227 (+ 986us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60604: BlockingRecv error: recv got EOF from 127.0.0.1:60604 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
W20260807 10:42:04.469149 12354 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:42:04.461940 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35206 (local address 127.20.171.124:33825)
0807 10:42:04.462187 (+ 247us) server_negotiation.cc:206] Beginning negotiation
0807 10:42:04.462197 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 10:42:04.466993 (+ 4796us) server_negotiation.cc:407] Connection header received
0807 10:42:04.467578 (+ 585us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:42:04.467584 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:42:04.467669 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:42:04.467752 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:42:04.468919 (+ 1167us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35206: BlockingRecv error: recv got EOF from 127.0.0.1:35206 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
W20260807 10:42:04.476559 12277 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:42:04.474328 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60614 (local address 127.20.171.125:35143)
0807 10:42:04.474509 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0807 10:42:04.474514 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:42:04.475030 (+ 516us) server_negotiation.cc:407] Connection header received
0807 10:42:04.475245 (+ 215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:42:04.475250 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:42:04.475368 (+ 118us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:42:04.475469 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:42:04.476286 (+ 817us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60614: BlockingRecv error: recv got EOF from 127.0.0.1:60614 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
W20260807 10:42:04.484596 12277 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:42:04.482244 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60622 (local address 127.20.171.125:35143)
0807 10:42:04.482414 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0807 10:42:04.482420 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:42:04.482994 (+ 574us) server_negotiation.cc:407] Connection header received
0807 10:42:04.483247 (+ 253us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:42:04.483256 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:42:04.483345 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:42:04.483448 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:42:04.484381 (+ 933us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60622: BlockingRecv error: recv got EOF from 127.0.0.1:60622 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
W20260807 10:42:04.495875 12277 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:42:04.493622 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60638 (local address 127.20.171.125:35143)
0807 10:42:04.493788 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0807 10:42:04.493793 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:42:04.494283 (+ 490us) server_negotiation.cc:407] Connection header received
0807 10:42:04.494457 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:42:04.494463 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:42:04.494570 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:42:04.494718 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:42:04.495631 (+ 913us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60638: BlockingRecv error: recv got EOF from 127.0.0.1:60638 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
W20260807 10:42:04.505730 12277 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:42:04.503528 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60652 (local address 127.20.171.125:35143)
0807 10:42:04.503747 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0807 10:42:04.503752 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:42:04.504250 (+ 498us) server_negotiation.cc:407] Connection header received
0807 10:42:04.504471 (+ 221us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:42:04.504477 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:42:04.504567 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:42:04.504669 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:42:04.505498 (+ 829us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60652: BlockingRecv error: recv got EOF from 127.0.0.1:60652 (error 108)
Metrics: {"server-negotiator.queue_time_us":101}
W20260807 10:42:04.519285 12277 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:42:04.516975 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60658 (local address 127.20.171.125:35143)
0807 10:42:04.517146 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0807 10:42:04.517152 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:42:04.517715 (+ 563us) server_negotiation.cc:407] Connection header received
0807 10:42:04.517931 (+ 216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:42:04.517937 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:42:04.518037 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:42:04.518143 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:42:04.519030 (+ 887us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60658: BlockingRecv error: recv got EOF from 127.0.0.1:60658 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
W20260807 10:42:04.541654 12277 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:42:04.539139 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60674 (local address 127.20.171.125:35143)
0807 10:42:04.539343 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0807 10:42:04.539349 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:42:04.539951 (+ 602us) server_negotiation.cc:407] Connection header received
0807 10:42:04.540178 (+ 227us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:42:04.540184 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:42:04.540328 (+ 144us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:42:04.540434 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:42:04.541382 (+ 948us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60674: BlockingRecv error: recv got EOF from 127.0.0.1:60674 (error 108)
Metrics: {"server-negotiator.queue_time_us":75}
W20260807 10:42:04.584582 12277 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:42:04.582020 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60686 (local address 127.20.171.125:35143)
0807 10:42:04.582261 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0807 10:42:04.582268 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:42:04.582862 (+ 594us) server_negotiation.cc:407] Connection header received
0807 10:42:04.583122 (+ 260us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:42:04.583128 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:42:04.583220 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:42:04.583332 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:42:04.584316 (+ 984us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60686: BlockingRecv error: recv got EOF from 127.0.0.1:60686 (error 108)
Metrics: {"server-negotiator.queue_time_us":83}
W20260807 10:42:04.660133 12277 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:42:04.657701 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60702 (local address 127.20.171.125:35143)
0807 10:42:04.657900 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0807 10:42:04.657907 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:42:04.658479 (+ 572us) server_negotiation.cc:407] Connection header received
0807 10:42:04.658685 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:42:04.658691 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:42:04.658799 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:42:04.658930 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:42:04.659884 (+ 954us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60702: BlockingRecv error: recv got EOF from 127.0.0.1:60702 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
W20260807 10:42:04.793299 12277 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:42:04.791196 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60714 (local address 127.20.171.125:35143)
0807 10:42:04.791438 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0807 10:42:04.791447 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 10:42:04.791807 (+ 360us) server_negotiation.cc:407] Connection header received
0807 10:42:04.792053 (+ 246us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:42:04.792057 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:42:04.792133 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:42:04.792246 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:42:04.793099 (+ 853us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60714: BlockingRecv error: recv got EOF from 127.0.0.1:60714 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
W20260807 10:42:05.055509 12277 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:42:05.053742 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60716 (local address 127.20.171.125:35143)
0807 10:42:05.054003 (+ 261us) server_negotiation.cc:206] Beginning negotiation
0807 10:42:05.054008 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:42:05.054135 (+ 127us) server_negotiation.cc:407] Connection header received
0807 10:42:05.054317 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:42:05.054321 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:42:05.054409 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:42:05.054496 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:42:05.055263 (+ 767us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60716: BlockingRecv error: recv got EOF from 127.0.0.1:60716 (error 108)
Metrics: {"server-negotiator.queue_time_us":97}
I20260807 10:42:05.262357 12410 catalog_manager.cc:1259] Loaded cluster ID: 04824251b4224618b2f57a742c6ef434
I20260807 10:42:05.262516 12410 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 3f0a39e26c09467ea14d28e85a651bf4: loading cluster ID for follower catalog manager: success
I20260807 10:42:05.265305 12410 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 3f0a39e26c09467ea14d28e85a651bf4: acquiring CA information for follower catalog manager: success
I20260807 10:42:05.267198 12410 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 3f0a39e26c09467ea14d28e85a651bf4: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260807 10:42:05.326702 12418 catalog_manager.cc:1602] T 00000000000000000000000000000000 P c16a8caf679149d6bedfcbe43e4b68f4: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260807 10:42:05.584443 12487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:05.577393 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60720 (local address 127.20.171.125:35143)
0807 10:42:05.578148 (+ 755us) server_negotiation.cc:206] Beginning negotiation
0807 10:42:05.578153 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:42:05.578172 (+ 19us) server_negotiation.cc:407] Connection header received
0807 10:42:05.578247 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:42:05.578251 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:42:05.578396 (+ 145us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:42:05.578505 (+ 109us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 10:42:05.578989 (+ 484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:05.579721 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:05.581709 (+ 1988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:05.582236 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:05.582356 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:05.582978 (+ 622us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 10:42:05.583694 (+ 716us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 10:42:05.583811 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0807 10:42:05.583951 (+ 140us) server_negotiation.cc:299] Negotiation successful
0807 10:42:05.584022 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":639,"thread_start_us":501,"threads_started":1}
I20260807 10:42:05.601392 12494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:05.591410 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35212 (local address 127.20.171.124:33825)
0807 10:42:05.595175 (+ 3765us) server_negotiation.cc:206] Beginning negotiation
0807 10:42:05.595179 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 10:42:05.595196 (+ 17us) server_negotiation.cc:407] Connection header received
0807 10:42:05.595279 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:42:05.595282 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:42:05.595419 (+ 137us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:42:05.595562 (+ 143us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 10:42:05.596095 (+ 533us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:05.596977 (+ 882us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:05.598855 (+ 1878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:05.599306 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:05.599401 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:05.600055 (+ 654us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 10:42:05.600694 (+ 639us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 10:42:05.600810 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0807 10:42:05.600940 (+ 130us) server_negotiation.cc:299] Negotiation successful
0807 10:42:05.601005 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3652,"thread_start_us":3489,"threads_started":1}
I20260807 10:42:05.614166 12500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:05.607418 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42536 (local address 127.20.171.126:37579)
0807 10:42:05.607906 (+ 488us) server_negotiation.cc:206] Beginning negotiation
0807 10:42:05.607910 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 10:42:05.608585 (+ 675us) server_negotiation.cc:407] Connection header received
0807 10:42:05.608828 (+ 243us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:42:05.608851 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:42:05.609067 (+ 216us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:42:05.609235 (+ 168us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 10:42:05.609709 (+ 474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:05.610426 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:05.611873 (+ 1447us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:05.612346 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:05.612491 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:05.613194 (+ 703us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 10:42:05.613505 (+ 311us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 10:42:05.613622 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0807 10:42:05.613761 (+ 139us) server_negotiation.cc:299] Negotiation successful
0807 10:42:05.613850 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":387,"thread_start_us":285,"threads_started":1}
I20260807 10:42:05.618862 12494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:05.608800 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35216 (local address 127.20.171.124:33825)
0807 10:42:05.608970 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0807 10:42:05.608975 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:42:05.614095 (+ 5120us) server_negotiation.cc:407] Connection header received
0807 10:42:05.614367 (+ 272us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:42:05.614372 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:42:05.614448 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:42:05.614511 (+ 63us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 10:42:05.615046 (+ 535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:05.615737 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:05.617266 (+ 1529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:05.617670 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:05.617811 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:05.618175 (+ 364us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 10:42:05.618266 (+ 91us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 10:42:05.618363 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0807 10:42:05.618504 (+ 141us) server_negotiation.cc:299] Negotiation successful
0807 10:42:05.618579 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260807 10:42:05.621570 12487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:05.607412 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60730 (local address 127.20.171.125:35143)
0807 10:42:05.607592 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0807 10:42:05.607596 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 10:42:05.612890 (+ 5294us) server_negotiation.cc:407] Connection header received
0807 10:42:05.613058 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:42:05.613066 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:42:05.613195 (+ 129us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:42:05.613309 (+ 114us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 10:42:05.614259 (+ 950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:05.615661 (+ 1402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:05.618686 (+ 3025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:05.619585 (+ 899us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:05.619723 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:05.620769 (+ 1046us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 10:42:05.620930 (+ 161us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 10:42:05.621003 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0807 10:42:05.621297 (+ 294us) server_negotiation.cc:299] Negotiation successful
0807 10:42:05.621377 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260807 10:42:05.627610 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 12124
I20260807 10:42:05.628520 12188 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:42:05.744047 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 12124
W20260807 10:42:05.769619 12218 connection.cc:535] server connection from 127.0.0.1:60564 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260807 10:42:05.770056 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 12200
I20260807 10:42:05.771152 12266 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:42:05.882261 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 12200
I20260807 10:42:05.908100 21165 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu pid 12280
I20260807 10:42:05.909329 12344 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:42:06.021510 21165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskXRtsKb/build/asan/bin/kudu with pid 12280
2026-08-07T10:42:06Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (5363 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (10502 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (369821 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST